00010000:00010000:0.0:1746065100.584377:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a88b5a00/0x14b4f8542d4ee551 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58290 expref: 30 pid: 9716 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746065100.584395:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065100.584412:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881260265088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065100.584418:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4363 00000100:00100000:0.0:1746065100.589025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.597321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.597355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.597379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.597734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.597751:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260265984 00000100:00100000:0.0:1746065100.597753:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260265984 00002000:00100000:0.0:1746065100.597780:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880095353800 x1830881260265984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:16/0 lens 488/0 e 0 to 0 dl 1746065111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065100.597789:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353800 with x1830881260265984 ext(2097152->3145727) 00002000:00010000:0.0:1746065100.597793:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353800 00000100:00100000:0.0:1746065100.598187:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260266240 00000100:00100000:0.0:1746065100.598190:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260266240 00002000:00100000:0.0:1746065100.598203:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880095352680 x1830881260266240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:16/0 lens 488/0 e 0 to 0 dl 1746065111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065100.598209:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352680 with x1830881260266240 ext(3145728->4194303) 00002000:00010000:0.0:1746065100.598211:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352680 00000100:00100000:0.0:1746065100.599757:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3893 00000100:00100000:0.0:1746065100.599764:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260265728:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065100.599886:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260265728:12345-192.168.202.46@tcp:3:cat.0 Request processed in 123us (2573us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065100.599893:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3893 00002000:00100000:0.0:1746065100.599898:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x37d:0x0] (585728->589823) req@ffff880095350e00 x1830881260265728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746065111 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065100.599904:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350e00 with x1830881260265728 ext(585728->589823) 00002000:00010000:0.0:1746065100.599906:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350e00 00000100:00100000:0.0:1746065100.601657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.601677:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260267008 00000100:00100000:0.0:1746065100.601682:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260267008 00000100:00100000:0.0:1746065100.601709:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3417 00000100:00100000:0.0:1746065100.601715:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:27965:x1830881260267008:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065100.601877:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:27965:x1830881260267008:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 160us (224us total) trans 8589942566 rc 0/0 00000100:00100000:0.0:1746065100.601882:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3417 00000100:00100000:0.0:1746065100.631651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.651867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.653615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.658067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.661287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.662274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.662333:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.667069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.670353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.671971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.677337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.677384:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.681159:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259439488:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065100.681176:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065100.681214:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260269312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3528us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065100.681223:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4366 00000100:00100000:0.0:1746065100.681867:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260269568 00000100:00100000:0.0:1746065100.681873:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260269568 00002000:00100000:0.0:1746065100.681898:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2957312->2961407) req@ffff88009a4ea300 x1830881260269568/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:16/0 lens 488/0 e 0 to 0 dl 1746065111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065100.681907:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ea300 with x1830881260269568 ext(2957312->2961407) 00002000:00010000:0.0:1746065100.681911:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ea300 00000100:00100000:0.0:1746065100.681923:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3896 00000100:00100000:0.0:1746065100.681928:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881260269568:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065100.682020:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881260269568:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 92us (584us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065100.682026:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3896 00002000:00100000:0.0:1746065100.682030:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2957312->2961407) req@ffff88009a4ea300 x1830881260269568/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:16/0 lens 488/4536 e 0 to 0 dl 1746065111 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065100.682036:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ea300 with x1830881260269568 ext(2957312->2961407) 00002000:00010000:0.0:1746065100.682039:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ea300 00000100:00100000:0.0:1746065100.686372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.691871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.693440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.694184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.697481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.699552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.699628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.706013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.733455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.735417:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.736231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.743944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.750184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.750340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.750381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.750397:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260272896 00000100:00100000:0.0:1746065100.750399:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260272896 00002000:00100000:0.0:1746065100.750413:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2142208->3190783) req@ffff880094ad5880 x1830881260272896/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:16/0 lens 488/0 e 0 to 0 dl 1746065111 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065100.750420:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad5880 with x1830881260272896 ext(2142208->3190783) 00002000:00010000:0.0:1746065100.750423:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ad5880 00000100:00100000:0.0:1746065100.750433:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3900 00000100:00100000:0.0:1746065100.750439:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881260272768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065100.780126:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.788122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.788156:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.788191:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.800100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.810899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.821115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.821571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.821617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.823062:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4371 00000100:00100000:0.0:1746065100.823073:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881260274432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065100.823086:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065100.823106:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b6a2a00/0x14b4f8542d4ee8a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5848f expref: 32 pid: 8427 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746065100.823117:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b6a2a00/0x14b4f8542d4ee8a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5848f expref: 32 pid: 8427 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746065100.823135:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b6a2a00/0x14b4f8542d4ee8a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5848f expref: 32 pid: 8427 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746065100.823155:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065100.823194:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260274432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 123us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065100.823200:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4371 00000100:00100000:0.0:1746065100.823215:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4372 00000100:00100000:0.0:1746065100.823220:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260274304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065100.823226:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065100.823233:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f35de00/0x14b4f8542d4ee75e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e583e7 expref: 20 pid: 21998 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065100.823241:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f35de00/0x14b4f8542d4ee75e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e583e7 expref: 20 pid: 21998 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065100.823252:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f35de00/0x14b4f8542d4ee75e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e583e7 expref: 20 pid: 21998 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065100.823261:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065100.823275:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881260274304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065100.823281:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4372 00000100:00100000:0.0:1746065100.823291:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4373 00000100:00100000:0.0:1746065100.823296:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260274560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065100.823301:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065100.823308:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090ba7e00/0x14b4f8542d4ee85a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5847a expref: 18 pid: 21998 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065100.823316:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090ba7e00/0x14b4f8542d4ee85a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5847a expref: 18 pid: 21998 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065100.823327:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090ba7e00/0x14b4f8542d4ee85a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5847a expref: 18 pid: 21998 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065100.823334:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065100.823336:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065100.823341:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5a00/0x14b4f8542d4ee8ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5849d expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065100.823348:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5a00/0x14b4f8542d4ee8ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5849d expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065100.823374:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5a00/0x14b4f8542d4ee8ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5849d expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065100.823385:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259440896:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065100.823424:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065100.827585:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9037 00000100:00100000:0.0:1746065100.827593:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881260274816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065100.827601:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065100.827611:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c9b800/0x14b4f8542d4ee8bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e584ab expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065100.827636:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259441152:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065100.827669:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065100.828610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.838666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.841906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.842575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.855987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.859436:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.870203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.881143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.881189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.882710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.898195:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260276992:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13270us (15477us total) trans 0 rc 409600/409600 00000100:00100000:0.0:1746065100.898207:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3909 00002000:00100000:0.0:1746065100.898219:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009b9fed80 x1830881260276992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:16/0 lens 504/440 e 0 to 0 dl 1746065111 ref 1 fl Complete:/200/0 rc 409600/409600 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065100.898229:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fed80 with x1830881260276992 ext(3145728->4194303) 00002000:00010000:0.0:1746065100.898235:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fed80 00000100:00100000:0.0:1746065100.906686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.928304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065100.934361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.006344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.015353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.020277:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.028801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.032617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.032657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.032695:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.032716:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260278912 00000100:00100000:0.0:1746065101.032722:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260278912 00002000:00100000:0.0:1746065101.032754:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88008fc5aa00 x1830881260278912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:17/0 lens 488/0 e 0 to 0 dl 1746065112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065101.032762:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5aa00 with x1830881260278912 ext(2097152->3145727) 00002000:00010000:0.0:1746065101.032766:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5aa00 00000100:00100000:0.0:1746065101.033406:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260279424 00000100:00100000:0.0:1746065101.033411:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260279424 00002000:00100000:0.0:1746065101.033430:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88008fc5b100 x1830881260279424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:17/0 lens 488/0 e 0 to 0 dl 1746065112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065101.033437:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b100 with x1830881260279424 ext(2097152->3145727) 00002000:00010000:0.0:1746065101.033440:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5b100 00000100:00100000:0.0:1746065101.033459:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3913 00000100:00100000:0.0:1746065101.033497:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260279168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065101.035577:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260279552 00000100:00100000:0.0:1746065101.035583:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260279552 00000100:00100000:0.0:1746065101.035613:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9043 00000100:00100000:0.0:1746065101.035621:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:27989:x1830881260279552:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065101.035632:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065101.035647:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7f6c00/0x14b4f8542d4ee909 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e584dc expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065101.035669:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3b7400/0x14b4f8542d4ee8c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584b2 expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065101.035676:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927da600/0x14b4f8542d4ee8f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584ce expref: 15 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065101.035683:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065101.035684:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065101.035688:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f6c00/0x14b4f8542d4ee909 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->3366911] (req 3145728->3366911) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584dc expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065101.035711:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927da600/0x14b4f8542d4ee8f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584ce expref: 15 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065101.035722:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927da600/0x14b4f8542d4ee8f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584ce expref: 15 pid: 21235 timeout: 800 lvb_type: 1 00000100:00100000:0.0:1746065101.035733:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259442048:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065101.035807:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3b7400/0x14b4f8542d4ee8c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584b2 expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065101.035837:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f3b7400/0x14b4f8542d4ee8c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584b2 expref: 22 pid: 8427 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746065101.035845:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259442176:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065101.035869:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065101.044765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.048119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.051216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.057603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.064941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.065019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.067931:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260280704 00000100:00100000:0.0:1746065101.067935:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260280704 00002000:00100000:0.0:1746065101.067954:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3366911) req@ffff88009009d180 x1830881260280704/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:17/0 lens 488/0 e 0 to 0 dl 1746065112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065101.067962:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009d180 with x1830881260280704 ext(3145728->3366911) 00010000:00010000:0.0:1746065101.067969:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f6c00/0x14b4f8542d4ee909 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584dc expref: 13 pid: 8429 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065101.067981:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7f6c00/0x14b4f8542d4ee909 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3366911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584dc expref: 13 pid: 8429 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746065101.067987:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009009d180 00000100:00100000:0.0:1746065101.067998:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1259 00000100:00100000:0.0:1746065101.068002:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260280704:12345-192.168.202.46@tcp:4:cat.0 00002000:00010000:0.0:1746065101.069704:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065101 -> 1746065102 00002000:00010000:0.0:1746065101.069709:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065101 -> 1746065102 00002000:00010000:0.0:1746065101.069711:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065101 -> 1746065102 00000100:00100000:0.0:1746065101.069725:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259442560:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065101.069746:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5ea00/0x14b4f8542d4ee917 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584ea expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065101.069756:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c5ea00/0x14b4f8542d4ee917 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e584ea expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065101.069789:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5ea00, rc 0) 00000100:00100000:0.0:1746065101.069860:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881260280320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4709us (4926us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065101.069866:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9045 00000100:00100000:0.0:1746065101.078022:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.079542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.085417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.085442:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260281600 00000100:00100000:0.0:1746065101.085449:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260281600 00010000:00010000:0.0:1746065101.085476:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3eb600/0x14b4f8542d4ee631 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5830e expref: 268 pid: 16767 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746065101.085517:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4379 00000100:00100000:0.0:1746065101.085539:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:1960:x1830881260281600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065101.085551:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065101.085559:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3eb600/0x14b4f8542d4ee631 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5830e expref: 268 pid: 16767 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065101.085569:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3eb600/0x14b4f8542d4ee631 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5830e expref: 268 pid: 16767 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065101.085588:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065101.085592:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a5f200/0x14b4f8542d4ee92c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.085599:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a5f200/0x14b4f8542d4ee92c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.085604:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065101.085637:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:1960:x1830881260281600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 114us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065101.085643:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4379 00000100:00100000:0.0:1746065101.087637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.087678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.092134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.101227:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3916 00000100:00100000:0.0:1746065101.101235:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260282496:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065101.109140:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.125083:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260282496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23837us (24498us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065101.125094:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3916 00002000:00100000:0.0:1746065101.125105:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009009f100 x1830881260282496/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:17/0 lens 488/440 e 0 to 0 dl 1746065112 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065101.125116:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009f100 with x1830881260282496 ext(3145728->4194303) 00002000:00010000:0.0:1746065101.125121:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009009f100 00000100:00100000:0.0:1746065101.140278:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.150043:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.153249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.156985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.161757:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.174012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.174102:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.177197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.184724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.212454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.263238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.269949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.269991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.270018:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260285568 00000100:00100000:0.0:1746065101.270022:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260285568 00010000:00010000:0.0:1746065101.270050:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c9f000/0x14b4f8542d4ee956 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5851b expref: 36 pid: 8429 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746065101.271703:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4382 00000100:00100000:0.0:1746065101.271714:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881260285568:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065101.271727:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065101.271751:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c9f000/0x14b4f8542d4ee956 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5851b expref: 35 pid: 8429 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065101.271766:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c9f000/0x14b4f8542d4ee956 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5851b expref: 35 pid: 8429 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065101.271788:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c9f000/0x14b4f8542d4ee956 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5851b expref: 35 pid: 8429 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065101.272507:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065101.272538:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881260285568:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 826us (2545us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065101.272544:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4382 00000100:00100000:0.0:1746065101.275073:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259444096:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065101.275092:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065101.275133:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881260285440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3290us (5191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065101.275142:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4383 00000100:00100000:0.0:1746065101.275802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.281166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.288167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.293105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.294355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.307233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.314491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.314574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.321040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.321283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.335372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.338164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.343625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.343713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.346932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.349847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.360150:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f14c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260288000:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 12930us (13222us total) trans 21474839750 rc 0/0 00000100:00100000:0.0:1746065101.360157:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1261 00002000:00100000:0.0:1746065101.360163:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3866623) req@ffff88012f14c000 x1830881260288000/t21474839750(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:17/0 lens 488/448 e 0 to 0 dl 1746065112 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065101.360171:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f14c000 with x1830881260288000 ext(3145728->3866623) 00010000:00010000:0.0:1746065101.360178:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090ba6000/0x14b4f8542d4ee972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58537 expref: 25 pid: 8429 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746065101.360191:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090ba6000/0x14b4f8542d4ee972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58537 expref: 25 pid: 8429 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746065101.360198:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f14c000 00000100:00100000:0.0:1746065101.366736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.366780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.374798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.376736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.395540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.404626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.415430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.425682:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.448578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.451707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.451770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.456738:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.456868:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.464748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.467348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.477113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.482670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.504839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.504932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.504968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.505009:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260292864 00000100:00100000:0.0:1746065101.505011:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260292864 00002000:00100000:0.0:1746065101.505024:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094ff6a00 x1830881260292864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:17/0 lens 488/0 e 0 to 0 dl 1746065112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065101.505029:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6a00 with x1830881260292864 ext(3145728->4194303) 00002000:00010000:0.0:1746065101.505033:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff6a00 00000100:00100000:0.0:1746065101.505043:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3934 00000100:00100000:0.0:1746065101.505046:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881260292864:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065101.531009:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.532280:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260292352:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27250us (27462us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065101.532289:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3932 00002000:00100000:0.0:1746065101.532881:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880094ff4a80 x1830881260292352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:17/0 lens 488/440 e 0 to 0 dl 1746065112 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065101.532894:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4a80 with x1830881260292352 ext(2097152->3145727) 00002000:00010000:0.0:1746065101.532899:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff4a80 00000100:00100000:0.0:1746065101.533707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.537307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.537960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.540035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.541001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065101.543533:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87400/0x14b4f8542d4eea67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543540:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87400/0x14b4f8542d4eea67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065101.543577:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00000004:00200000:0.0:1746065101.543582:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065101.543595:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87400/0x14b4f8542d4eea67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543604:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87400/0x14b4f8542d4eea67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543611:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87a00/0x14b4f8542d4eea59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543616:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87a00/0x14b4f8542d4eea59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543621:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87a00/0x14b4f8542d4eea59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543625:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090b87a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065101.543629:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87a00/0x14b4f8542d4eea59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543634:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87a00/0x14b4f8542d4eea59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543642:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065101.543644:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065101.543647:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87a00/0x14b4f8542d4eea59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543651:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87a00/0x14b4f8542d4eea59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543674:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87600/0x14b4f8542d4eea60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543678:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87600/0x14b4f8542d4eea60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543682:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87600/0x14b4f8542d4eea60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543686:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090b87600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065101.543688:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87600/0x14b4f8542d4eea60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543692:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87600/0x14b4f8542d4eea60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543697:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880135064a00) 00010000:00010000:0.0:1746065101.543699:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065101.543701:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87600/0x14b4f8542d4eea60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543708:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87600/0x14b4f8542d4eea60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065101.543741:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87e00/0x14b4f8542d4eea52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585a7 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065101.543750:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b87400/0x14b4f8542d4eea67 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585a7 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065101.543756:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065101.543758:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065101.543764:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b87400, rc 0) 00000100:00100000:0.0:1746065101.543787:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28016:x1830881260293248:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 9470us (10080us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065101.543793:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8642 00000100:00100000:0.0:1746065101.547475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.547883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.547910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.547942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.552512:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.562410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.570466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.573644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.575235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.579397:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260295808 00000100:00100000:0.0:1746065101.579404:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260295808 00000100:00100000:0.0:1746065101.579445:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3429 00000100:00100000:0.0:1746065101.579452:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28016:x1830881260295808:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1746065101.579624:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28016:x1830881260295808:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 171us (305us total) trans 8589942589 rc 0/0 00000100:00100000:0.0:1746065101.579630:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3429 00000100:00100000:0.0:1746065101.581477:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.581546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.587247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.589596:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.599809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.604425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.611897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.611924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.612236:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.613611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.620647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.622227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.672908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.678932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.684709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.684722:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.684744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.694540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.699990:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259448960 00000100:00100000:0.0:1746065101.699995:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259448960 00000100:00100000:0.0:1746065101.700919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.703553:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.704619:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.734486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.740398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.746875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.746902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.752935:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259449344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065101.754095:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259449344 00000100:00100000:0.0:1746065101.754102:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259449344 00000100:00100000:0.0:1746065101.754148:0:8431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1746065101.754155:0:8431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881259449344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065101.754187:0:8431:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 281083904 pending 23855104 free 3849322496 avail 3847225344 00000100:00100000:0.0:1746065101.754235:0:8431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881259449344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065101.754240:0:8431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1746065101.762731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.778443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.779461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.779496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.790032:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260301568 00000100:00100000:0.0:1746065101.790039:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260301568 00002000:00100000:0.0:1746065101.790077:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88008fc59c00 x1830881260301568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:17/0 lens 488/0 e 0 to 0 dl 1746065112 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065101.790085:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59c00 with x1830881260301568 ext(2097152->3145727) 00002000:00010000:0.0:1746065101.790089:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc59c00 00000100:00100000:0.0:1746065101.790115:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3943 00000100:00100000:0.0:1746065101.790121:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260301568:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065101.795911:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260301056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16118us (16584us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065101.795922:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3942 00002000:00100000:0.0:1746065101.795927:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880134d86a00 x1830881260301056/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:17/0 lens 488/440 e 0 to 0 dl 1746065112 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065101.795933:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86a00 with x1830881260301056 ext(2097152->3145727) 00002000:00010000:0.0:1746065101.795936:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d86a00 00000100:00100000:0.0:1746065101.815001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.818118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.820754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.821149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.821206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.845241:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.964653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.983111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.983158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.985572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065101.999737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.002766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.002806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.002879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.008139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.008169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.023286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.038713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.040594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.048717:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.049156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.055167:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.055215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.058374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.059103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.061000:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260307456 00000100:00100000:0.0:1746065102.061006:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260307456 00002000:00100000:0.0:1746065102.061028:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1327103) req@ffff88008fc58a80 x1830881260307456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:18/0 lens 488/0 e 0 to 0 dl 1746065113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.061036:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58a80 with x1830881260307456 ext(1048576->1327103) 00002000:00010000:0.0:1746065102.061040:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc58a80 00000100:00100000:0.0:1746065102.061055:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3948 00000100:00100000:0.0:1746065102.061061:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260307456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065102.066380:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260307456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5309us (5424us total) trans 0 rc 278528/278528 00000100:00100000:0.0:1746065102.066390:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3948 00002000:00100000:0.0:1746065102.066401:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1327103) req@ffff88008fc58a80 x1830881260307456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:18/0 lens 488/440 e 0 to 0 dl 1746065113 ref 1 fl Complete:/200/0 rc 278528/278528 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.066410:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58a80 with x1830881260307456 ext(1048576->1327103) 00002000:00010000:0.0:1746065102.066415:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc58a80 00000100:00100000:0.0:1746065102.072073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.072526:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.075478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.077619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.077654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.084216:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.090018:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.201956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.201997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.202907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.215314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.222346:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.222415:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.222454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.222486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.222527:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260309760 00000100:00100000:0.0:1746065102.222534:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260309760 00010000:00010000:0.0:1746065102.222564:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3eaa00/0x14b4f8542d4eea75 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585b5 expref: 8 pid: 8429 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.222585:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260309888 00000100:00100000:0.0:1746065102.222587:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260309888 00010000:00010000:0.0:1746065102.222595:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9200/0x14b4f8542d4eeb16 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58602 expref: 25 pid: 8427 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.222605:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260310016 00000100:00100000:0.0:1746065102.222607:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260310016 00010000:00010000:0.0:1746065102.222623:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090ba7800/0x14b4f8542d4eea28 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58599 expref: 36 pid: 8429 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746065102.222635:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4416 00000100:00100000:0.0:1746065102.222641:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260309760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.222651:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.222668:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3eaa00/0x14b4f8542d4eea75 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585b5 expref: 8 pid: 8429 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.222677:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3eaa00/0x14b4f8542d4eea75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585b5 expref: 8 pid: 8429 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.222697:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.222733:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260309760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 92us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.222739:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4416 00000100:00100000:0.0:1746065102.222755:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4417 00000100:00100000:0.0:1746065102.222759:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260309888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.222765:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.222771:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9200/0x14b4f8542d4eeb16 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58602 expref: 25 pid: 8427 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.222778:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9200/0x14b4f8542d4eeb16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58602 expref: 25 pid: 8427 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.222786:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.222796:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260309888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 37us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.222801:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4417 00000100:00100000:0.0:1746065102.222809:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4418 00000100:00100000:0.0:1746065102.222812:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881260310016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.222840:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.222846:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090ba7800/0x14b4f8542d4eea28 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58599 expref: 36 pid: 8429 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.222854:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090ba7800/0x14b4f8542d4eea28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58599 expref: 36 pid: 8429 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.222865:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.222866:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.222872:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4e00/0x14b4f8542d4eec0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586a3 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.222878:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4e00/0x14b4f8542d4eec0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586a3 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.222904:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4e00/0x14b4f8542d4eec0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586a3 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065102.222915:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259452928:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065102.222961:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f600 going to sleep for 11 seconds 00000100:00080000:0.0:1746065102.222973:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065102.229157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.230380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.230414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.241936:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4419 00000100:00100000:0.0:1746065102.241946:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881260310784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.241965:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.241981:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f278800/0x14b4f8542d4ee948 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5850d expref: 35 pid: 8429 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.242009:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f278800/0x14b4f8542d4ee948 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5850d expref: 35 pid: 8429 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.242246:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f278800/0x14b4f8542d4ee948 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5850d expref: 35 pid: 8429 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.242266:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.242282:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881260310784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 339us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.242288:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4419 00000100:00100000:0.0:1746065102.242327:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260311168 00000100:00100000:0.0:1746065102.242330:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260311168 00010000:00010000:0.0:1746065102.242339:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090b87800/0x14b4f8542d4eea1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5858b expref: 34 pid: 9716 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.242351:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4421 00000100:00100000:0.0:1746065102.242355:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881260311168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.242361:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.242367:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090b87800/0x14b4f8542d4eea1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5858b expref: 34 pid: 9716 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.242374:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090b87800/0x14b4f8542d4eea1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5858b expref: 34 pid: 9716 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.242384:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b87800/0x14b4f8542d4eea1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5858b expref: 34 pid: 9716 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.242393:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.242407:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260311168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.242415:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4421 00000100:00100000:0.0:1746065102.245169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.248478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.256033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.259341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.259380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.259985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.260320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.272327:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.273930:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260313088 00000100:00100000:0.0:1746065102.273939:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260313088 00000100:00100000:0.0:1746065102.274007:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8654 00000100:00100000:0.0:1746065102.274015:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:28058:x1830881260313088:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065102.274033:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065102.274046:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b58f600/0x14b4f8542d4eec2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e586c6 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.274177:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b58f800/0x14b4f8542d4eec35 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065102.274189:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b58f800/0x14b4f8542d4eec35 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065102.274198:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b58f800/0x14b4f8542d4eec35 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065102.274207:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065102.274400:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b58f600/0x14b4f8542d4eec2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586c6 expref: 279 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.274415:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b58f800/0x14b4f8542d4eec35 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586c6 expref: 278 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.274423:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065102.274425:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065102.274428:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b58f800, rc 0) 00000100:00100000:0.0:1746065102.274447:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:28058:x1830881260313088:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 433us (2126us total) trans 8589942602 rc 0/0 00000100:00100000:0.0:1746065102.274453:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8654 00000100:00100000:0.0:1746065102.295419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.297993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.298037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.308120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.329081:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260314112 00000100:00100000:0.0:1746065102.329085:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260314112 00000100:00100000:0.0:1746065102.329107:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9097 00000100:00100000:0.0:1746065102.329112:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881260314112:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065102.329123:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065102.329132:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f894200/0x14b4f8542d4eec4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e586d4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.329144:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.329146:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.329151:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f894200/0x14b4f8542d4eec4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586d4 expref: 25 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.329161:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f894200/0x14b4f8542d4eec4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586d4 expref: 25 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.329168:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f894200, rc 0) 00000100:00100000:0.0:1746065102.329189:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881260314112:12345-192.168.202.46@tcp:101:cat.0 Request processed in 77us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.329194:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9097 00000100:00100000:0.0:1746065102.336012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.337046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.351037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.355545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.361623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.361646:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.361664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.361681:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260315008 00000100:00100000:0.0:1746065102.361687:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260315008 00010000:00010000:0.0:1746065102.361713:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6800/0x14b4f8542d4eeba9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58664 expref: 7 pid: 8851 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.361728:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260315136 00000100:00100000:0.0:1746065102.361730:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260315136 00010000:00010000:0.0:1746065102.361735:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be6a400/0x14b4f8542d4eeb32 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5861e expref: 33 pid: 8851 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746065102.361742:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260315264 00000100:00100000:0.0:1746065102.361743:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260315264 00010000:00010000:0.0:1746065102.361748:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6144000/0x14b4f8542d4eeb2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58617 expref: 20 pid: 8851 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746065102.361756:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4426 00000100:00100000:0.0:1746065102.361760:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881260315008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.361769:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.361783:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6800/0x14b4f8542d4eeba9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58664 expref: 7 pid: 8851 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.361790:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6800/0x14b4f8542d4eeba9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58664 expref: 7 pid: 8851 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.361808:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.361855:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881260315008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.361859:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4426 00000100:00100000:0.0:1746065102.361875:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4428 00000100:00100000:0.0:1746065102.361878:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1959:x1830881260315264:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.361882:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.361887:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6144000/0x14b4f8542d4eeb2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58617 expref: 20 pid: 8851 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.361892:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6144000/0x14b4f8542d4eeb2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58617 expref: 20 pid: 8851 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.361898:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.361900:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.361905:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6e00/0x14b4f8542d4eec51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2457600->3088383) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586db expref: 32 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.361910:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6e00/0x14b4f8542d4eec51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2457600->3088383) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586db expref: 32 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.361929:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6e00/0x14b4f8542d4eec51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2457600->3088383) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586db expref: 32 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065102.361936:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259454976:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065102.361966:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065102.364028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.371908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.371995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.372897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.376199:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.377771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.386411:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3964 00000100:00100000:0.0:1746065102.386419:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260317696:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065102.387411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.387447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.388055:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9101 00000100:00100000:0.0:1746065102.388060:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881260318336:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065102.388066:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065102.388074:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f895400/0x14b4f8542d4eec82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e586fe expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.388084:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.388085:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.388090:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f895400/0x14b4f8542d4eec82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586fe expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.388101:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f895400/0x14b4f8542d4eec82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586fe expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.388108:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f895400, rc 0) 00000100:00100000:0.0:1746065102.388131:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260318336:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 71us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.388135:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9101 00000100:00100000:0.0:1746065102.404334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.407351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.409973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.411833:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.412434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.412458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.412470:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260319616 00000100:00100000:0.0:1746065102.412472:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260319616 00000100:00100000:0.0:1746065102.412488:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260319744 00000100:00100000:0.0:1746065102.412489:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260319744 00000100:00100000:0.0:1746065102.412507:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9105 00000100:00100000:0.0:1746065102.412521:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260319616:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065102.412541:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f894c00/0x14b4f8542d4eecc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.412557:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092daa200/0x14b4f8542d4ee845 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5845e expref: 24 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.412564:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a112400/0x14b4f8542d4eea6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585ae expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.412570:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4800/0x14b4f8542d4ee899 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58488 expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.412574:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.412576:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.412578:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f894c00/0x14b4f8542d4eecc8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.412601:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4800/0x14b4f8542d4ee899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58488 expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.412611:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4800/0x14b4f8542d4ee899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58488 expref: 36 pid: 21998 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.412621:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259455744:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065102.412682:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a112400/0x14b4f8542d4eea6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585ae expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.412689:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a112400/0x14b4f8542d4eea6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585ae expref: 8 pid: 8429 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.412700:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259455872:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065102.412720:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092daa200/0x14b4f8542d4ee845 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5845e expref: 24 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.412727:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092daa200/0x14b4f8542d4ee845 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5845e expref: 24 pid: 21998 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746065102.412734:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259456000:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065102.412748:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065102.412768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.412797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.413128:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.413140:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260320128 00000100:00100000:0.0:1746065102.413143:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260320128 00000100:00100000:0.0:1746065102.413156:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9108 00000100:00100000:0.0:1746065102.413160:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260320000:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065102.413174:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a47d400/0x14b4f8542d4eecdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.413182:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a47d600/0x14b4f8542d4eec43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586cd expref: 36 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.413188:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f895400/0x14b4f8542d4eec82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586fe expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.413198:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f894200/0x14b4f8542d4eec4a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586d4 expref: 24 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.413203:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.413204:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.413206:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a47d400/0x14b4f8542d4eecdd lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.413218:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f894200/0x14b4f8542d4eec4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586d4 expref: 24 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.414417:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f894200/0x14b4f8542d4eec4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586d4 expref: 24 pid: 8851 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.414425:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259456896:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065102.419398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.419421:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260320512 00000100:00100000:0.0:1746065102.419429:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260320512 00010000:00010000:0.0:1746065102.419458:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4800/0x14b4f8542d4ee899 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58488 expref: 37 pid: 21998 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.419482:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4433 00000100:00100000:0.0:1746065102.419489:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881260320512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.419502:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.419532:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4800/0x14b4f8542d4ee899 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58488 expref: 37 pid: 21998 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.419543:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4800/0x14b4f8542d4ee899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58488 expref: 37 pid: 21998 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.419564:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.419597:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881260320512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.419602:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4433 00000100:00100000:0.0:1746065102.419634:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.419644:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260320384 00000100:00100000:0.0:1746065102.419646:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260320384 00010000:00010000:0.0:1746065102.419655:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a112400/0x14b4f8542d4eea6e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585ae expref: 11 pid: 8429 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.419684:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4434 00000100:00100000:0.0:1746065102.419688:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881260320384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.419695:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.419702:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a112400/0x14b4f8542d4eea6e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585ae expref: 11 pid: 8429 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.419709:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a112400/0x14b4f8542d4eea6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e585ae expref: 11 pid: 8429 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.419718:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.419731:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881260320384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 42us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.419735:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4434 00000100:00100000:0.0:1746065102.425288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.425304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.425321:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260321024 00000100:00100000:0.0:1746065102.425325:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260321024 00010000:00010000:0.0:1746065102.425354:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f137400/0x14b4f8542d4eec04 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5869c expref: 31 pid: 8427 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.425384:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260320768 00000100:00100000:0.0:1746065102.425387:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260320768 00010000:00010000:0.0:1746065102.425397:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a47da00/0x14b4f8542d4eec89 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586f7 expref: 11 pid: 4545 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.425410:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4437 00000100:00100000:0.0:1746065102.425413:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260320768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.425418:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.425433:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a47da00/0x14b4f8542d4eec89 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586f7 expref: 11 pid: 4545 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.425638:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a47da00/0x14b4f8542d4eec89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586f7 expref: 11 pid: 4545 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.425875:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a47da00/0x14b4f8542d4eec89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586f7 expref: 11 pid: 4545 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.425886:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.425905:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260320768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 491us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.425911:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4437 00000100:00100000:0.0:1746065102.425923:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4438 00000100:00100000:0.0:1746065102.425927:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260321152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.425934:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.425945:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b15b800/0x14b4f8542d4eec97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58705 expref: 9 pid: 8851 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.425952:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b15b800/0x14b4f8542d4eec97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58705 expref: 9 pid: 8851 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.425963:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b15b800/0x14b4f8542d4eec97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58705 expref: 9 pid: 8851 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.425971:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.425985:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260321152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.425990:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4438 00000100:00100000:0.0:1746065102.425998:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260321280 00000100:00100000:0.0:1746065102.426000:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260321280 00010000:00010000:0.0:1746065102.426008:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7800/0x14b4f8542d4eec12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586aa expref: 30 pid: 4545 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746065102.426161:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260320896 00000100:00100000:0.0:1746065102.426165:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260320896 00010000:00010000:0.0:1746065102.426176:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be6a400/0x14b4f8542d4eec7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586f0 expref: 10 pid: 8851 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746065102.426189:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4439 00000100:00100000:0.0:1746065102.426193:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260321280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.426199:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.426206:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7800/0x14b4f8542d4eec12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586aa expref: 30 pid: 4545 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.426213:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7800/0x14b4f8542d4eec12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586aa expref: 30 pid: 4545 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.426222:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7800/0x14b4f8542d4eec12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586aa expref: 30 pid: 4545 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.426230:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.426243:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881260321280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.426248:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4439 00000100:00100000:0.0:1746065102.426258:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4440 00000100:00100000:0.0:1746065102.426262:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260320896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.426267:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.426273:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be6a400/0x14b4f8542d4eec7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586f0 expref: 10 pid: 8851 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.426279:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be6a400/0x14b4f8542d4eec7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586f0 expref: 10 pid: 8851 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.426288:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be6a400/0x14b4f8542d4eec7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586f0 expref: 10 pid: 8851 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746065102.426299:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.426311:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881260320896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.426315:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4440 00000100:00100000:0.0:1746065102.426393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.426417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.426427:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260321792 00000100:00100000:0.0:1746065102.426429:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260321792 00010000:00010000:0.0:1746065102.426439:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4eec27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586bf expref: 19 pid: 21235 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746065102.426452:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4441 00000100:00100000:0.0:1746065102.426456:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881260321792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.426462:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.426468:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4eec27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586bf expref: 19 pid: 21235 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.426475:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4eec27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586bf expref: 19 pid: 21235 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.426485:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4eec27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586bf expref: 19 pid: 21235 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.426493:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.426494:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.426498:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.426505:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.428564:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.428928:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881260321792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2138us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.428934:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4441 00010000:00010000:0.0:1746065102.428980:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.428988:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.429004:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.429010:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.429016:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.429022:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f137e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065102.429025:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.429035:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.429044:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.429049:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f137e00/0x14b4f8542d4eeccf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065102.429705:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260319744:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 16977us (17244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.429712:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9106 00010000:00010000:0.0:1746065102.429905:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f136a00/0x14b4f8542d4eecd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.430213:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f136a00/0x14b4f8542d4eecd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.430229:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f136a00/0x14b4f8542d4eecd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.430234:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f136a00/0x14b4f8542d4eecd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.430240:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f136a00/0x14b4f8542d4eecd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.430249:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f136a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065102.430251:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f136a00/0x14b4f8542d4eecd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.430257:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f136a00/0x14b4f8542d4eecd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.430266:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f136a00/0x14b4f8542d4eecd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.430271:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f136a00/0x14b4f8542d4eecd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065102.430317:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881260319872:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 17443us (17546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.430323:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9107 00000100:00100000:0.0:1746065102.432650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.432682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.432693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.432707:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.432732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.434741:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9114 00000100:00100000:0.0:1746065102.434747:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260322304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065102.434753:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065102.434759:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f27b600/0x14b4f8542d4eed07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58728 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065102.434769:0:21235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6cf, atime: 0x6812d6cf, ctime: 0x6812d6cf, blocks: 0x821 00010000:00010000:0.0:1746065102.434775:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.434777:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.434780:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f27b600/0x14b4f8542d4eed07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58728 expref: 33 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.434789:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f27b600/0x14b4f8542d4eed07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58728 expref: 33 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.434795:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f27b600, rc 0) 00000100:00100000:0.0:1746065102.434809:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260322304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 62us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.434834:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9114 00000100:00100000:0.0:1746065102.434877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.437732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.440524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.444484:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260323200 00000100:00100000:0.0:1746065102.444490:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260323200 00010000:00010000:0.0:1746065102.444522:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6e00/0x14b4f8542d4eec51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2457600->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586db expref: 34 pid: 21235 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746065102.444538:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4447 00000100:00100000:0.0:1746065102.444542:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881260323200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.444550:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.444730:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6e00/0x14b4f8542d4eec51 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2457600->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586db expref: 35 pid: 21235 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.444741:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6e00/0x14b4f8542d4eec51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2457600->3088383) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e586db expref: 35 pid: 21235 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.444757:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.444759:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.444762:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15b600/0x14b4f8542d4eeceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.444769:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15b600/0x14b4f8542d4eeceb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.444792:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.444834:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881260323200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 290us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.444840:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4447 00000100:00100000:0.0:1746065102.447572:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260323840 00000100:00100000:0.0:1746065102.447576:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260323840 00002000:00100000:0.0:1746065102.447598:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x380:0x0] (4632576->4636671) req@ffff88009a4ebb80 x1830881260323840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:18/0 lens 488/0 e 0 to 0 dl 1746065113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.447606:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ebb80 with x1830881260323840 ext(4632576->4636671) 00002000:00010000:0.0:1746065102.447610:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ebb80 00000100:00100000:0.0:1746065102.447789:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3967 00000100:00100000:0.0:1746065102.447796:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881260323840:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065102.448180:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881260323840:12345-192.168.202.46@tcp:3:cat.0 Request processed in 384us (763us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065102.448190:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3967 00002000:00100000:0.0:1746065102.448195:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x380:0x0] (4632576->4636671) req@ffff88009a4ebb80 x1830881260323840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:18/0 lens 488/4536 e 0 to 0 dl 1746065113 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.448202:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ebb80 with x1830881260323840 ext(4632576->4636671) 00002000:00010000:0.0:1746065102.448205:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ebb80 00000100:00100000:0.0:1746065102.451895:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.451923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.452486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.452668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.453924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.454450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.454462:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260324864 00000100:00100000:0.0:1746065102.454465:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260324864 00010000:00010000:0.0:1746065102.454476:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d0a00/0x14b4f8542d4ee4f6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58227 expref: 275 pid: 24350 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746065102.454490:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4453 00000100:00100000:0.0:1746065102.454494:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:1959:x1830881260324864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065102.454500:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065102.454504:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d0a00/0x14b4f8542d4ee4f6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58227 expref: 275 pid: 24350 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.454511:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d0a00/0x14b4f8542d4ee4f6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58227 expref: 275 pid: 24350 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746065102.454531:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065102.454534:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5a00/0x14b4f8542d4eed2a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065102.454541:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5a00/0x14b4f8542d4eed2a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065102.454547:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5a00/0x14b4f8542d4eed2a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065102.454562:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065102.454577:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:1959:x1830881260324864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.454582:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4453 00000100:00100000:0.0:1746065102.484146:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259458816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065102.484167:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065102.484177:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259459328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065102.484188:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065102.484533:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259459840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065102.484555:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065102.484566:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065102.484570:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259459968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065102.484582:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065102.485182:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9125 00000100:00100000:0.0:1746065102.485188:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3297:x1830881259459328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065102.485260:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065102.485262:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065102.485264:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065102.485265:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065102.485267:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065102.485286:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3297:x1830881259459328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (1097us total) trans 17179872502 rc 0/0 00000100:00100000:0.0:1746065102.485290:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9125 00000100:00100000:0.0:1746065102.485300:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9127 00000100:00100000:0.0:1746065102.485304:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259459968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065102.485366:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065102.485368:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065103 -> 1746065103 00002000:00010000:0.0:1746065102.485370:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065102 -> 1746065102 00002000:00010000:0.0:1746065102.485371:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065103 -> 1746065103 00002000:00010000:0.0:1746065102.485373:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2075 -> 2075 00000100:00100000:0.0:1746065102.485388:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259459968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (805us total) trans 21474839759 rc 0/0 00000100:00100000:0.0:1746065102.485392:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9127 00000100:00100000:0.0:1746065102.485400:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259459456 00000100:00100000:0.0:1746065102.485402:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259459456 00000100:00100000:0.0:1746065102.485414:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9128 00000100:00100000:0.0:1746065102.485418:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259459456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065102.485471:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065102.485473:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065102.485474:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065102.485476:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065102.485477:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065102.485494:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259459456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (101us total) trans 17179872503 rc 0/0 00000100:00100000:0.0:1746065102.485498:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9128 00000004:00080000:0.0:1746065102.485533:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f045500/2, rc 0, transno 21474839759 00000100:00100000:0.0:1746065102.485538:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259459968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065102.485544:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f045180/2, rc 0, transno 21474839758 00000100:00100000:0.0:1746065102.485546:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259459840:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065102.485552:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d509180/2, rc 0, transno 17179872501 00000100:00100000:0.0:1746065102.485554:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259458816:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065102.485559:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d508700/2, rc 0, transno 17179872502 00000100:00100000:0.0:1746065102.485562:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259459328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065102.485571:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259460096 00000100:00100000:0.0:1746065102.485573:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259460096 00000100:00100000:0.0:1746065102.485586:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9129 00000100:00100000:0.0:1746065102.485589:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881259460096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065102.485663:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3295:x1830881259460096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (127us total) trans 21474839760 rc 0/0 00000100:00100000:0.0:1746065102.485668:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9129 00000100:00100000:0.0:1746065102.485944:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259460352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065102.485961:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065102.485994:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259460864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065102.486009:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065102.486351:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f044e00/2, rc 0, transno 21474839761 00000100:00100000:0.0:1746065102.486355:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259460352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065102.486361:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd07480/2, rc 0, transno 21474839763 00000100:00100000:0.0:1746065102.486363:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259460864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065102.486428:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259460608 00000100:00100000:0.0:1746065102.486430:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259460608 00000100:00100000:0.0:1746065102.486457:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9133 00000100:00100000:0.0:1746065102.486462:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3295:x1830881259460608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065102.486532:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065102.486534:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065102.486755:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065102.486757:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065102.486758:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065102.486779:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881259460608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 317us (362us total) trans 21474839764 rc 0/0 00000100:00100000:0.0:1746065102.486783:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9133 00000100:00100000:0.0:1746065102.489004:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259460224 00000100:00100000:0.0:1746065102.489016:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259460224 00000100:00100000:0.0:1746065102.489049:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259460736 00000100:00100000:0.0:1746065102.489051:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259460736 00000100:00100000:0.0:1746065102.489062:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9134 00000100:00100000:0.0:1746065102.489068:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881259460224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065102.489988:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259460224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 919us (3528us total) trans 17179872506 rc 0/0 00000100:00100000:0.0:1746065102.489994:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9134 00000100:00100000:0.0:1746065102.494854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.495631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.499176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.500730:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9137 00000100:00100000:0.0:1746065102.500735:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260326656:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065102.500742:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065102.500749:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f27ac00/0x14b4f8542d4eeda1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58791 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.500762:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.500763:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.500767:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f27ac00/0x14b4f8542d4eeda1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58791 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.500774:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f27ac00/0x14b4f8542d4eeda1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58791 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.500781:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f27ac00, rc 0) 00000100:00100000:0.0:1746065102.500793:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260326656:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 59us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.500798:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9137 00000100:00100000:0.0:1746065102.500806:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9139 00000100:00100000:0.0:1746065102.500810:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260326272:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065102.500829:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065102.500835:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f27ae00/0x14b4f8542d4eedaf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5877c expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065102.500843:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.500844:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065102.500848:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f27ae00/0x14b4f8542d4eedaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5877c expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.500856:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f27ae00/0x14b4f8542d4eedaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5877c expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065102.500866:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f27ae00, rc 0) 00000100:00100000:0.0:1746065102.501254:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260326272:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 443us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065102.501259:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9139 00000100:00100000:0.0:1746065102.518455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.518506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.518549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.519812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.520876:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3970 00000100:00100000:0.0:1746065102.520882:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260328192:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065102.548098:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881260328192:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27208us (29582us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065102.548108:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3970 00002000:00100000:0.0:1746065102.548118:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f15ca80 x1830881260328192/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:18/0 lens 488/440 e 0 to 0 dl 1746065113 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.548125:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ca80 with x1830881260328192 ext(1048576->2097151) 00002000:00010000:0.0:1746065102.548130:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15ca80 00000100:00100000:0.0:1746065102.548659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.550705:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.550747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:0.0:1746065102.578895:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06a00/2, rc 0, transno 21474839772 00000100:00100000:0.0:1746065102.578902:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259461888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065102.578908:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd04000/2, rc 0, transno 21474839773 00000100:00100000:0.0:1746065102.578911:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259462400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065102.578917:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ad4380/2, rc 0, transno 17179872508 00000100:00100000:0.0:1746065102.578923:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259462912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065102.578928:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fd500/2, rc 0, transno 17179872509 00000100:00100000:0.0:1746065102.578930:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259463424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065102.578935:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05180/2, rc 0, transno 21474839770 00000100:00100000:0.0:1746065102.578937:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259461504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065102.578942:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05f80/2, rc 0, transno 21474839771 00000100:00100000:0.0:1746065102.578945:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259462016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065102.578951:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba1f80/2, rc 0, transno 17179872514 00000100:00100000:0.0:1746065102.578953:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259462528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065102.578960:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ad4e00/2, rc 0, transno 17179872507 00000100:00100000:0.0:1746065102.578962:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259463040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065102.578971:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259463552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065102.578993:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065102.579394:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009009e680/2, rc 0, transno 17179872515 00000100:00100000:0.0:1746065102.579398:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259463552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065102.580330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.588036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.590894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.590921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.591159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.591194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.593731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.617070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.617724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.618329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.624497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.626681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.626742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.630945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.677143:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.677193:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.689905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.693166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.696218:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.704630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.704662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.704696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.712685:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260334592 00000100:00100000:0.0:1746065102.712691:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260334592 00002000:00100000:0.0:1746065102.712714:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009f9cd880 x1830881260334592/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:18/0 lens 488/0 e 0 to 0 dl 1746065113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.712721:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd880 with x1830881260334592 ext(2097152->3145727) 00002000:00010000:0.0:1746065102.712726:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cd880 00000100:00100000:0.0:1746065102.712751:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3983 00000100:00100000:0.0:1746065102.712757:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881260334592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065102.717769:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881260334720:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12631us (13066us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065102.717782:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3982 00002000:00100000:0.0:1746065102.717791:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880135005880 x1830881260334720/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:18/0 lens 488/440 e 0 to 0 dl 1746065113 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.717798:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135005880 with x1830881260334720 ext(3145728->4194303) 00002000:00010000:0.0:1746065102.717803:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135005880 00000100:00100000:0.0:1746065102.719967:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260334208:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14882us (15330us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065102.719977:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3980 00002000:00100000:0.0:1746065102.719986:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880135005500 x1830881260334208/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:18/0 lens 488/440 e 0 to 0 dl 1746065113 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.719994:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135005500 with x1830881260334208 ext(2097152->3145727) 00002000:00010000:0.0:1746065102.719999:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135005500 00000100:00100000:0.0:1746065102.730865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.730895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.730917:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.730945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.730957:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260335488 00000100:00100000:0.0:1746065102.730961:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260335488 00002000:00100000:0.0:1746065102.730996:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880135007480 x1830881260335488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:18/0 lens 488/0 e 0 to 0 dl 1746065113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.731005:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135007480 with x1830881260335488 ext(1048576->2097151) 00002000:00010000:0.0:1746065102.731010:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135007480 00000100:00100000:0.0:1746065102.731021:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260335744 00000100:00100000:0.0:1746065102.731023:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260335744 00002000:00100000:0.0:1746065102.731030:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880135007100 x1830881260335744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:18/0 lens 504/0 e 0 to 0 dl 1746065113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.731037:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135007100 with x1830881260335744 ext(1048576->2097151) 00002000:00010000:0.0:1746065102.731040:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135007100 00000100:00100000:0.0:1746065102.731045:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260336000 00000100:00100000:0.0:1746065102.731046:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260336000 00002000:00100000:0.0:1746065102.731053:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88008f49ce00 x1830881260336000/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:18/0 lens 488/0 e 0 to 0 dl 1746065113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.731059:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ce00 with x1830881260336000 ext(1048576->2097151) 00002000:00010000:0.0:1746065102.731061:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49ce00 00000100:00100000:0.0:1746065102.731091:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3984 00000100:00100000:0.0:1746065102.731098:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881260335488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065102.735441:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260336128 00000100:00100000:0.0:1746065102.735453:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260336128 00000100:00100000:0.0:1746065102.735519:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9169 00000100:00100000:0.0:1746065102.735527:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881260336128:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065102.735544:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065102.735561:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4eee7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58816 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065102.735606:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259464448:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065102.735975:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065102.751395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.769164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.769213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.769961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.769975:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260337408 00000100:00100000:0.0:1746065102.769978:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260337408 00002000:00100000:0.0:1746065102.769995:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88008f49d880 x1830881260337408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:18/0 lens 488/0 e 0 to 0 dl 1746065113 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065102.770001:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d880 with x1830881260337408 ext(2097152->3145727) 00002000:00010000:0.0:1746065102.770005:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49d880 00000100:00100000:0.0:1746065102.770027:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3991 00000100:00100000:0.0:1746065102.770032:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260337408:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:0.0:1746065102.781611:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065102.801745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.810481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.857463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.872389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.879003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.883921:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.889263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.893681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.900138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.902724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.933288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.938108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.967992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.975099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.986488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.988609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.988672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.996261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065102.996306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.002248:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260342272 00000100:00100000:0.0:1746065103.002256:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260342272 00002000:00100000:0.0:1746065103.002298:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2646016->2650111) req@ffff88009baa1880 x1830881260342272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/0 e 0 to 0 dl 1746065114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.002308:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1880 with x1830881260342272 ext(2646016->2650111) 00002000:00010000:0.0:1746065103.002315:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1880 00000100:00100000:0.0:1746065103.002346:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3999 00000100:00100000:0.0:1746065103.002352:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881260342272:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065103.002669:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881260342272:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 316us (679us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065103.002675:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3999 00002000:00100000:0.0:1746065103.002681:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2646016->2650111) req@ffff88009baa1880 x1830881260342272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746065114 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.002687:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1880 with x1830881260342272 ext(2646016->2650111) 00002000:00010000:0.0:1746065103.002690:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1880 00000100:00100000:0.0:1746065103.005443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065103.005493:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065103.010140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.010188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.022361:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260343424 00000100:00100000:0.0:1746065103.022370:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260343424 00000100:00100000:0.0:1746065103.022409:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8673 00000100:00100000:0.0:1746065103.022416:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:28090:x1830881260343424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065103.022436:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065103.022453:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f278800/0x14b4f8542d4eef14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5885c expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.022557:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022567:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022576:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022587:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022592:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022596:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022693:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022701:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022706:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065103.022715:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065103.022779:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022785:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022790:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022795:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a5200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065103.022798:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022804:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022813:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065103.022834:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065103.022839:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022844:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5200/0x14b4f8542d4eef29 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022858:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022862:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022866:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022870:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b28c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065103.022872:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022876:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022885:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065103.022887:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065103.022890:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022894:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b28c00/0x14b4f8542d4eef1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022900:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022904:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022908:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022913:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a4c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065103.022915:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022918:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022923:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715400) 00010000:00010000:0.0:1746065103.022924:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065103.022926:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022930:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4eef22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.022955:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f278800/0x14b4f8542d4eef14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5885c expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.022963:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f278800/0x14b4f8542d4eef14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5885c expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.022969:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f278800, rc 0) 00000100:00100000:0.0:1746065103.023005:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:28090:x1830881260343424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 590us (675us total) trans 8589942623 rc 301/301 00000100:00100000:0.0:1746065103.023011:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8673 00000100:00100000:0.0:1746065103.023033:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4003 00000100:00100000:0.0:1746065103.023038:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f14e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881260343808:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065103.031632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.037448:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.040720:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.041409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.041425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.041444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065103.041884:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065103.041887:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065103.041903:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8675 00000100:00100000:0.0:1746065103.041908:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+15:28092:x1830881260344448:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065103.041917:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065103.041926:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4600/0x14b4f8542d4eef5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5886a expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.042173:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042185:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042191:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042199:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042204:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042209:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042393:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042495:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042503:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065103.042519:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065103.042594:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042600:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042605:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042614:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a5e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065103.042617:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042623:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042631:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065103.042633:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065103.042636:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042641:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4eef6f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042735:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042741:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042744:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042748:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a5000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065103.042750:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042754:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042759:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065103.042760:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065103.042763:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042767:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4eef61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042773:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042777:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042781:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042784:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a5c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065103.042786:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042789:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042793:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715400) 00010000:00010000:0.0:1746065103.042795:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065103.042796:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.042800:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4eef68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.043058:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4600/0x14b4f8542d4eef5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5886a expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.043065:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4600/0x14b4f8542d4eef5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5886a expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.043073:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a4600, rc 0) 00000100:00100000:0.0:1746065103.043238:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+16:28092:x1830881260344448:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1329us (2521us total) trans 8589942625 rc 301/301 00000100:00100000:0.0:1746065103.043244:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8675 00000100:00100000:0.0:1746065103.046951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.050494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.052714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.054501:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.061470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.064129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.066964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.087177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.105244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.117724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.123849:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260347392 00000100:00100000:0.0:1746065103.123855:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260347392 00000100:00100000:0.0:1746065103.123893:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8676 00000100:00100000:0.0:1746065103.123899:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:28097:x1830881260347392:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065103.123918:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065103.123931:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a000/0x14b4f8542d4eef8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58894 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.125659:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125674:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125685:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125696:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125701:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125706:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125804:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125811:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125830:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065103.125838:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065103.125903:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125909:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125914:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125920:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b15bc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065103.125923:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125929:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125938:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065103.125940:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065103.125944:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125948:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15bc00/0x14b4f8542d4eefa0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125978:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125982:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125987:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125990:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b15ae00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065103.125992:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.125996:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126001:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065103.126003:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065103.126005:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126009:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4eef92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126015:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126019:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126023:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126027:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b15a800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065103.126029:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126033:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126038:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5a36b00) 00010000:00010000:0.0:1746065103.126040:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065103.126042:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126046:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a800/0x14b4f8542d4eef99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065103.126080:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a000/0x14b4f8542d4eef8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58894 expref: 259 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.126087:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b15a000/0x14b4f8542d4eef8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58894 expref: 259 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.126094:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15a000, rc 0) 00000100:00100000:0.0:1746065103.126137:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:28097:x1830881260347392:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2236us (2349us total) trans 8589942628 rc 301/301 00000100:00100000:0.0:1746065103.126144:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8676 00000100:00100000:0.0:1746065103.136365:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.137117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.140693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.172594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.189316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.201559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.225189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.225227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.225279:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.225311:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260349184 00000100:00100000:0.0:1746065103.225314:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260349184 00010000:00010000:0.0:1746065103.225330:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5600/0x14b4f8542d4eed0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58736 expref: 36 pid: 21998 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746065103.225350:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4470 00000100:00100000:0.0:1746065103.225356:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260348928:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065103.225368:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065103.225387:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f27ac00/0x14b4f8542d4eeda1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58791 expref: 7 pid: 8429 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746065103.225493:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f27ac00/0x14b4f8542d4eeda1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58791 expref: 7 pid: 8429 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746065103.225521:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f27ac00/0x14b4f8542d4eeda1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58791 expref: 7 pid: 8429 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746065103.225867:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065103.225893:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260348928:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 536us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065103.225898:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4470 00000100:00100000:0.0:1746065103.230472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.232152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.272851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.276455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.276496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.284147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.289203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.295639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.311499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.311559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.344249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.350350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.350394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.353890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.361959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.364029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.364050:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260352256 00000100:00100000:0.0:1746065103.364057:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260352256 00010000:00010000:0.0:1746065103.364083:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0fd600/0x14b4f8542d4eef06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5884e expref: 35 pid: 4544 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746065103.368356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.370704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.372677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.373704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.373762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.379422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.380477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.388055:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.389677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.393625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.394722:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.396703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.401499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.405703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.408551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.415519:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.425907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.425966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.425990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.426021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065103.428930:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065103.432388:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260356352 00000100:00100000:0.0:1746065103.432394:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260356352 00002000:00100000:0.0:1746065103.432423:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1810432->1814527) req@ffff88012f14ca80 x1830881260356352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/0 e 0 to 0 dl 1746065114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.432431:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f14ca80 with x1830881260356352 ext(1810432->1814527) 00002000:00010000:0.0:1746065103.432435:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f14ca80 00000100:00100000:0.0:1746065103.432444:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4021 00000100:00100000:0.0:1746065103.432448:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f14ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881260356352:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065103.432740:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f14ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881260356352:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 290us (450us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065103.432746:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4021 00002000:00100000:0.0:1746065103.432751:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1810432->1814527) req@ffff88012f14ca80 x1830881260356352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/4536 e 0 to 0 dl 1746065114 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.432757:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f14ca80 with x1830881260356352 ext(1810432->1814527) 00002000:00010000:0.0:1746065103.432760:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f14ca80 00000100:00100000:0.0:1746065103.436201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.436227:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260356480 00000100:00100000:0.0:1746065103.436234:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260356480 00002000:00100000:0.0:1746065103.436267:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1269760->1802239) req@ffff88009ba1c700 x1830881260356480/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/0 e 0 to 0 dl 1746065114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.436275:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c700 with x1830881260356480 ext(1269760->1802239) 00010000:00010000:0.0:1746065103.436283:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x14b4f8542d4eefd1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588a2 expref: 35 pid: 25185 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746065103.436294:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x14b4f8542d4eefd1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588a2 expref: 35 pid: 25185 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746065103.436301:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ba1c700 00000100:00100000:0.0:1746065103.436329:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1282 00000100:00100000:0.0:1746065103.436336:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881260356480:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065103.442803:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881260355840:12345-192.168.202.46@tcp:4:cat.0 Request processed in 15917us (16827us total) trans 21474839778 rc 0/0 00000100:00100000:0.0:1746065103.442836:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1281 00002000:00100000:0.0:1746065103.442846:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->2678783) req@ffff8800a90ae680 x1830881260355840/t21474839778(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:19/0 lens 488/448 e 0 to 0 dl 1746065114 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.442855:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ae680 with x1830881260355840 ext(2097152->2678783) 00010000:00010000:0.0:1746065103.442863:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6e00/0x14b4f8542d4ef072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2678783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588ef expref: 25 pid: 8427 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746065103.442876:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6e00/0x14b4f8542d4ef072 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2678783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588ef expref: 25 pid: 8427 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746065103.442882:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a90ae680 00000100:00100000:0.0:1746065103.449316:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260356736 00000100:00100000:0.0:1746065103.449324:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260356736 00010000:00010000:0.0:1746065103.449354:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4ef009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588be expref: 38 pid: 25185 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746065103.449374:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260356864 00000100:00100000:0.0:1746065103.449376:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260356864 00010000:00010000:0.0:1746065103.449385:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f278800/0x14b4f8542d4ef064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588e1 expref: 25 pid: 8428 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746065103.449396:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4482 00000100:00100000:0.0:1746065103.449401:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881260356736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065103.449412:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065103.449428:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4ef009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588be expref: 38 pid: 25185 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746065103.449441:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4ef009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588be expref: 38 pid: 25185 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746065103.449459:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15ae00/0x14b4f8542d4ef009 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588be expref: 38 pid: 25185 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746065103.449484:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065103.449521:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881260356736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 120us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065103.449527:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4482 00000100:00100000:0.0:1746065103.449544:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4483 00000100:00100000:0.0:1746065103.449549:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260356864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065103.449554:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065103.449560:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f278800/0x14b4f8542d4ef064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588e1 expref: 25 pid: 8428 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746065103.449567:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f278800/0x14b4f8542d4ef064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588e1 expref: 25 pid: 8428 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746065103.449577:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f278800/0x14b4f8542d4ef064 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588e1 expref: 25 pid: 8428 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746065103.449584:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065103.449586:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065103.449591:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4ef08e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5890b expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.449599:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4ef08e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5890b expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.449624:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4ef08e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5890b expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065103.449634:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259470080:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065103.449679:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065103.454956:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881260356480:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 18615us (18758us total) trans 17179872518 rc 0/0 00000100:00100000:0.0:1746065103.454964:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1282 00002000:00100000:0.0:1746065103.454971:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1269760->1802239) req@ffff88009ba1c700 x1830881260356480/t17179872518(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/448 e 0 to 0 dl 1746065114 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.454979:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c700 with x1830881260356480 ext(1269760->1802239) 00010000:00010000:0.0:1746065103.454986:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x14b4f8542d4eefd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588a2 expref: 37 pid: 25185 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746065103.454997:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x14b4f8542d4eefd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e588a2 expref: 37 pid: 25185 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746065103.455003:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ba1c700 00000100:00100000:0.0:1746065103.459227:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260357504 00000100:00100000:0.0:1746065103.459232:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260357504 00000100:00100000:0.0:1746065103.459257:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3452 00000100:00100000:0.0:1746065103.459264:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:28108:x1830881260357504:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065103.459404:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:28108:x1830881260357504:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 140us (325us total) trans 8589942636 rc 0/0 00000100:00100000:0.0:1746065103.459409:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3452 00000100:00100000:0.0:1746065103.460190:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260357760 00000100:00100000:0.0:1746065103.460194:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260357760 00002000:00100000:0.0:1746065103.460214:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009f15c000 x1830881260357760/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/0 e 0 to 0 dl 1746065114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.460222:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15c000 with x1830881260357760 ext(3145728->4194303) 00002000:00010000:0.0:1746065103.460225:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15c000 00000100:00100000:0.0:1746065103.460237:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4023 00000100:00100000:0.0:1746065103.460242:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881260357760:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065103.476889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.482706:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.490379:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.502292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.502329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.503120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.503148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.504329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.509364:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259470592:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065103.509379:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4ef0aa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58920 expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065103.509387:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5000/0x14b4f8542d4ef0aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58920 expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065103.510646:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5000, rc 0) 00000100:00100000:0.0:1746065103.510668:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260358784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7247us (7549us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065103.510673:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9197 00000100:00100000:0.0:1746065103.517069:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260359808 00000100:00100000:0.0:1746065103.517078:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260359808 00000100:00100000:0.0:1746065103.517136:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3455 00000100:00100000:0.0:1746065103.517144:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28061:x1830881260359808:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065103.517343:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28061:x1830881260359808:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 200us (1437us total) trans 8589942639 rc 0/0 00000100:00100000:0.0:1746065103.517349:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3455 00000100:00100000:0.0:1746065103.524527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.524560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.524768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.524985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.526848:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4029 00000100:00100000:0.0:1746065103.526856:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260360704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065103.537551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.553222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.553274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.562628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.568844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.568885:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.573789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.579930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.596550:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9201 00000100:00100000:0.0:1746065103.596561:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881260363520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065103.596578:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065103.596594:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944ef600/0x14b4f8542d4ef10c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58951 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065103.596644:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f722d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259471360:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065103.596698:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065103.602938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.614380:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.624045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.624093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.652477:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.657560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.658098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.661541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.667646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.678781:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.683883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.686716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.693032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.699269:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.699625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.738802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.761724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.762766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.785642:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881260367360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18090us (22870us total) trans 0 rc 913408/913408 00000100:00100000:0.0:1746065103.785651:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4035 00002000:00100000:0.0:1746065103.785661:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37a:0x0] (1183744->2097151) req@ffff880095351180 x1830881260367360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/440 e 0 to 0 dl 1746065114 ref 1 fl Complete:/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.785669:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351180 with x1830881260367360 ext(1183744->2097151) 00002000:00010000:0.0:1746065103.785674:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351180 00000100:00100000:0.0:1746065103.804628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.811307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.811335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.811356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.811377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.811413:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260368128 00000100:00100000:0.0:1746065103.811419:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260368128 00002000:00100000:0.0:1746065103.811450:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3403775) req@ffff880095353480 x1830881260368128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 504/0 e 0 to 0 dl 1746065114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.811460:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353480 with x1830881260368128 ext(2097152->3403775) 00002000:00010000:0.0:1746065103.811464:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353480 00000100:00100000:0.0:1746065103.811475:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260368384 00000100:00100000:0.0:1746065103.811476:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260368384 00002000:00100000:0.0:1746065103.811482:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3403776->4194303) req@ffff880095352300 x1830881260368384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/0 e 0 to 0 dl 1746065114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.811488:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352300 with x1830881260368384 ext(3403776->4194303) 00002000:00010000:0.0:1746065103.811490:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352300 00000100:00100000:0.0:1746065103.811496:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260368640 00000100:00100000:0.0:1746065103.811497:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260368640 00002000:00100000:0.0:1746065103.811516:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2490368->3538943) req@ffff88009c124a80 x1830881260368640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/0 e 0 to 0 dl 1746065114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.811521:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124a80 with x1830881260368640 ext(2490368->3538943) 00002000:00010000:0.0:1746065103.811524:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c124a80 00000100:00100000:0.0:1746065103.811539:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260368000 00000100:00100000:0.0:1746065103.811540:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260368000 00002000:00100000:0.0:1746065103.811547:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1183743) req@ffff88009c124000 x1830881260368000/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/0 e 0 to 0 dl 1746065114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.811553:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124000 with x1830881260368000 ext(1048576->1183743) 00010000:00010000:0.0:1746065103.811558:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4ef08e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5890b expref: 38 pid: 25185 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746065103.811571:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4ef08e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5890b expref: 38 pid: 25185 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746065103.811576:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c124000 00000100:00100000:0.0:1746065103.811585:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1286 00000100:00100000:0.0:1746065103.811588:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881260368000:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065103.820084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.820130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.820154:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260368896 00000100:00100000:0.0:1746065103.820163:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260368896 00002000:00100000:0.0:1746065103.820197:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37b:0x0] (3538944->4194303) req@ffff88009c125c00 x1830881260368896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/0 e 0 to 0 dl 1746065114 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.820206:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125c00 with x1830881260368896 ext(3538944->4194303) 00002000:00010000:0.0:1746065103.820211:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c125c00 00000100:00100000:0.0:1746065103.820231:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4040 00000100:00100000:0.0:1746065103.820238:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881260368896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065103.821528:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1959:x1830881260368000:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9935us (10147us total) trans 21474839780 rc 0/0 00000100:00100000:0.0:1746065103.821535:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1286 00002000:00100000:0.0:1746065103.821542:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1183743) req@ffff88009c124000 x1830881260368000/t21474839780(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/448 e 0 to 0 dl 1746065114 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.821549:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124000 with x1830881260368000 ext(1048576->1183743) 00010000:00010000:0.0:1746065103.821555:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4ef08e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5890b expref: 43 pid: 25185 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746065103.821568:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7400/0x14b4f8542d4ef08e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5890b expref: 43 pid: 25185 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746065103.821573:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c124000 00000100:00100000:0.0:1746065103.827060:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881260368384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15355us (15715us total) trans 0 rc 790528/790528 00000100:00100000:0.0:1746065103.827069:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4038 00002000:00100000:0.0:1746065103.827079:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3403776->4194303) req@ffff880095352300 x1830881260368384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:19/0 lens 488/440 e 0 to 0 dl 1746065114 ref 1 fl Complete:/200/0 rc 790528/790528 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065103.827087:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352300 with x1830881260368384 ext(3403776->4194303) 00002000:00010000:0.0:1746065103.827092:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352300 00010000:00010000:0.0:1746065103.837040:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f6200/0x14b4f8542d4ef17c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1933311) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58997 expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065103.837056:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c127100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259473152:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065103.841764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.852869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.854832:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260369792 00000100:00100000:0.0:1746065103.854838:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260369792 00000100:00100000:0.0:1746065103.854864:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9210 00000100:00100000:0.0:1746065103.854870:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801332f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881260369792:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065103.854882:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065103.854893:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c397200/0x14b4f8542d4ef1a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e589a5 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065103.854931:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259473280:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065103.854976:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065103.864616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.886783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.887287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.893209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.895002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.895041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.895900:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9214 00000100:00100000:0.0:1746065103.895907:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881260371200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065103.895914:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065103.895923:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090ba7600/0x14b4f8542d4ef1e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e589c1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065103.895958:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c125180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259473792:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065103.896438:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065103.897090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:0.0:1746065103.901243:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065103 -> 1746065104 00000100:00100000:0.0:1746065103.901254:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c125180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259473792:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065103.901901:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090ba7600/0x14b4f8542d4ef1e5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e589c1 expref: 30 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065103.901911:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090ba7600/0x14b4f8542d4ef1e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e589c1 expref: 30 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065103.901932:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090ba7600, rc 0) 00000100:00100000:0.0:1746065103.908399:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260371840 00000100:00100000:0.0:1746065103.908403:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260371840 00000100:00100000:0.0:1746065103.908434:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3459 00000100:00100000:0.0:1746065103.908439:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:28126:x1830881260371840:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065103.909195:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:28126:x1830881260371840:12345-192.168.202.46@tcp:35:cat.0 Request processed in 753us (947us total) trans 8589942649 rc 0/0 00000100:00100000:0.0:1746065103.909202:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3459 00000100:00100000:0.0:1746065103.911399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.934403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.940953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.940997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.960573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.965095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.965127:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.965163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.965397:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4497 00000100:00100000:0.0:1746065103.965404:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f78d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881260372864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065103.965410:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065103.965419:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f27ae00/0x14b4f8542d4eedaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5877c expref: 6 pid: 8429 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746065103.965546:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f27ae00/0x14b4f8542d4eedaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5877c expref: 6 pid: 8429 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746065103.965696:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f27ae00/0x14b4f8542d4eedaf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5877c expref: 6 pid: 8429 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746065103.965711:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065103.965712:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065103.965718:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5a00/0x14b4f8542d4ef1fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 106496->770047) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e589dd expref: 37 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065103.965725:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5a00/0x14b4f8542d4ef1fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 106496->770047) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e589dd expref: 37 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065103.966932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.966961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.966992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.967269:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065103.969771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.973811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.976336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.977093:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.980809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.987680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065103.993214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.004522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.009202:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.023971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.036184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.036213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.036300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.037922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.059122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.061551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.061652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.069695:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.079866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.079963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.081609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.084904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.085550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.086375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.086395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.086417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.110399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.124061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.134103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.134128:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260379904 00000100:00100000:0.0:1746065104.134135:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260379904 00000100:00100000:0.0:1746065104.134175:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 570 00000100:00100000:0.0:1746065104.134183:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:1961:x1830881260379904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065104.134196:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065104.134215:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f816600/0x14b4f8542d4ef2be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58a54 expref: 272 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.134234:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065104.134238:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065104.136803:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:1961:x1830881260379904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2609us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.136825:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 570 00000100:00100000:0.0:1746065104.178649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.178680:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260381184 00000100:00100000:0.0:1746065104.178687:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260381184 00002000:00100000:0.0:1746065104.178721:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d136d80 x1830881260381184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:20/0 lens 488/0 e 0 to 0 dl 1746065115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065104.178732:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136d80 with x1830881260381184 ext(3145728->4194303) 00002000:00010000:0.0:1746065104.178736:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d136d80 00000100:00100000:0.0:1746065104.178753:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4059 00000100:00100000:0.0:1746065104.178760:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881260381184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065104.181265:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881260380416:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17520us (17712us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065104.181275:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4056 00002000:00100000:0.0:1746065104.181285:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8801332f8700 x1830881260380416/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:20/0 lens 488/440 e 0 to 0 dl 1746065115 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065104.181294:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801332f8700 with x1830881260380416 ext(2097152->3145727) 00002000:00010000:0.0:1746065104.181299:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801332f8700 00000100:00100000:0.0:1746065104.197562:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881260380672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 32820us (33976us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065104.197575:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4057 00002000:00100000:0.0:1746065104.197586:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8801332f9180 x1830881260380672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:20/0 lens 488/440 e 0 to 0 dl 1746065115 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065104.197594:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801332f9180 with x1830881260380672 ext(3145728->4194303) 00002000:00010000:0.0:1746065104.197600:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801332f9180 00000100:00100000:0.0:1746065104.203643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.208766:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260381184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29998us (30116us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065104.208778:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4059 00002000:00100000:0.0:1746065104.208788:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d136d80 x1830881260381184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:20/0 lens 488/440 e 0 to 0 dl 1746065115 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065104.208797:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136d80 with x1830881260381184 ext(3145728->4194303) 00002000:00010000:0.0:1746065104.208802:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d136d80 00000100:00100000:0.0:1746065104.219074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.232952:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881260381440:12345-192.168.202.46@tcp:4:cat.0 Request processed in 20833us (20939us total) trans 17179872520 rc 0/0 00000100:00100000:0.0:1746065104.232960:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1291 00002000:00100000:0.0:1746065104.232967:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (106496->770047) req@ffff8801332f9f80 x1830881260381440/t17179872520(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:20/0 lens 488/448 e 0 to 0 dl 1746065115 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065104.232981:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801332f9f80 with x1830881260381440 ext(106496->770047) 00010000:00010000:0.0:1746065104.232988:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5a00/0x14b4f8542d4ef1fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 106496->770047) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e589dd expref: 43 pid: 8427 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746065104.232999:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5a00/0x14b4f8542d4ef1fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 106496->770047) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e589dd expref: 43 pid: 8427 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746065104.233006:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801332f9f80 00000100:00100000:0.0:1746065104.233071:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260382464 00000100:00100000:0.0:1746065104.233075:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260382464 00000100:00100000:0.0:1746065104.233098:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 571 00000100:00100000:0.0:1746065104.233103:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+32:1958:x1830881260382464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065104.233113:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065104.233128:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5a800/0x14b4f8542d4ef2ef lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58a69 expref: 32 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.233140:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065104.233143:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065104.233163:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135006a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+31:1958:x1830881260382464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.233167:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 571 00000100:00100000:0.0:1746065104.257913:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.258795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.260276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.270218:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.276129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.284444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.284493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.288960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.291041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:0.0:1746065104.291684:0:21235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065104 -> 1746065105 00002000:00010000:0.0:1746065104.291687:0:21235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime: 1746065104 -> 1746065105 00002000:00010000:0.0:1746065104.291689:0:21235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065104 -> 1746065105 00000100:00100000:0.0:1746065104.291699:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f78ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259477760:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065104.291724:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8f000/0x14b4f8542d4ef320 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58a93 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065104.291735:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8f000/0x14b4f8542d4ef320 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58a93 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065104.291748:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8f000, rc 0) 00000100:00100000:0.0:1746065104.291798:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+8:1958:x1830881260384640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2753us (2845us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065104.291804:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9239 00000100:00100000:0.0:1746065104.339159:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260385280 00000100:00100000:0.0:1746065104.339167:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260385280 00000100:00100000:0.0:1746065104.339207:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3465 00000100:00100000:0.0:1746065104.339215:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75065d94-a855-40b7-bd64-6d6f17292955+31:19663:x1830881260385280:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065104.339385:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75065d94-a855-40b7-bd64-6d6f17292955+32:19663:x1830881260385280:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 170us (362us total) trans 8589942659 rc 0/0 00000100:00100000:0.0:1746065104.339391:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3465 00010000:00010000:0.0:1746065104.361702:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4ef374 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.361708:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4ef374 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065104.361724:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065104.362334:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4ef36d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58acb expref: 11 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.362348:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4ef374 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58acb expref: 10 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.362353:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065104.362356:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065104.362358:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd6c00, rc 0) 00000100:00100000:0.0:1746065104.362381:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800927b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28150:x1830881260386432:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 4309us (4438us total) trans 8589942660 rc 0/0 00000100:00100000:0.0:1746065104.362387:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8692 00000100:00100000:0.0:1746065104.364529:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260386816 00000100:00100000:0.0:1746065104.364536:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260386816 00000100:00100000:0.0:1746065104.364565:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8693 00000100:00100000:0.0:1746065104.364572:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800927b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28150:x1830881260386816:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065104.364591:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065104.364593:0:20754:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065104.364612:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4ef374 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58acb expref: 10 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.364625:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065104.364629:0:20754:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065104.365644:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce400/0x14b4f8542d4ef382 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58ad2 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.365718:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf400/0x14b4f8542d4ef389 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.365728:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf400/0x14b4f8542d4ef389 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.365736:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf400/0x14b4f8542d4ef389 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065104.365745:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065104.365853:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce400/0x14b4f8542d4ef382 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ad2 expref: 12 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.365865:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf400/0x14b4f8542d4ef389 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ad2 expref: 11 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.365871:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065104.365874:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065104.365876:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4fcf400, rc 0) 00000100:00100000:0.0:1746065104.365928:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800927b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28150:x1830881260386816:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1355us (1622us total) trans 8589942661 rc 0/0 00000100:00100000:0.0:1746065104.365934:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8693 00000100:00100000:0.0:1746065104.371291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.372067:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260386944 00000100:00100000:0.0:1746065104.372074:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260386944 00000100:00100000:0.0:1746065104.372736:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8694 00000100:00100000:0.0:1746065104.372744:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28150:x1830881260386944:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065104.372766:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065104.372782:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf200/0x14b4f8542d4ef397 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58ad9 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.373066:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf200/0x14b4f8542d4ef397 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ad9 expref: 12 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.373078:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf200/0x14b4f8542d4ef397 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ad9 expref: 12 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.373095:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065104.373097:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065104.373100:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4fcf200, rc 0) 00000100:00100000:0.0:1746065104.373333:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28150:x1830881260386944:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 588us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.373339:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8694 00000100:00100000:0.0:1746065104.373790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.373806:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260387200 00000100:00100000:0.0:1746065104.373811:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260387200 00000100:00100000:0.0:1746065104.374353:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8695 00000100:00100000:0.0:1746065104.374359:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:28153:x1830881260387200:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065104.374371:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065104.374382:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcfc00/0x14b4f8542d4ef39e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58ae0 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.374756:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.374770:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.374778:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.374788:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.374793:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.374797:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.374900:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.374910:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf400/0x14b4f8542d4ef389 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ad2 expref: 11 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.374916:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.374940:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf400/0x14b4f8542d4ef389 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ad2 expref: 11 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.375016:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf400/0x14b4f8542d4ef389 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ad2 expref: 11 pid: 20754 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746065104.375028:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259478400:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065104.375674:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065104.378065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.378125:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259478400:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065104.378137:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378388:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378394:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065104.378405:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065104.378482:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378489:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378494:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378511:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4fce600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065104.378514:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378519:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378527:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065104.378530:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065104.378532:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378537:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fce600/0x14b4f8542d4ef3b3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378549:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378553:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378557:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378560:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4fcf000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065104.378562:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378566:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378571:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065104.378573:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065104.378575:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378579:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf000/0x14b4f8542d4ef3a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378586:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378590:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378595:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378598:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4fcf600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065104.378601:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378605:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378609:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669a00) 00010000:00010000:0.0:1746065104.378611:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065104.378613:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378617:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcf600/0x14b4f8542d4ef3ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.378648:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcfc00/0x14b4f8542d4ef39e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ae0 expref: 275 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.378655:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4fcfc00/0x14b4f8542d4ef39e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ae0 expref: 275 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.378661:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4fcfc00, rc 0) 00000100:00100000:0.0:1746065104.378690:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:28153:x1830881260387200:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4330us (4901us total) trans 8589942662 rc 301/301 00000100:00100000:0.0:1746065104.378696:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8695 00000100:00100000:0.0:1746065104.383094:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800927b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259479168:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065104.384330:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259479680:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065104.385318:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259479424:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065104.385338:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065104.392447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.392484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.392517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.392561:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.394333:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260389888 00000100:00100000:0.0:1746065104.394338:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260389888 00010000:00010000:0.0:1746065104.394357:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350ae800/0x14b4f8542d4ef21d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58a00 expref: 9 pid: 21235 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746065104.394376:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4515 00000100:00100000:0.0:1746065104.394381:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881260389888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065104.394388:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065104.394398:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350ae800/0x14b4f8542d4ef21d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58a00 expref: 9 pid: 21235 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746065104.394406:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350ae800/0x14b4f8542d4ef21d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58a00 expref: 9 pid: 21235 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746065104.394418:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350ae800/0x14b4f8542d4ef21d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58a00 expref: 9 pid: 21235 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746065104.394426:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065104.394428:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065104.394431:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394442:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394456:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065104.394489:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881260389888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.394494:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4515 00010000:00010000:0.0:1746065104.394522:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394528:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394544:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394550:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394556:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394561:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec8e400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065104.394564:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394573:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394581:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.394585:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4ef3cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065104.394615:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800927b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881260387968:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 18544us (19388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.394621:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9250 00000100:00100000:0.0:1746065104.397930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.398059:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260388992 00000100:00100000:0.0:1746065104.398065:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260388992 00010000:00010000:0.0:1746065104.398085:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b15a200/0x14b4f8542d4ef095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58912 expref: 23 pid: 25185 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746065104.398104:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260389504 00000100:00100000:0.0:1746065104.398105:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260389504 00010000:00010000:0.0:1746065104.398114:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec8e600/0x14b4f8542d4ef351 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ab6 expref: 9 pid: 4545 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746065104.398125:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4516 00000100:00100000:0.0:1746065104.398130:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260388992:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065104.398141:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065104.398154:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b15a200/0x14b4f8542d4ef095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58912 expref: 23 pid: 25185 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746065104.398162:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b15a200/0x14b4f8542d4ef095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58912 expref: 23 pid: 25185 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746065104.398177:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b15a200/0x14b4f8542d4ef095 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58912 expref: 23 pid: 25185 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746065104.398187:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065104.399460:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881260388992:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1326us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.399468:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4516 00000100:00100000:0.0:1746065104.399486:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4519 00000100:00100000:0.0:1746065104.399493:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881260389760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065104.399511:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065104.399521:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4ef216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e589f9 expref: 9 pid: 21235 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746065104.399530:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4ef216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e589f9 expref: 9 pid: 21235 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746065104.399542:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4ef216 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e589f9 expref: 9 pid: 21235 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746065104.399550:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065104.399552:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065104.399556:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399563:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399580:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065104.399593:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881260389760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.399598:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4519 00010000:00010000:0.0:1746065104.399617:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399624:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399636:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399643:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399649:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399655:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5f5c400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065104.399658:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399669:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399678:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.399683:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4ef3dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065104.399711:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800927b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260387840:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 22575us (24526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.399717:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9251 00000100:00100000:0.0:1746065104.407582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.409953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.410907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065104.411351:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c3d2600/0x14b4f8542d4ef3c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.411358:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3d2600/0x14b4f8542d4ef3c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.411372:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d2600/0x14b4f8542d4ef3c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.411378:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d2600/0x14b4f8542d4ef3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.411388:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c3d2600/0x14b4f8542d4ef3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.411393:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c3d2600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065104.411395:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c3d2600/0x14b4f8542d4ef3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.411401:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c3d2600/0x14b4f8542d4ef3c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.411410:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065104.411411:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065104.411416:0:21235:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec8f400/0x14b4f8542d4ef3eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ae7 expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.411422:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec8f400/0x14b4f8542d4ef3eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ae7 expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.411445:0:21235:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec8f400/0x14b4f8542d4ef3eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ae7 expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065104.411455:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d135880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259480320:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065104.411533:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065104.416662:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.423552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.423608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.434410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.438657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.438693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.442890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.443857:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.496181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.501074:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260393600 00000100:00100000:0.0:1746065104.501078:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260393600 00000100:00100000:0.0:1746065104.501093:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260393856 00000100:00100000:0.0:1746065104.501094:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260393856 00000100:00100000:0.0:1746065104.501107:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9255 00000100:00100000:0.0:1746065104.501115:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881260393472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065104.501131:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065104.501145:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f717400/0x14b4f8542d4ef446 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58b0a expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065104.501193:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259480448:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065104.501532:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065104.506978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.507021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.511657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.516261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.518660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.519685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.522204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.522474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.522787:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.527133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.527188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.530333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.530377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.539288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.544461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.544799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.553368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.553524:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.562625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.566677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.573139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.576983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.584003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.584031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.584050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.584075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.606137:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881260398464:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21691us (22083us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065104.606144:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4076 00002000:00100000:0.0:1746065104.606150:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880094a13b80 x1830881260398464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:20/0 lens 488/440 e 0 to 0 dl 1746065115 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065104.606157:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13b80 with x1830881260398464 ext(2097152->3145727) 00002000:00010000:0.0:1746065104.606161:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a13b80 00000100:00100000:0.0:1746065104.620119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.620161:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.641627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.642965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.642981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.643562:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.643718:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260400384 00000100:00100000:0.0:1746065104.643722:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260400384 00002000:00100000:0.0:1746065104.643746:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880094a13480 x1830881260400384/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:20/0 lens 488/0 e 0 to 0 dl 1746065115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065104.643755:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13480 with x1830881260400384 ext(2097152->3145727) 00002000:00010000:0.0:1746065104.643759:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a13480 00000100:00100000:0.0:1746065104.643770:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260400768 00000100:00100000:0.0:1746065104.643772:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260400768 00002000:00100000:0.0:1746065104.643780:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094a10000 x1830881260400768/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:20/0 lens 488/0 e 0 to 0 dl 1746065115 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065104.643786:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10000 with x1830881260400768 ext(3145728->4194303) 00002000:00010000:0.0:1746065104.643788:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10000 00000100:00100000:0.0:1746065104.643803:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4082 00000100:00100000:0.0:1746065104.643808:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881260400384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065104.643877:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4083 00000100:00100000:0.0:1746065104.643882:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881260400512:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065104.643910:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4084 00000100:00100000:0.0:1746065104.643913:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881260400768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065104.673228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.673253:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260401152 00000100:00100000:0.0:1746065104.673260:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260401152 00000100:00100000:0.0:1746065104.673304:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8700 00000100:00100000:0.0:1746065104.673311:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+36:28168:x1830881260401152:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065104.673330:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065104.673345:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5704200/0x14b4f8542d4ef4d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58b7a expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.673422:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5704800/0x14b4f8542d4ef4d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.673435:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f000/0x14b4f8542d4ef438 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b03 expref: 276 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.673441:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8e800/0x14b4f8542d4ef477 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b26 expref: 37 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.673445:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5704800/0x14b4f8542d4ef4d9 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.673467:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8e800/0x14b4f8542d4ef477 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b26 expref: 37 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.673478:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8e800/0x14b4f8542d4ef477 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b26 expref: 37 pid: 14643 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746065104.673488:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259481600:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065104.673571:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f000/0x14b4f8542d4ef438 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b03 expref: 276 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.673578:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f000/0x14b4f8542d4ef438 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b03 expref: 276 pid: 14643 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746065104.673589:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259481728:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065104.673605:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065104.676234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.676274:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260401408 00000100:00100000:0.0:1746065104.676282:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260401408 00000100:00100000:0.0:1746065104.677332:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8701 00000100:00100000:0.0:1746065104.677342:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:28169:x1830881260401408:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065104.677362:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065104.678732:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f7400/0x14b4f8542d4ef4e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58b81 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.678806:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6600/0x14b4f8542d4ef4e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065104.678829:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6600/0x14b4f8542d4ef4e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065104.678836:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6600/0x14b4f8542d4ef4e7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065104.679569:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259481600:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065104.679577:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259481728:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065104.679595:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5704800/0x14b4f8542d4ef4d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.680571:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5704800/0x14b4f8542d4ef4d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065104.680580:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5704800/0x14b4f8542d4ef4d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065104.680590:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065104.680683:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5704200/0x14b4f8542d4ef4d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b7a expref: 38 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.680697:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5704800/0x14b4f8542d4ef4d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b7a expref: 37 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.680703:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065104.680705:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065104.680706:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5704800, rc 0) 00000100:00100000:0.0:1746065104.680725:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+37:28168:x1830881260401152:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7415us (7504us total) trans 8589942671 rc 0/0 00000100:00100000:0.0:1746065104.680730:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8700 00000100:00100000:0.0:1746065104.689028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.694534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.735422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.741122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.744474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.751101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.760880:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.771363:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.771444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.773141:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f14f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259482496:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065104.773154:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065104.773187:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881260403200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1436us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.773194:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4530 00000100:00100000:0.0:1746065104.775085:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.851045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.853069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.854283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.861020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.862961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.863975:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260404224 00000100:00100000:0.0:1746065104.863978:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260404224 00010000:00010000:0.0:1746065104.863992:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4ef4b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b5e expref: 12 pid: 4544 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746065104.864015:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4534 00000100:00100000:0.0:1746065104.864020:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f14f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260404224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065104.864026:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065104.864034:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4ef4b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b5e expref: 12 pid: 4544 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746065104.864040:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4ef4b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b5e expref: 12 pid: 4544 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746065104.864051:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4ef4b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b5e expref: 12 pid: 4544 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746065104.864070:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065104.864072:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065104.864077:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4ef511 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b9d expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.864083:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4ef511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b9d expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.864368:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4ef511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b9d expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065104.864378:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259483264:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065104.864673:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065104.869214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.921115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.924601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.925604:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.925635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.925705:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9275 00000100:00100000:0.0:1746065104.925712:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881260405120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065104.925720:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065104.925729:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7f7e00/0x14b4f8542d4ef542 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58bb2 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065104.925756:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259483392:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065104.925805:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065104.933411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.933678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.934208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.934257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.945571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.948943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.958846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.958923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.958945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.966698:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259484288:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065104.966727:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093815a00/0x14b4f8542d4ef56c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58bdc expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065104.966739:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093815a00/0x14b4f8542d4ef56c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58bdc expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065104.966762:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093815a00, rc 0) 00000100:00100000:0.0:1746065104.966801:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260406528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7474us (7854us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065104.966808:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9281 00000100:00100000:0.0:1746065104.968451:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259484416:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065104.968466:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065104.968505:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881260406656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3841us (3912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065104.968514:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4535 00000100:00100000:0.0:1746065104.971105:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260407040 00000100:00100000:0.0:1746065104.971113:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260407040 00000100:00100000:0.0:1746065104.971154:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9282 00000100:00100000:0.0:1746065104.971162:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:28176:x1830881260407040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065104.971179:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065104.971197:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7000/0x14b4f8542d4ef573 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58be3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.971224:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093f0c000/0x14b4f8542d4ef4fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b88 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.971231:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065104.971233:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065104.971236:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7000/0x14b4f8542d4ef573 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58be3 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.971261:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093f0c000/0x14b4f8542d4ef4fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b88 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065104.971271:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093f0c000/0x14b4f8542d4ef4fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58b88 expref: 11 pid: 8429 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746065104.971281:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259484544:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065104.971348:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065104.976422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.983484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.997811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.997930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065104.998535:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.001046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065105.001540:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065105.003615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.012418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.027517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.029916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.033866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.037698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.056745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.056947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.072945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065105.074884:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4ef5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.074890:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4ef5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065105.074926:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00000004:00200000:0.0:1746065105.074930:0:20754:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065105.074944:0:20754:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4ef5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.074952:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4ef5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.074960:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4ef5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.074965:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4ef5b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.074969:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4ef5b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.074974:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b55600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.074978:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4ef5b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.074984:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4ef5b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.074992:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065105.074994:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.074997:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4ef5b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.075001:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4ef5b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.075027:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4ef5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.075031:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4ef5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.075035:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4ef5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.075039:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b54600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.075041:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4ef5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.075045:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4ef5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.075051:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c8fa200) 00010000:00010000:0.0:1746065105.075053:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.075055:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4ef5c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.075061:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4ef5c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.075087:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4ef5b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c06 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.075099:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4ef5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c06 expref: 13 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.075104:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065105.075106:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065105.075108:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b55a00, rc 0) 00000100:00100000:0.0:1746065105.075642:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28184:x1830881260409472:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 18092us (18693us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065105.075648:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8704 00000100:00100000:0.0:1746065105.079801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.079863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.079884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.079906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.080519:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4095 00000100:00100000:0.0:1746065105.080528:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260410752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065105.088159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.088213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.089791:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9292 00000100:00100000:0.0:1746065105.089799:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260411776:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065105.089807:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.089832:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935dc200/0x14b4f8542d4ef5f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58c37 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.089844:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065105.089845:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065105.089850:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935dc200/0x14b4f8542d4ef5f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c37 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065105.089859:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935dc200/0x14b4f8542d4ef5f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c37 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065105.091484:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935dc200, rc 0) 00000100:00100000:0.0:1746065105.091528:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260411776:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1727us (3221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065105.091534:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9292 00000100:00100000:0.0:1746065105.093372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.093441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.108189:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881260411008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27204us (28293us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065105.108201:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4096 00002000:00100000:0.0:1746065105.108212:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880134d85f80 x1830881260411008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:21/0 lens 488/440 e 0 to 0 dl 1746065116 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065105.108221:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85f80 with x1830881260411008 ext(3145728->4194303) 00002000:00010000:0.0:1746065105.108226:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d85f80 00000100:00100000:0.0:1746065105.118426:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260413568 00000100:00100000:0.0:1746065105.118434:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260413568 00000100:00100000:0.0:1746065105.118484:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8705 00000100:00100000:0.0:1746065105.118502:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28184:x1830881260413568:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065105.118519:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.118535:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009418a800/0x14b4f8542d4ef60d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58c4c expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.118617:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4ef614 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.118629:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4ef5c7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c06 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.118636:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4ef614 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.118660:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4ef5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c06 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.118670:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4ef5c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c06 expref: 14 pid: 20754 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746065105.118680:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259485952:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065105.118730:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065105.133051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.138282:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260413824 00000100:00100000:0.0:1746065105.138291:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260413824 00000100:00100000:0.0:1746065105.138327:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260413952 00000100:00100000:0.0:1746065105.138329:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260413952 00000100:00100000:0.0:1746065105.138342:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9295 00000100:00100000:0.0:1746065105.138348:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260413824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065105.138366:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.138382:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a60a6000/0x14b4f8542d4ef622 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58c53 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.138403:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065105.138404:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065105.138411:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a60a6000/0x14b4f8542d4ef622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c53 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065105.138424:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a60a6000/0x14b4f8542d4ef622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c53 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065105.138433:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a6000, rc 0) 00000100:00100000:0.0:1746065105.138464:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260413824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 117us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065105.138469:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9295 00000100:00100000:0.0:1746065105.138481:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9296 00000100:00100000:0.0:1746065105.138485:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260413952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065105.138501:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.138508:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4ef629 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58c5a expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065105.138538:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259486080:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065105.138583:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065105.141543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.148438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.148504:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.153930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.170811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.184094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.191653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.199033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.199389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.204105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.206514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.208193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.210804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.212116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.219885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.221660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.264669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.269644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.269681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.269758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.276550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.278900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.280972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.282906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.282933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.296544:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.297992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.298019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.298037:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260418816 00000100:00100000:0.0:1746065105.298044:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260418816 00000100:00100000:0.0:1746065105.298086:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260418944 00000100:00100000:0.0:1746065105.298089:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260418944 00000100:00100000:0.0:1746065105.298099:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260419072 00000100:00100000:0.0:1746065105.298101:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260419072 00000100:00100000:0.0:1746065105.298118:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9306 00000100:00100000:0.0:1746065105.298124:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260418816:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065105.298140:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.298154:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7c00/0x14b4f8542d4ef6bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58cbc expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065105.298193:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259488384:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065105.298245:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065105.298315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.298331:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260419328 00000100:00100000:0.0:1746065105.298333:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260419328 00002000:00100000:0.0:1746065105.298351:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd71c00 x1830881260419328/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:21/0 lens 504/0 e 0 to 0 dl 1746065116 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065105.298359:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71c00 with x1830881260419328 ext(1048576->2097151) 00002000:00010000:0.0:1746065105.298362:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd71c00 00000100:00100000:0.0:1746065105.299000:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4106 00000100:00100000:0.0:1746065105.299005:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+13:1959:x1830881260419328:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065105.320842:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260419584 00000100:00100000:0.0:1746065105.320851:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260419584 00000100:00100000:0.0:1746065105.320895:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8710 00000100:00100000:0.0:1746065105.320903:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:28190:x1830881260419584:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065105.320920:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.320934:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c348e00/0x14b4f8542d4ef6d1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58cd1 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.321006:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c348000/0x14b4f8542d4ef6d8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065105.321017:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c348000/0x14b4f8542d4ef6d8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065105.321026:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c348000/0x14b4f8542d4ef6d8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065105.321036:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065105.321137:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c348e00/0x14b4f8542d4ef6d1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58cd1 expref: 19 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.321165:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c348000/0x14b4f8542d4ef6d8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58cd1 expref: 18 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.321172:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065105.321174:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065105.321177:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c348000, rc 0) 00000100:00100000:0.0:1746065105.321218:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:28190:x1830881260419584:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 315us (691us total) trans 8589942683 rc 0/0 00000100:00100000:0.0:1746065105.321223:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8710 00000100:00100000:0.0:1746065105.327210:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260420864 00000100:00100000:0.0:1746065105.327214:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260420864 00000100:00100000:0.0:1746065105.327237:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8712 00000100:00100000:0.0:1746065105.327242:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:28197:x1830881260420864:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065105.327250:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.327261:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4bb4400/0x14b4f8542d4ef6ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58cdf expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.327334:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b530d800/0x14b4f8542d4ef702 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.327341:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b530d800/0x14b4f8542d4ef702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.327350:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b530d800/0x14b4f8542d4ef702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.327359:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4ef709 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.327364:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4ef709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.327369:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4ef709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.329403:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4ef6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ca7 expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.329412:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4ef6a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ca7 expref: 17 pid: 14643 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746065105.329420:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259489280:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065105.329449:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065105.334112:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260421120 00000100:00100000:0.0:1746065105.334115:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260421120 00000100:00100000:0.0:1746065105.334145:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9315 00000100:00100000:0.0:1746065105.334151:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881260421120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065105.334163:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.334175:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013501bc00/0x14b4f8542d4ef741 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58ce6 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065105.334211:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259490560:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065105.334265:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065105.334292:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259489024:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065105.338747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.342186:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.342242:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259489280:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065105.342269:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093487600/0x14b4f8542d4ef6fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065105.342314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.342331:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260421760 00000100:00100000:0.0:1746065105.342336:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260421760 00010000:00010000:0.0:1746065105.342364:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5705000/0x14b4f8542d4ef557 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58bc7 expref: 11 pid: 4545 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746065105.342386:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4554 00000100:00100000:0.0:1746065105.342393:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260421760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065105.342403:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065105.342422:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5705000/0x14b4f8542d4ef557 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58bc7 expref: 11 pid: 4545 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746065105.342431:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5705000/0x14b4f8542d4ef557 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58bc7 expref: 11 pid: 4545 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746065105.342451:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5705000/0x14b4f8542d4ef557 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58bc7 expref: 11 pid: 4545 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746065105.342466:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065105.342467:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065105.342471:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4ef6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.342477:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4ef6e6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.342504:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065105.342534:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260421760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 141us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065105.342539:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4554 00000100:00100000:0.0:1746065105.342574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.342632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.342643:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260421888 00000100:00100000:0.0:1746065105.342646:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260421888 00010000:00010000:0.0:1746065105.342657:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948c7800/0x14b4f8542d4ef5f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c30 expref: 10 pid: 8429 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746065105.342671:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4555 00000100:00100000:0.0:1746065105.342675:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260421888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065105.342681:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065105.342691:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948c7800/0x14b4f8542d4ef5f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c30 expref: 10 pid: 8429 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746065105.342698:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948c7800/0x14b4f8542d4ef5f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58c30 expref: 10 pid: 8429 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746065105.342710:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065105.344594:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260421888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1915us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065105.344602:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4555 00000100:00100000:0.0:1746065105.346542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.346613:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259490560:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065105.346636:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013501bc00/0x14b4f8542d4ef741 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ce6 expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065105.346644:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013501bc00/0x14b4f8542d4ef741 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ce6 expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065105.346651:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013501bc00, rc 0) 00000100:00100000:0.0:1746065105.346664:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881260421120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 12514us (12732us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065105.346669:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9315 00010000:00010000:0.0:1746065105.347081:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013501ac00/0x14b4f8542d4ef725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.347087:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013501ac00/0x14b4f8542d4ef725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.347105:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013501ac00/0x14b4f8542d4ef725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.347112:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013501ac00/0x14b4f8542d4ef725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.347118:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013501ac00/0x14b4f8542d4ef725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.347123:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013501ac00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065105.347126:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013501ac00/0x14b4f8542d4ef725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.347132:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013501ac00/0x14b4f8542d4ef725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.347140:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013501ac00/0x14b4f8542d4ef725 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.347144:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013501ac00/0x14b4f8542d4ef725 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065105.347174:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260419968:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 16057us (17896us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065105.347180:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9311 00000100:00100000:0.0:1746065105.350385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.350422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.350447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.350479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.352781:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.361336:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260422016:12345-192.168.202.46@tcp:4:cat.0 Request processed in 17617us (18759us total) trans 21474839789 rc 0/0 00000100:00100000:0.0:1746065105.361343:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1302 00002000:00100000:0.0:1746065105.361349:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1351680->1617919) req@ffff8800a90af100 x1830881260422016/t21474839789(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:21/0 lens 488/448 e 0 to 0 dl 1746065116 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065105.361355:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90af100 with x1830881260422016 ext(1351680->1617919) 00010000:00010000:0.0:1746065105.361360:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4ef5a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58bf8 expref: 14 pid: 8429 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746065105.361368:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4ef5a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58bf8 expref: 14 pid: 8429 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746065105.361374:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a90af100 00000100:00100000:0.0:1746065105.376193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.402521:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260424448 00000100:00100000:0.0:1746065105.402525:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260424448 00000100:00100000:0.0:1746065105.402558:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9321 00000100:00100000:0.0:1746065105.402693:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:28193:x1830881260424448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065105.402706:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.402718:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4ef772 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58d10 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.402739:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065105.402743:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093487c00/0x14b4f8542d4ef73a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.402749:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065105.402753:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4ef772 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d10 expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.402765:0:4544:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff880093487c00/0x14b4f8542d4ef73a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.402777:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4ef772 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d10 expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.402785:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffbe800, rc 0) 00000100:00100000:0.0:1746065105.402832:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:28193:x1830881260424448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 267us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065105.402837:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9321 00000100:00100000:0.0:1746065105.419239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.429044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.445236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.448271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.448299:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260426624 00000100:00100000:0.0:1746065105.448307:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260426624 00000100:00100000:0.0:1746065105.448343:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8714 00000100:00100000:0.0:1746065105.448351:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009048f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:28200:x1830881260426624:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065105.448370:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.448387:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d000/0x14b4f8542d4ef780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58d1e expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.448475:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.448497:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.448505:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.448516:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.448521:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.448531:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451079:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ce00/0x14b4f8542d4ef795 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451101:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ce00/0x14b4f8542d4ef795 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451112:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ce00/0x14b4f8542d4ef795 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065105.451124:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065105.451244:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451252:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451262:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451268:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0c800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.451271:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451277:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451289:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065105.451292:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.451296:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451301:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c800/0x14b4f8542d4ef787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451343:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451349:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451353:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451357:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0d400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.451359:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451363:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451374:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012dc07b00) 00010000:00010000:0.0:1746065105.451376:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.451378:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451382:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4ef78e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.451425:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d000/0x14b4f8542d4ef780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d1e expref: 287 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.451434:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ce00/0x14b4f8542d4ef795 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d1e expref: 286 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.451440:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065105.451441:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065105.451443:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0ce00, rc 0) 00000100:00100000:0.0:1746065105.451502:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009048f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+286:28200:x1830881260426624:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3152us (3233us total) trans 8589942688 rc 0/0 00000100:00100000:0.0:1746065105.451509:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8714 00000100:00100000:0.0:1746065105.452095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.462259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.463752:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260427648 00000100:00100000:0.0:1746065105.463755:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260427648 00000100:00100000:0.0:1746065105.463776:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260427264 00000100:00100000:0.0:1746065105.463778:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260427264 00000100:00100000:0.0:1746065105.463800:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9325 00000100:00100000:0.0:1746065105.463806:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881260427648:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065105.463830:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.463842:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e0d200/0x14b4f8542d4ef7b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58d41 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065105.463861:0:4544:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6d0, atime: 0x6812d6d0, ctime: 0x6812d6d0, blocks: 0x821 00010000:00010000:0.0:1746065105.463870:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065105.463871:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065105.463876:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e0d200/0x14b4f8542d4ef7b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d41 expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065105.463886:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e0d200/0x14b4f8542d4ef7b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d41 expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065105.463892:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0d200, rc 0) 00000100:00100000:0.0:1746065105.464674:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881260427648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 866us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065105.464680:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9325 00000100:00100000:0.0:1746065105.471579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.476290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.477696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.480977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.481057:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.482613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.488158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.490105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.490685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.497088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.508940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.539043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.553521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.569617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.573203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.574177:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.576914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.583563:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.588424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.588512:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.595631:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.610085:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260432640 00000100:00100000:0.0:1746065105.610093:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260432640 00000100:00100000:0.0:1746065105.610142:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8715 00000100:00100000:0.0:1746065105.610149:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+287:28208:x1830881260432640:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065105.610168:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.610187:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775000/0x14b4f8542d4ef7f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58d72 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.610279:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610289:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610297:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610307:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610314:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610319:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610403:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774000/0x14b4f8542d4ef805 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610410:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774000/0x14b4f8542d4ef805 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610415:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774000/0x14b4f8542d4ef805 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065105.610422:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065105.610509:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610515:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610520:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610524:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c774c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.610527:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610532:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610540:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065105.610543:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.610546:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610550:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774c00/0x14b4f8542d4ef7f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610574:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610579:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610583:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610585:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c775800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.610587:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610591:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610596:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012cf56200) 00010000:00010000:0.0:1746065105.610598:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.610599:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610603:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775800/0x14b4f8542d4ef7fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.610630:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775000/0x14b4f8542d4ef7f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d72 expref: 290 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.610643:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c774000/0x14b4f8542d4ef805 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d72 expref: 289 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.610649:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065105.610651:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065105.610653:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c774000, rc 0) 00000100:00100000:0.0:1746065105.610704:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:28208:x1830881260432640:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 555us (695us total) trans 8589942691 rc 0/0 00000100:00100000:0.0:1746065105.610710:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8715 00000100:00100000:0.0:1746065105.612564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.621948:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.628062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.628094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.628131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.632532:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260433152:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 10390us (10581us total) trans 17179872526 rc 0/0 00000100:00100000:0.0:1746065105.632543:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1305 00002000:00100000:0.0:1746065105.632553:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1601536->2097151) req@ffff88009f9cdf80 x1830881260433152/t17179872526(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:21/0 lens 488/448 e 0 to 0 dl 1746065116 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065105.632561:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cdf80 with x1830881260433152 ext(1601536->2097151) 00010000:00010000:0.0:1746065105.632570:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093486c00/0x14b4f8542d4ef7e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d64 expref: 16 pid: 4545 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746065105.632583:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093486c00/0x14b4f8542d4ef7e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d64 expref: 16 pid: 4545 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746065105.632594:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cdf80 00000100:00100000:0.0:1746065105.642700:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260433536:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14461us (14646us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065105.642708:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4125 00002000:00100000:0.0:1746065105.642715:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8801332fa680 x1830881260433536/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:21/0 lens 488/440 e 0 to 0 dl 1746065116 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065105.642723:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801332fa680 with x1830881260433536 ext(0->1048575) 00002000:00010000:0.0:1746065105.642726:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801332fa680 00000100:00100000:0.0:1746065105.644315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.646413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.650288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.653715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.657158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.662884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.679953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.680204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.680220:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260435712 00000100:00100000:0.0:1746065105.680223:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260435712 00000100:00100000:0.0:1746065105.680254:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8716 00000100:00100000:0.0:1746065105.680260:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:28216:x1830881260435712:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065105.680275:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.680289:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8de800/0x14b4f8542d4ef828 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58d8e expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.680365:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680374:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680382:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680391:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680395:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680400:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680469:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4ef83d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680475:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4ef83d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680480:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4ef83d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065105.680498:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065105.680567:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680572:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680578:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680585:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8df200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.680588:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680593:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680601:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065105.680603:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.680606:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680610:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df200/0x14b4f8542d4ef82f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680621:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680625:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680629:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680632:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8df600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.680634:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680637:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680641:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5df2300) 00010000:00010000:0.0:1746065105.680643:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.680645:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680649:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4ef836 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.680675:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8de800/0x14b4f8542d4ef828 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d8e expref: 292 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.680682:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4ef83d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d8e expref: 291 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.680687:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065105.680689:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065105.680691:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b0a00, rc 0) 00000100:00100000:0.0:1746065105.680723:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+291:28216:x1830881260435712:12345-192.168.202.46@tcp:101:cat.0 Request processed in 464us (520us total) trans 8589942693 rc 0/0 00000100:00100000:0.0:1746065105.680729:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8716 00000100:00100000:0.0:1746065105.686381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.686450:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.691470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.697890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.699064:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.710192:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.720345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.723185:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.723234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.723265:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.723291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.723773:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4133 00000100:00100000:0.0:1746065105.723780:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260437504:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065105.734774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.741234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.764889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.766936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.768598:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260439808 00000100:00100000:0.0:1746065105.768602:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260439808 00000100:00100000:0.0:1746065105.768635:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8717 00000100:00100000:0.0:1746065105.768640:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+290:28220:x1830881260439808:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065105.768653:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065105.768668:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4ef87c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58dc6 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.768745:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.768755:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.768765:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.768776:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.768781:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.768786:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.768889:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4ef891 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.768951:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4ef891 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.768958:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4ef891 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065105.768966:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065105.769036:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769042:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769047:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769051:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e9600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.769055:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769061:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769071:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065105.769073:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.769076:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769081:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4ef883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769097:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769102:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769105:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769109:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e9400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065105.769110:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769114:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769118:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5df2400) 00010000:00010000:0.0:1746065105.769119:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065105.769121:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769125:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4ef88a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065105.769154:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4ef87c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58dc6 expref: 293 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.769163:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4ef891 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58dc6 expref: 292 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065105.769168:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065105.769171:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065105.769173:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e8c00, rc 0) 00000100:00100000:0.0:1746065105.769196:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+292:28220:x1830881260439808:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 556us (1600us total) trans 8589942694 rc 0/0 00000100:00100000:0.0:1746065105.769201:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8717 00000100:00100000:0.0:1746065105.783102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.788740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.798078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.805417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.812961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.821207:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.827891:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.899136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.903722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.916557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.922467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.922769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.926736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.930541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.940363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.944401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.945055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.956107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.979066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065105.985211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.012134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.022992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.024043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.046624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.046665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.046702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.046862:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9350 00000100:00100000:0.0:1746065106.046870:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260445312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065106.046878:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065106.046888:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013667c200/0x14b4f8542d4ef8ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58dfe expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065106.046916:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259495680:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065106.047010:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065106.059640:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.063155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.063182:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.071151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.077603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.078768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.084229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.097211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.100910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.107183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.120468:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.149997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.152267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.162276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.162707:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260447744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10089us (12717us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065106.162722:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4153 00002000:00100000:0.0:1746065106.162733:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880094d95f80 x1830881260447744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:22/0 lens 488/440 e 0 to 0 dl 1746065117 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065106.162742:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95f80 with x1830881260447744 ext(2097152->3145727) 00002000:00010000:0.0:1746065106.162747:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95f80 00000100:00100000:0.0:1746065106.168582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.175348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.184103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.187134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.190849:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.194721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.200470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.203876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.207680:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260449920 00000100:00100000:0.0:1746065106.207689:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260449920 00000100:00100000:0.0:1746065106.210098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.210141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.214152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.216175:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.216925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.231963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.233122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.239064:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.239097:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.239130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.244704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.244772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.264016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.266862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.276956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.296990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.304991:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.308767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065106.308929:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065106.310491:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.313031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.313063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.313079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.313092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.313103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.313123:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.313314:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9364 00000100:00100000:0.0:1746065106.313322:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260454016:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065106.313330:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065106.313338:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013667c000/0x14b4f8542d4ef9b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58e75 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065106.313369:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259498368:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065106.313408:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065106.317446:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.321497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.330160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.334606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.337404:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.337443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.341796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.348014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.348055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.348091:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.349324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.349339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.349356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.357748:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.357788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.357993:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259500416:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065106.362869:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4595 00000100:00100000:0.0:1746065106.362876:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f723b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260456832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.362883:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.362895:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb4ca00/0x14b4f8542d4ef9cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e91 expref: 10 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.362904:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb4ca00/0x14b4f8542d4ef9cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e91 expref: 10 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.362915:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb4ca00/0x14b4f8542d4ef9cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e91 expref: 10 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.362929:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.363981:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f723b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260456832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1104us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.363992:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4595 00000100:00100000:0.0:1746065106.364032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.364047:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457088 00000100:00100000:0.0:1746065106.364050:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457088 00010000:00010000:0.0:1746065106.364063:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb4d000/0x14b4f8542d4ef9be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e83 expref: 10 pid: 4544 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746065106.364078:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4596 00000100:00100000:0.0:1746065106.364083:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260457088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.364089:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.364097:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb4d000/0x14b4f8542d4ef9be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e83 expref: 10 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.364110:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb4d000/0x14b4f8542d4ef9be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e83 expref: 10 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.364122:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb4d000/0x14b4f8542d4ef9be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e83 expref: 10 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.364130:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.364145:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260457088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.364150:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4596 00000100:00100000:0.0:1746065106.364196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.364207:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457472 00000100:00100000:0.0:1746065106.364210:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457472 00010000:00010000:0.0:1746065106.364220:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093486400/0x14b4f8542d4ef859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58da3 expref: 16 pid: 25185 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746065106.364231:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4597 00000100:00100000:0.0:1746065106.364234:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260457472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.364241:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.364249:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093486400/0x14b4f8542d4ef859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58da3 expref: 16 pid: 25185 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.364255:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093486400/0x14b4f8542d4ef859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58da3 expref: 16 pid: 25185 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.364265:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093486400/0x14b4f8542d4ef859 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58da3 expref: 16 pid: 25185 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.364273:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.364275:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.364279:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb4c800/0x14b4f8542d4efa27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.364285:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb4c800/0x14b4f8542d4efa27 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.364307:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.364320:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260457472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.364325:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4597 00000100:00100000:0.0:1746065106.364353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.364362:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457600 00000100:00100000:0.0:1746065106.364364:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457600 00010000:00010000:0.0:1746065106.364372:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec34400/0x14b4f8542d4ef97f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e59 expref: 32 pid: 4545 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746065106.364383:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4598 00000100:00100000:0.0:1746065106.364392:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881260457600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.364397:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.364405:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ec34400/0x14b4f8542d4ef97f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e59 expref: 32 pid: 4545 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.364411:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ec34400/0x14b4f8542d4ef97f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e59 expref: 32 pid: 4545 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.364420:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec34400/0x14b4f8542d4ef97f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e59 expref: 32 pid: 4545 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.364426:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.364428:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.364430:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f469000/0x14b4f8542d4efa2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.364435:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f469000/0x14b4f8542d4efa2e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.364446:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.364455:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881260457600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.364462:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4598 00000100:00100000:0.0:1746065106.364519:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457728 00000100:00100000:0.0:1746065106.364522:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457728 00010000:00010000:0.0:1746065106.364531:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb4c000/0x14b4f8542d4ef9c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e8a expref: 9 pid: 4544 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746065106.364542:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457856 00000100:00100000:0.0:1746065106.364544:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457856 00010000:00010000:0.0:1746065106.364550:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b64a000/0x14b4f8542d4ef821 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d87 expref: 19 pid: 25185 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746065106.364561:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4599 00000100:00100000:0.0:1746065106.364565:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881260457728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.364570:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.364578:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb4c000/0x14b4f8542d4ef9c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e8a expref: 9 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.364585:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb4c000/0x14b4f8542d4ef9c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e8a expref: 9 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.364595:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb4c000/0x14b4f8542d4ef9c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e8a expref: 9 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.364602:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.364615:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881260457728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.364622:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4599 00000100:00100000:0.0:1746065106.364631:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457984 00000100:00100000:0.0:1746065106.364633:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457984 00010000:00010000:0.0:1746065106.364641:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5704200/0x14b4f8542d4ef8de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58df0 expref: 31 pid: 25185 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746065106.364650:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4600 00000100:00100000:0.0:1746065106.364654:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881260457856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.364660:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.364667:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b64a000/0x14b4f8542d4ef821 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d87 expref: 19 pid: 25185 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.364674:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b64a000/0x14b4f8542d4ef821 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d87 expref: 19 pid: 25185 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.364683:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b64a000/0x14b4f8542d4ef821 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58d87 expref: 19 pid: 25185 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.364689:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.364691:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.364693:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c5e000/0x14b4f8542d4efa20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.364698:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5e000/0x14b4f8542d4efa20 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.364709:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.364722:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+18:1958:x1830881260457856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.364727:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4600 00000100:00100000:0.0:1746065106.365335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.365347:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260458112 00000100:00100000:0.0:1746065106.365350:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260458112 00010000:00010000:0.0:1746065106.365361:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009418a800/0x14b4f8542d4ef8f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e05 expref: 18 pid: 4544 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746065106.365373:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4602 00000100:00100000:0.0:1746065106.365377:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260458112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.365383:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.365389:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009418a800/0x14b4f8542d4ef8f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e05 expref: 18 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.365396:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009418a800/0x14b4f8542d4ef8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e05 expref: 18 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.365405:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009418a800/0x14b4f8542d4ef8f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e05 expref: 18 pid: 4544 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.365413:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.365414:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.365416:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f469200/0x14b4f8542d4efa3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.365422:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f469200/0x14b4f8542d4efa3c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.365436:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.365450:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260458112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.365455:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4602 00000100:00100000:0.0:1746065106.373940:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.379944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.381319:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4604 00000100:00100000:0.0:1746065106.381328:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260458368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.381341:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.381359:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec34a00/0x14b4f8542d4ef978 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e52 expref: 27 pid: 4545 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.381370:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec34a00/0x14b4f8542d4ef978 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e52 expref: 27 pid: 4545 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.381388:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec34a00/0x14b4f8542d4ef978 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58e52 expref: 27 pid: 4545 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.381398:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.381399:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.381403:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2c00/0x14b4f8542d4efa19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.381410:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2c00/0x14b4f8542d4efa19 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.381441:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.381489:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260458368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 163us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.381495:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4604 00000100:00100000:0.0:1746065106.383554:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.388653:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260459136 00000100:00100000:0.0:1746065106.388657:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260459136 00010000:00010000:0.0:1746065106.388672:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0000/0x14b4f8542d4eee2d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e587ec expref: 299 pid: 20754 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746065106.388699:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4608 00000100:00100000:0.0:1746065106.388708:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+299:1959:x1830881260459136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.388714:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.388721:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0000/0x14b4f8542d4eee2d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e587ec expref: 299 pid: 20754 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.389162:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0000/0x14b4f8542d4eee2d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e587ec expref: 299 pid: 20754 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.389175:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0000/0x14b4f8542d4eee2d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e587ec expref: 299 pid: 20754 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746065106.389184:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065106.389186:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe68400/0x14b4f8542d4efa43 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065106.389191:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.389207:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+298:1959:x1830881260459136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 504us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.389212:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4608 00000100:00100000:0.0:1746065106.390107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000040:00080000:0.0:1746065106.392170:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2310, 88 off192904 00000004:00080000:0.0:1746065106.392177:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705683361778ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065106.392200:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2311, 88 off192992 00000004:00080000:0.0:1746065106.392203:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705683388040ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065106.392210:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2312, 88 off193080 00000004:00080000:0.0:1746065106.392212:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705683396882ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065106.392262:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2351, 88 off196696 00000004:00080000:0.0:1746065106.392265:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705683449352ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065106.392286:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2313, 88 off193168 00000004:00080000:0.0:1746065106.392289:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705683473485ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065106.392297:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2352, 88 off196784 00000004:00080000:0.0:1746065106.392299:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705683484077ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065106.392305:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2314, 88 off193256 00000004:00080000:0.0:1746065106.392308:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705683492432ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065106.392320:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2353, 88 off196872 00000004:00080000:0.0:1746065106.392322:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705683506747ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065106.392328:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2354, 88 off196960 00000004:00080000:0.0:1746065106.392331:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705683515388ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065106.392336:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2355, 88 off197048 00000004:00080000:0.0:1746065106.392339:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705683523477ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065106.392344:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2356, 88 off197136 00000004:00080000:0.0:1746065106.392347:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705683531642ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065106.392353:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2315, 88 off193344 00000004:00080000:0.0:1746065106.392356:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705683540310ns, next at 666938887344ns, rc = 0 00010000:00010000:0.0:1746065106.421648:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe68400/0x14b4f8542d4efa43 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065106.421656:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe68400/0x14b4f8542d4efa43 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065106.421662:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe68400/0x14b4f8542d4efa43 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065106.421667:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe68400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065106.421670:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe68400/0x14b4f8542d4efa43 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065106.421676:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe68400/0x14b4f8542d4efa43 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065106.421688:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065106.421691:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065106.421694:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe68400/0x14b4f8542d4efa43 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065106.421698:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe68400/0x14b4f8542d4efa43 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065106.422106:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259501824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.423836:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.423849:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f78e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259502336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.423866:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746065106.423883:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065106.423886:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065106.423895:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259502208 00000100:00100000:0.0:1746065106.423898:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259502208 00000100:00100000:0.0:1746065106.425401:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9392 00000100:00100000:0.0:1746065106.425408:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881259502208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.425539:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881259502208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (2916us total) trans 17179872538 rc 0/0 00000100:00100000:0.0:1746065106.425543:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9392 00000100:00100000:0.0:1746065106.425644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:0.0:1746065106.425668:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f044000/2, rc 0, transno 17179872534 00000100:00100000:0.0:1746065106.425671:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259501824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.426781:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259503488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.426865:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065106.427413:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f78e300/2, rc 0, transno 17179872535 00000100:00100000:0.0:1746065106.427417:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f78e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259502336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.428012:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3d880/2, rc 0, transno 17179872539 00000100:00100000:0.0:1746065106.428015:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259503488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.436564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.436669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.436690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.436716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.436730:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.436795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.437203:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260459648 00000100:00100000:0.0:1746065106.437206:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260459648 00000100:00100000:0.0:1746065106.437222:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9394 00000100:00100000:0.0:1746065106.437228:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260459776:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065106.437245:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065106.437698:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013667ce00/0x14b4f8542d4efa82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58ed0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065106.437709:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6d3, atime: 0x6812d6d3, ctime: 0x6812d6d3, blocks: 0x821 00010000:00010000:0.0:1746065106.437717:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.437718:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.437722:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013667ce00/0x14b4f8542d4efa82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ed0 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065106.437731:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013667ce00/0x14b4f8542d4efa82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ed0 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065106.437736:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013667ce00, rc 0) 00000100:00100000:0.0:1746065106.437753:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260459776:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 526us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.437758:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9394 00000100:00100000:0.0:1746065106.444925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.449186:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.449224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.449269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.449291:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260460928 00000100:00100000:0.0:1746065106.449298:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260460928 00000100:00100000:0.0:1746065106.449335:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260461056 00000100:00100000:0.0:1746065106.449337:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260461056 00000100:00100000:0.0:1746065106.449348:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260461184 00000100:00100000:0.0:1746065106.449349:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260461184 00000100:00100000:0.0:1746065106.449361:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4164 00000100:00100000:0.0:1746065106.449368:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260460928:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065106.449396:0:21485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b64be00/0x14b4f8542d4efa90 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.449407:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.449409:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.449413:0:21485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b64be00/0x14b4f8542d4efa90 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.449424:0:21485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b64be00/0x14b4f8542d4efa90 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065106.454749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.458426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.458458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.459680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.460601:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4168 00000100:00100000:0.0:1746065106.460610:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881260461824:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065106.460640:0:21486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5704600/0x14b4f8542d4efaac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.460653:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.460655:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.460659:0:21486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5704600/0x14b4f8542d4efaac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.460671:0:21486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5704600/0x14b4f8542d4efaac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065106.487507:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.491010:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.491043:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.491056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.491065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.491083:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.491142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.491160:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9400 00000100:00100000:0.0:1746065106.491665:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260462720:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065106.491771:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065106.491774:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.491776:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.491778:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.491779:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:0.0:1746065106.491799:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260462720:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 632us (795us total) trans 17179872541 rc 0/0 00000100:00100000:0.0:1746065106.491805:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9400 00000100:00100000:0.0:1746065106.491841:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9405 00000100:00100000:0.0:1746065106.491846:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260463360:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065106.491915:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065106.491918:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065106 -> 1746065107 00002000:00010000:0.0:1746065106.491919:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065106 -> 1746065107 00002000:00010000:0.0:1746065106.491921:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065106 -> 1746065107 00002000:00010000:0.0:1746065106.491923:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746065106.491940:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260463360:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 95us (798us total) trans 21474839805 rc 0/0 00000100:00100000:0.0:1746065106.491945:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9405 00000100:00100000:0.0:1746065106.494532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.497035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.526469:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259505152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.526506:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259504000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065106.527342:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.527541:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259504512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065106.527560:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.530106:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259505024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.530131:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.530293:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259505536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.530309:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065106.531141:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d96a00/2, rc 0, transno 21474839813 00000100:00100000:0.0:1746065106.531146:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259504000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065106.531151:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d96d80/2, rc 0, transno 21474839814 00000100:00100000:0.0:1746065106.531154:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259504512:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065106.531159:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06d80/2, rc 0, transno 17179872544 00000100:00100000:0.0:1746065106.531164:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259505024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.531178:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259505536 00000100:00100000:0.0:1746065106.531180:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259505536 00000100:00100000:0.0:1746065106.531193:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9415 00000100:00100000:0.0:1746065106.531197:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881259505536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.531286:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3298:x1830881259505536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (975us total) trans 17179872545 rc 0/0 00000100:00100000:0.0:1746065106.531291:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9415 00000100:00100000:0.0:1746065106.531926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.531944:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.531963:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259505664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.531978:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.532025:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065106.532029:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259505792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.532045:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065106.532071:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05f80/2, rc 0, transno 17179872545 00000100:00100000:0.0:1746065106.532073:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259505536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.533553:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cd180/2, rc 0, transno 17179872550 00000100:00100000:0.0:1746065106.533557:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259505792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.533564:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd04a80/2, rc 0, transno 17179872548 00000100:00100000:0.0:1746065106.533567:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259505152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.533572:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06a00/2, rc 0, transno 17179872549 00000100:00100000:0.0:1746065106.533574:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259505664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.561614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.566841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.569353:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.571619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.575567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.576019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.576722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.587229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.610317:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259506688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065106.610336:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610347:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259507200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065106.610357:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610364:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259507712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.610375:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610381:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259508224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.610390:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610397:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746065106.610401:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259506560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065106.610410:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610416:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259507072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065106.610425:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610432:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259507584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.610440:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610453:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259508096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.610462:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610484:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259507840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.610496:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610502:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259508352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.610511:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610518:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065106.610522:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259507968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.610533:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610538:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259508480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.610549:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.610563:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259506688 00000100:00100000:0.0:1746065106.610566:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259506688 00000100:00100000:0.0:1746065106.610577:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259507200 00000100:00100000:0.0:1746065106.610578:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259507200 00000100:00100000:0.0:1746065106.610584:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259507712 00000100:00100000:0.0:1746065106.610585:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259507712 00000100:00100000:0.0:1746065106.610591:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259508224 00000100:00100000:0.0:1746065106.610592:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259508224 00000100:00100000:0.0:1746065106.610596:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259506560 00000100:00100000:0.0:1746065106.610598:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259506560 00000100:00100000:0.0:1746065106.610602:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259507072 00000100:00100000:0.0:1746065106.610603:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259507072 00000100:00100000:0.0:1746065106.610607:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259507584 00000100:00100000:0.0:1746065106.610608:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259507584 00000100:00100000:0.0:1746065106.610611:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259508096 00000100:00100000:0.0:1746065106.610613:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259508096 00000100:00100000:0.0:1746065106.610617:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259507840 00000100:00100000:0.0:1746065106.610618:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259507840 00000100:00100000:0.0:1746065106.610623:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259508352 00000100:00100000:0.0:1746065106.610624:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259508352 00000100:00100000:0.0:1746065106.610627:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259507968 00000100:00100000:0.0:1746065106.610628:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259507968 00000100:00100000:0.0:1746065106.610632:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259508480 00000100:00100000:0.0:1746065106.610633:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259508480 00000100:00100000:0.0:1746065106.610639:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9428 00000100:00100000:0.0:1746065106.610643:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f14f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881259506688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065106.610721:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065106.610724:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.610726:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.610727:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.610729:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065106.610746:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f14f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3298:x1830881259506688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (409us total) trans 21474839819 rc 0/0 00000100:00100000:0.0:1746065106.610750:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9428 00000100:00100000:0.0:1746065106.610763:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9429 00000100:00100000:0.0:1746065106.610766:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881259507200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065106.610836:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065106.610839:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065106.610840:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065106.610842:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065106.610843:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065106.610859:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3298:x1830881259507200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (501us total) trans 21474839820 rc 0/0 00000100:00100000:0.0:1746065106.610864:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9429 00000100:00100000:0.0:1746065106.610874:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9430 00000100:00100000:0.0:1746065106.610878:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881259507712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065106.611043:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065106.611046:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.611048:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.611049:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.611051:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065106.611068:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259507712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (692us total) trans 17179872553 rc 0/0 00000100:00100000:0.0:1746065106.611073:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9430 00000100:00100000:0.0:1746065106.611083:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9432 00000100:00100000:0.0:1746065106.611087:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881259506560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065106.611146:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065106.611148:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.611150:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.611151:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.611153:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065106.611167:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3298:x1830881259506560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (756us total) trans 21474839821 rc 0/0 00000100:00100000:0.0:1746065106.611172:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9432 00000100:00100000:0.0:1746065106.611180:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9434 00000100:00100000:0.0:1746065106.611184:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881259507584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065106.611248:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065106.611250:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.611251:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.611253:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065107 -> 1746065107 00002000:00010000:0.0:1746065106.611254:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:0.0:1746065106.611272:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259507584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (830us total) trans 17179872555 rc 0/0 00000100:00100000:0.0:1746065106.611277:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9434 00000100:00100000:0.0:1746065106.611286:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9435 00000100:00100000:0.0:1746065106.611290:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881259508096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065106.611348:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065106.611350:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065106.611351:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065106.611353:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065106.611355:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065106.611371:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259508096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (908us total) trans 17179872556 rc 0/0 00000100:00100000:0.0:1746065106.611375:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9435 00000100:00100000:0.0:1746065106.611385:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9437 00000100:00100000:0.0:1746065106.611389:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881259508352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.611461:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881259508352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (948us total) trans 17179872558 rc 0/0 00000100:00100000:0.0:1746065106.611466:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9437 00000100:00100000:0.0:1746065106.611487:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9439 00000100:00100000:0.0:1746065106.611491:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3295:x1830881259508480:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.611550:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff4000/2, rc 0, transno 17179872557 00000100:00100000:0.0:1746065106.611557:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259507840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.611563:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4b1180/2, rc 0, transno 17179872558 00000100:00100000:0.0:1746065106.611566:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259508352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.611579:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7ace00/2, rc 0, transno 21474839821 00000100:00100000:0.0:1746065106.611582:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259506560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065106.611587:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7aed80/2, rc 0, transno 21474839822 00000100:00100000:0.0:1746065106.611589:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259507072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065106.611594:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff7480/2, rc 0, transno 17179872555 00000100:00100000:0.0:1746065106.611596:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259507584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.611601:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4b2680/2, rc 0, transno 17179872556 00000100:00100000:0.0:1746065106.611603:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259508096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.611609:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7adf80/2, rc 0, transno 21474839819 00000100:00100000:0.0:1746065106.611611:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259506688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065106.611616:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3c700/2, rc 0, transno 21474839820 00000100:00100000:0.0:1746065106.611679:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259507200:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065106.611691:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff7100/2, rc 0, transno 17179872553 00000100:00100000:0.0:1746065106.611693:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259507712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065106.611699:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4b3480/2, rc 0, transno 17179872554 00000100:00100000:0.0:1746065106.611701:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259508224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.611990:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259508608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.612015:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.614746:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259508480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3254us (4195us total) trans 17179872560 rc 0/0 00000100:00100000:0.0:1746065106.614752:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9439 00000004:00080000:0.0:1746065106.615021:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4b0380/2, rc 0, transno 17179872561 00000100:00100000:0.0:1746065106.615026:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259508608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.615327:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260466944 00000100:00100000:0.0:1746065106.615332:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260466944 00000100:00100000:0.0:1746065106.615357:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8738 00000100:00100000:0.0:1746065106.615362:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28250:x1830881260466944:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065106.615373:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065106.615387:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2f200/0x14b4f8542d4efb85 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58f39 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.615427:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2f200/0x14b4f8542d4efb85 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f39 expref: 249 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.615439:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2f200/0x14b4f8542d4efb85 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f39 expref: 249 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.615454:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065106.615456:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065106.615460:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e2f200, rc 0) 00000100:00100000:0.0:1746065106.615496:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28250:x1830881260466944:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 133us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.615501:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8738 00000100:00100000:0.0:1746065106.615562:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259506432:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065106.615588:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ac200/0x14b4f8542d4efb3f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f1d expref: 12 pid: 16767 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065106.615600:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ace00/0x14b4f8542d4efb46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f1d expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.615612:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363ace00, rc 0) 00000100:00100000:0.0:1746065106.615632:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:28251:x1830881260465536:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 42554us (42642us total) trans 8589942713 rc 0/0 00000100:00100000:0.0:1746065106.615637:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8734 00000100:00100000:0.0:1746065106.616244:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467072 00000100:00100000:0.0:1746065106.616248:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467072 00000100:00100000:0.0:1746065106.616415:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8739 00000100:00100000:0.0:1746065106.616420:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:28257:x1830881260467072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065106.616428:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065106.616435:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093882000/0x14b4f8542d4efb8c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58f40 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.616455:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093882000/0x14b4f8542d4efb8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f40 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.616464:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093882000/0x14b4f8542d4efb8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f40 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.616473:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065106.616483:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065106.616485:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093882000, rc 0) 00000100:00100000:0.0:1746065106.616725:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:28257:x1830881260467072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 303us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.616730:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8739 00000004:00080000:0.0:1746065106.616756:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4b0e00/2, rc 0, transno 17179872560 00000100:00100000:0.0:1746065106.616760:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259508480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065106.619050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.619193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.619212:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467328 00000100:00100000:0.0:1746065106.619215:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467328 00000100:00100000:0.0:1746065106.619234:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 582 00000100:00100000:0.0:1746065106.619238:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260467328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.619246:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.619255:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093882000/0x14b4f8542d4efb8c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f40 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.619311:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065106.619315:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.619332:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260467328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.619337:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 582 00000100:00100000:0.0:1746065106.619566:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467584 00000100:00100000:0.0:1746065106.619569:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467584 00000100:00100000:0.0:1746065106.619596:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9442 00000100:00100000:0.0:1746065106.619601:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260467584:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065106.619608:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065106.619616:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093882a00/0x14b4f8542d4efb9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58f4e expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.619627:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.619628:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.619632:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093882a00/0x14b4f8542d4efb9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f4e expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065106.619640:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093882a00/0x14b4f8542d4efb9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f4e expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065106.619647:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093882a00, rc 0) 00000100:00100000:0.0:1746065106.619674:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260467584:12345-192.168.202.46@tcp:101:cat.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.619678:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9442 00000100:00100000:0.0:1746065106.620651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.620675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.620696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.620707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.620720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.620737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.621094:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9447 00000100:00100000:0.0:1746065106.621101:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260468096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065106.621108:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065106.621114:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093883e00/0x14b4f8542d4efbbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e58f6a expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.621122:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.621129:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093883e00/0x14b4f8542d4efbbd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f6a expref: 23 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065106.621137:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093883e00/0x14b4f8542d4efbbd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f6a expref: 22 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065106.621145:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093883e00, rc 0) 00000100:00100000:0.0:1746065106.621161:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260468096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 61us (452us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065106.621166:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9447 00000100:00100000:0.0:1746065106.628724:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260468736 00000100:00100000:0.0:1746065106.628735:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260468736 00010000:00010000:0.0:1746065106.628765:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb72800/0x14b4f8542d4efb93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f47 expref: 21 pid: 21998 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746065106.629423:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260468864 00000100:00100000:0.0:1746065106.629427:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260468864 00010000:00010000:0.0:1746065106.629439:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3eb400/0x14b4f8542d4efa6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ec9 expref: 11 pid: 8851 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746065106.629455:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260469120 00000100:00100000:0.0:1746065106.629458:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260469120 00010000:00010000:0.0:1746065106.629466:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3eae00/0x14b4f8542d4efa5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ede expref: 12 pid: 8851 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746065106.629488:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4615 00000100:00100000:0.0:1746065106.629493:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881260468736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.629500:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.629516:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb72800/0x14b4f8542d4efb93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f47 expref: 21 pid: 21998 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.629524:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb72800/0x14b4f8542d4efb93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f47 expref: 21 pid: 21998 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.629538:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb72800/0x14b4f8542d4efb93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f47 expref: 21 pid: 21998 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.629548:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.629566:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1958:x1830881260468736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.629571:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4615 00000100:00100000:0.0:1746065106.629588:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4616 00000100:00100000:0.0:1746065106.629592:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1958:x1830881260468864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.629598:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.629605:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3eb400/0x14b4f8542d4efa6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ec9 expref: 12 pid: 8851 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.629612:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3eb400/0x14b4f8542d4efa6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ec9 expref: 12 pid: 8851 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.629622:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3eb400/0x14b4f8542d4efa6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ec9 expref: 12 pid: 8851 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.629629:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065106.629642:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881260468864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.629647:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4616 00000100:00100000:0.0:1746065106.629657:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4617 00000100:00100000:0.0:1746065106.629662:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260469120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065106.629668:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065106.629675:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3eae00/0x14b4f8542d4efa5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ede expref: 10 pid: 8851 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.629683:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3eae00/0x14b4f8542d4efa5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ede expref: 10 pid: 8851 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746065106.629692:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.629693:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065106.629698:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4efba1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f5c expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.629705:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4efba1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f5c expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.629724:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4efba1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f5c expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065106.629734:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259509376:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065106.629771:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e300 going to sleep for 11 seconds 00010000:00010000:0.0:1746065106.630305:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3eae00/0x14b4f8542d4efa5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58ede expref: 10 pid: 8851 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746065106.630313:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259509120:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065106.630330:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4efba1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f5c expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065106.630337:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f6a00, rc 0) 00000100:00100000:0.0:1746065106.630354:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28250:x1830881260467712:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9396us (9704us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065106.630359:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9443 00000100:00100000:0.0:1746065106.637012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.642421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.645463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.645930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.647397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.647419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.647474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.649742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.651027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.657908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.657941:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.657965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.670243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.672809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.672865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.684980:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.685015:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.685029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065106.693218:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065106.703893:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.705748:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260473344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17190us (20713us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065106.705755:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4178 00002000:00100000:0.0:1746065106.705762:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f15f800 x1830881260473344/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:22/0 lens 488/440 e 0 to 0 dl 1746065117 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065106.705769:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15f800 with x1830881260473344 ext(1048576->2097151) 00002000:00010000:0.0:1746065106.705773:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15f800 00000100:00100000:0.0:1746065106.708204:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259510656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065106.708251:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065106.718516:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.720547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.722510:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.729909:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.729948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.729971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.730015:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.730205:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4182 00000100:00100000:0.0:1746065106.730213:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881260474752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065106.747795:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.759975:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.760013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.767493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.775482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.777614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.777917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.783542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.786915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065106.789983:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065106.794437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.795789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.795841:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.799716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.810500:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260477440:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13436us (14658us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065106.810507:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4187 00002000:00100000:0.0:1746065106.810512:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009ba1c380 x1830881260477440/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:22/0 lens 488/440 e 0 to 0 dl 1746065117 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065106.810517:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c380 with x1830881260477440 ext(3145728->4194303) 00002000:00010000:0.0:1746065106.810520:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1c380 00000100:00100000:0.0:1746065106.820736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.830078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.832862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.835625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.837799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.844367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.849490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.850687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.850912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.854329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.858173:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.886923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.893968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.901292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.901326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.901363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.905119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.907515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.913727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.913756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.913800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.919287:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.920422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.922159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.922865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.922944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.931106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.946431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.949949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.957193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.963105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.981865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.986883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.987612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.989159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.989197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065106.990332:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093883400/0x14b4f8542d4efca4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065106.990339:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093883400/0x14b4f8542d4efca4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:0.0:1746065106.990356:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00000100:00100000:0.0:1746065106.997722:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065106.997768:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.006064:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.009263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.032686:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.033354:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260485888 00000100:00100000:0.0:1746065107.033358:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260485888 00002000:00100000:0.0:1746065107.033375:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2334720->3383295) req@ffff88012b4b3100 x1830881260485888/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:23/0 lens 488/0 e 0 to 0 dl 1746065118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.033388:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b3100 with x1830881260485888 ext(2334720->3383295) 00002000:00010000:0.0:1746065107.033391:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4b3100 00000100:00100000:0.0:1746065107.033411:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4201 00000100:00100000:0.0:1746065107.033417:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881260485632:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065107.039142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.041903:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881260485632:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8485us (8852us total) trans 0 rc 671744/671744 00000100:00100000:0.0:1746065107.041910:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4201 00002000:00100000:0.0:1746065107.041915:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3522560->4194303) req@ffff88012b4b2d80 x1830881260485632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:23/0 lens 488/440 e 0 to 0 dl 1746065118 ref 1 fl Complete:/200/0 rc 671744/671744 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.041921:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b2d80 with x1830881260485632 ext(3522560->4194303) 00002000:00010000:0.0:1746065107.041923:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4b2d80 00000100:00100000:0.0:1746065107.058258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.061011:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.064170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.068964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.069001:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.069024:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.069055:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065107.069782:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065107.069785:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065107.079443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.079524:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.106953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.111944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.117611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.125116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065107.126140:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065107.127643:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.139173:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260489088 00000100:00100000:0.0:1746065107.139181:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260489088 00010000:00010000:0.0:1746065107.139208:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093883c00/0x14b4f8542d4efc34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2768896->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fcc expref: 39 pid: 8428 timeout: 806 lvb_type: 0 00000100:00100000:0.0:1746065107.139247:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4640 00000100:00100000:0.0:1746065107.139254:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881260489088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.139266:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.139284:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093883c00/0x14b4f8542d4efc34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2768896->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fcc expref: 39 pid: 8428 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746065107.139294:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093883c00/0x14b4f8542d4efc34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2768896->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fcc expref: 39 pid: 8428 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746065107.139313:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093883c00/0x14b4f8542d4efc34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2768896->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fcc expref: 39 pid: 8428 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746065107.139365:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.139367:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.139373:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb72a00/0x14b4f8542d4efd06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5904a expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.139379:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb72a00/0x14b4f8542d4efd06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5904a expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.139408:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb72a00/0x14b4f8542d4efd06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5904a expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065107.139418:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259515264:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065107.139682:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065107.146663:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.156319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.160065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.162186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.165698:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.165722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.165799:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4641 00000100:00100000:0.0:1746065107.165807:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260489984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065107.169610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.171190:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.202063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.204313:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.212493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.212525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.218848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.218879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.220599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.224413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.229564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.243275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.243315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.243356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.243380:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260492288 00000100:00100000:0.0:1746065107.243387:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260492288 00002000:00100000:0.0:1746065107.243425:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880134d86680 x1830881260492288/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:23/0 lens 488/0 e 0 to 0 dl 1746065118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.243434:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86680 with x1830881260492288 ext(3145728->4194303) 00002000:00010000:0.0:1746065107.243439:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d86680 00000100:00100000:0.0:1746065107.243453:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260492544 00000100:00100000:0.0:1746065107.243456:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260492544 00002000:00100000:0.0:1746065107.243467:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880134d84a80 x1830881260492544/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:23/0 lens 488/0 e 0 to 0 dl 1746065118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.243489:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84a80 with x1830881260492544 ext(3145728->4194303) 00002000:00010000:0.0:1746065107.243492:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d84a80 00000100:00100000:0.0:1746065107.243513:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260492800 00000100:00100000:0.0:1746065107.243516:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260492800 00002000:00100000:0.0:1746065107.243527:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x380:0x0] (2473984->2478079) req@ffff880134d85c00 x1830881260492800/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:23/0 lens 488/0 e 0 to 0 dl 1746065118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.243533:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85c00 with x1830881260492800 ext(2473984->2478079) 00002000:00010000:0.0:1746065107.243536:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d85c00 00000100:00100000:0.0:1746065107.243547:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4211 00000100:00100000:0.0:1746065107.243553:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260492288:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065107.268199:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.274374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.286755:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.290431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.294012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.298968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.299302:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.303341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.303375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.303450:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.303524:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.306074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.306119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.314528:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260495488 00000100:00100000:0.0:1746065107.314536:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260495488 00000100:00100000:0.0:1746065107.316330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.318599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.318627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.320762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.322555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.325954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.326731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.328085:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259517312:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065107.328100:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.328118:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260496384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2020us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.328125:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4648 00000100:00100000:0.0:1746065107.332760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.354009:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260497024 00000100:00100000:0.0:1746065107.354013:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260497024 00010000:00010000:0.0:1746065107.354030:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c39f600/0x14b4f8542d4efded lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590c1 expref: 43 pid: 8428 timeout: 806 lvb_type: 0 00000100:00100000:0.0:1746065107.354058:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4649 00000100:00100000:0.0:1746065107.354063:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1958:x1830881260497024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.354071:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.354088:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c39f600/0x14b4f8542d4efded lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590c1 expref: 43 pid: 8428 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746065107.354102:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c39f600/0x14b4f8542d4efded lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590c1 expref: 43 pid: 8428 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746065107.354117:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c39f600/0x14b4f8542d4efded lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590c1 expref: 43 pid: 8428 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746065107.354140:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.354142:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.354147:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd77e00/0x14b4f8542d4efdf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590c8 expref: 42 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.354153:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd77e00/0x14b4f8542d4efdf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590c8 expref: 42 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.354170:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd77e00/0x14b4f8542d4efdf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590c8 expref: 42 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065107.354177:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259517696:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065107.354216:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065107.356613:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.356641:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.365883:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.375306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.375343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.375370:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.375405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.383986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.402543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.412761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.524994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.533326:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260499584 00000100:00100000:0.0:1746065107.533331:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260499584 00000100:00100000:0.0:1746065107.533357:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 587 00000100:00100000:0.0:1746065107.533362:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260499584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.533371:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.533388:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c39f200/0x14b4f8542d4efe3a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590dd expref: 22 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.533407:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065107.533410:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.533440:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260499584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.533445:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 587 00000100:00100000:0.0:1746065107.542442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.555856:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.555901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.558128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.559589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.563165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.564581:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.564802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.570350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.570373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.577555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.578551:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260502272 00000100:00100000:0.0:1746065107.578554:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260502272 00010000:00010000:0.0:1746065107.578572:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd77600/0x14b4f8542d4efde6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590ba expref: 34 pid: 21235 timeout: 806 lvb_type: 0 00000100:00100000:0.0:1746065107.578589:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4653 00000100:00100000:0.0:1746065107.578594:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881260502272:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.578603:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.578613:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd77600/0x14b4f8542d4efde6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590ba expref: 34 pid: 21235 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746065107.578621:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd77600/0x14b4f8542d4efde6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590ba expref: 34 pid: 21235 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746065107.578634:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd77600/0x14b4f8542d4efde6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e590ba expref: 34 pid: 21235 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746065107.578645:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.578647:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.578652:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3fe200/0x14b4f8542d4efe79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59100 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.578657:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3fe200/0x14b4f8542d4efe79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59100 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.578674:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3fe200/0x14b4f8542d4efe79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59100 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065107.578686:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259519104:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065107.578727:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065107.588926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.588977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.588993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.589023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.591171:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.593529:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259519488:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065107.593554:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.593600:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1960:x1830881260502656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4158us (4575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.593610:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4656 00000100:00100000:0.0:1746065107.596962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.596983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.597039:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.605151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.616293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.616648:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.620915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.627865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.640774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.640904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.643547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.646424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.654390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.663299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.663380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.676132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.678623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.678648:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.678683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.685165:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1334 00000100:00100000:0.0:1746065107.685174:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260507648:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065107.704137:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881260507136:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25189us (25485us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065107.704145:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4229 00002000:00100000:0.0:1746065107.704151:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012e8b4000 x1830881260507136/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:23/0 lens 488/440 e 0 to 0 dl 1746065118 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.704158:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4000 with x1830881260507136 ext(3145728->4194303) 00002000:00010000:0.0:1746065107.704162:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b4000 00000100:00100000:0.0:1746065107.718869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.729994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.730082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.738917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.738958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.743427:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260509312 00000100:00100000:0.0:1746065107.743437:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260509312 00002000:00100000:0.0:1746065107.743483:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009c3fbb80 x1830881260509312/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:23/0 lens 488/0 e 0 to 0 dl 1746065118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.743492:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830881260509312 ext(3145728->4194303) 00002000:00010000:0.0:1746065107.743497:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:0.0:1746065107.743525:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4235 00000100:00100000:0.0:1746065107.743531:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1958:x1830881260509312:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065107.746584:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260509568 00000100:00100000:0.0:1746065107.746591:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260509568 00000100:00100000:0.0:1746065107.746636:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8753 00000100:00100000:0.0:1746065107.746644:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+22:28307:x1830881260509568:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065107.746663:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065107.746677:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4cc00/0x14b4f8542d4eff05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59169 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.746759:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.746771:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.746781:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.746792:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.746797:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.746801:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.746919:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4c000/0x14b4f8542d4eff1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.746927:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4c000/0x14b4f8542d4eff1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.746933:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4c000/0x14b4f8542d4eff1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065107.746941:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065107.747015:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747021:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747025:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747030:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb4da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065107.747033:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747038:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747047:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065107.747050:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065107.747053:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747057:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4da00/0x14b4f8542d4eff0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747077:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747081:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747089:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747092:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb4ce00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065107.747095:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747099:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747105:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c773900) 00010000:00010000:0.0:1746065107.747107:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065107.747108:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747113:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4ce00/0x14b4f8542d4eff13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.747141:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4cc00/0x14b4f8542d4eff05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59169 expref: 25 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.747151:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4c000/0x14b4f8542d4eff1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59169 expref: 24 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.747157:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065107.747158:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065107.747161:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4c000, rc 0) 00000100:00100000:0.0:1746065107.747193:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:28307:x1830881260509568:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 549us (1540us total) trans 8589942743 rc 0/0 00000100:00100000:0.0:1746065107.747199:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8753 00000100:00100000:0.0:1746065107.758122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.764069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.766433:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.766480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.769378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.769605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.775440:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260510848 00000100:00100000:0.0:1746065107.775446:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260510848 00002000:00100000:0.0:1746065107.775484:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37a:0x0] (1499136->1503231) req@ffff88009c3fad80 x1830881260510848/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:23/0 lens 488/0 e 0 to 0 dl 1746065118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.775491:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830881260510848 ext(1499136->1503231) 00002000:00010000:0.0:1746065107.775495:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:0.0:1746065107.775516:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4237 00000100:00100000:0.0:1746065107.775523:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260510848:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065107.776900:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260510848:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1372us (1766us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065107.776908:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4237 00002000:00100000:0.0:1746065107.776914:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37a:0x0] (1499136->1503231) req@ffff88009c3fad80 x1830881260510848/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:23/0 lens 488/4536 e 0 to 0 dl 1746065118 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.776921:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830881260510848 ext(1499136->1503231) 00002000:00010000:0.0:1746065107.776925:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:0.0:1746065107.782131:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260511232 00000100:00100000:0.0:1746065107.782140:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260511232 00002000:00100000:0.0:1746065107.782177:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4636671) req@ffff8800a5882d80 x1830881260511232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:23/0 lens 488/0 e 0 to 0 dl 1746065118 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.782193:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881260511232 ext(4194304->4636671) 00002000:00010000:0.0:1746065107.782198:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882d80 00000100:00100000:0.0:1746065107.782215:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4238 00000100:00100000:0.0:1746065107.782223:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1959:x1830881260511232:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065107.783417:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260511360 00000100:00100000:0.0:1746065107.783421:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260511360 00000100:00100000:0.0:1746065107.783445:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9510 00000100:00100000:0.0:1746065107.783451:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:28307:x1830881260511360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065107.783461:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065107.783485:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb4d800/0x14b4f8542d4eff44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5918c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.783509:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f481c00/0x14b4f8542d4efee9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5914d expref: 44 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.783517:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3ff200/0x14b4f8542d4efef0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59154 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.783523:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.783525:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.783528:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb4d800/0x14b4f8542d4eff44 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3817472->4194303] (req 3817472->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5918c expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.783552:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3ff200/0x14b4f8542d4efef0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59154 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.783568:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3ff200/0x14b4f8542d4efef0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59154 expref: 29 pid: 4544 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.783578:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259521536:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065107.783626:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f481c00/0x14b4f8542d4efee9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5914d expref: 44 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.783634:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f481c00/0x14b4f8542d4efee9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5914d expref: 44 pid: 4544 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.783642:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259521664:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065107.783655:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065107.789942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.791212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.792013:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1959:x1830881260511232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9649us (9834us total) trans 0 rc 442368/442368 00000100:00100000:0.0:1746065107.792021:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4238 00002000:00100000:0.0:1746065107.792028:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4636671) req@ffff8800a5882d80 x1830881260511232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:23/0 lens 488/440 e 0 to 0 dl 1746065118 ref 1 fl Complete:/200/0 rc 442368/442368 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065107.792036:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881260511232 ext(4194304->4636671) 00010000:00010000:0.0:1746065107.792041:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f481c00/0x14b4f8542d4efee9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5914d expref: 45 pid: 4544 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.792053:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f481c00/0x14b4f8542d4efee9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5914d expref: 45 pid: 4544 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746065107.792058:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5882d80 00000100:00100000:0.0:1746065107.793514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.796869:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.798930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.798965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.799979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.800007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.800037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.801695:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.802720:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.803376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.806268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.807132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.813242:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.815624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.815686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.815708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.815734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.819306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.825755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.826588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.845753:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065107.845912:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065107.848176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.853742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.860537:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.861195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.861215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.861244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.862208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.862227:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260515584 00000100:00100000:0.0:1746065107.862233:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260515584 00000100:00100000:0.0:1746065107.862270:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260515840 00000100:00100000:0.0:1746065107.862271:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260515840 00000100:00100000:0.0:1746065107.862288:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260515712 00000100:00100000:0.0:1746065107.862290:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260515712 00000100:00100000:0.0:1746065107.862298:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260515968 00000100:00100000:0.0:1746065107.862300:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260515968 00000100:00100000:0.0:1746065107.862308:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260516096 00000100:00100000:0.0:1746065107.862310:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260516096 00000100:00100000:0.0:1746065107.862320:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9521 00000100:00100000:0.0:1746065107.862326:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260515584:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065107.862340:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065107.862352:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb4cc00/0x14b4f8542d4effad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e591e0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.862372:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.862373:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.862381:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb4cc00/0x14b4f8542d4effad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591e0 expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.862394:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb4cc00/0x14b4f8542d4effad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591e0 expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.862408:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4cc00, rc 0) 00000100:00100000:0.0:1746065107.862442:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260515584:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 116us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.862447:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9521 00000100:00100000:0.0:1746065107.862463:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9522 00000100:00100000:0.0:1746065107.862478:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260515840:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065107.862484:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065107.862492:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb4d200/0x14b4f8542d4effb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e591ee expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065107.862522:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259523072:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065107.862558:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00080000:0.0:1746065107.862570:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065107.862573:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065107.862583:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9523 00000100:00100000:0.0:1746065107.862588:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260515712:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065107.862593:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065107.862600:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb4d400/0x14b4f8542d4effbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e591e7 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.862609:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.862610:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.862615:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb4d400/0x14b4f8542d4effbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591e7 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.862628:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb4d400/0x14b4f8542d4effbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591e7 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.862635:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4d400, rc 0) 00000100:00100000:0.0:1746065107.862648:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260515712:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 60us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.862652:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9523 00000100:00100000:0.0:1746065107.862662:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9524 00000100:00100000:0.0:1746065107.862666:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260515968:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065107.862671:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065107.862676:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb4c000/0x14b4f8542d4effc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e591f5 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065107.862693:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259523200:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065107.862709:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065107.862740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.865858:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259523328:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065107.865873:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb7a200/0x14b4f8542d4effd0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59203 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.865882:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb7a200/0x14b4f8542d4effd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59203 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.865891:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb7a200, rc 0) 00000100:00100000:0.0:1746065107.865908:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260516224:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2665us (3168us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065107.865914:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9526 00000100:00100000:0.0:1746065107.869243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.874580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.879418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.885431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.892879:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.892898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.892918:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260518144 00000100:00100000:0.0:1746065107.892926:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260518144 00010000:00010000:0.0:1746065107.892960:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb4d400/0x14b4f8542d4effbb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591e7 expref: 13 pid: 4545 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746065107.892985:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260518272 00000100:00100000:0.0:1746065107.892987:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260518272 00010000:00010000:0.0:1746065107.892997:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb4cc00/0x14b4f8542d4effad lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591e0 expref: 12 pid: 8851 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746065107.893009:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4670 00000100:00100000:0.0:1746065107.893015:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1959:x1830881260518144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.893026:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.893044:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb4d400/0x14b4f8542d4effbb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591e7 expref: 13 pid: 4545 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746065107.893053:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb4d400/0x14b4f8542d4effbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591e7 expref: 13 pid: 4545 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746065107.893077:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.893112:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1959:x1830881260518144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.893117:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4670 00000100:00100000:0.0:1746065107.893944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.893973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.893984:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260518016 00000100:00100000:0.0:1746065107.893987:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260518016 00010000:00010000:0.0:1746065107.893999:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801363ac600/0x14b4f8542d4efbfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fa9 expref: 45 pid: 8851 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746065107.894012:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4672 00000100:00100000:0.0:1746065107.894017:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881260518016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.894025:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.894034:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801363ac600/0x14b4f8542d4efbfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fa9 expref: 45 pid: 8851 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746065107.894041:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801363ac600/0x14b4f8542d4efbfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fa9 expref: 45 pid: 8851 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746065107.894054:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363ac600/0x14b4f8542d4efbfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fa9 expref: 45 pid: 8851 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746065107.894066:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.894083:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881260518016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.894091:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4672 00000100:00100000:0.0:1746065107.894151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.894162:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260518656 00000100:00100000:0.0:1746065107.894165:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260518656 00010000:00010000:0.0:1746065107.894176:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb7b400/0x14b4f8542d4eff75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4632576->18446744073709551615] (req 4632576->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591bd expref: 44 pid: 21235 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.894188:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4673 00000100:00100000:0.0:1746065107.894192:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881260518656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.894197:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.894207:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb7b400/0x14b4f8542d4eff75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4632576->18446744073709551615] (req 4632576->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591bd expref: 44 pid: 21235 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.894214:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb7b400/0x14b4f8542d4eff75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4632576->18446744073709551615] (req 4632576->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591bd expref: 44 pid: 21235 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.894224:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb7b400/0x14b4f8542d4eff75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4632576->18446744073709551615] (req 4632576->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e591bd expref: 44 pid: 21235 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.894232:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.894246:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260518656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.894250:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4673 00000100:00100000:0.0:1746065107.894276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.894299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.894308:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260519168 00000100:00100000:0.0:1746065107.894311:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260519168 00010000:00010000:0.0:1746065107.894321:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6145400/0x14b4f8542d4efbcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f7f expref: 28 pid: 8429 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.894335:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4674 00000100:00100000:0.0:1746065107.894339:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260519168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.894345:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.894352:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6145400/0x14b4f8542d4efbcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f7f expref: 28 pid: 8429 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.894359:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6145400/0x14b4f8542d4efbcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f7f expref: 28 pid: 8429 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.894478:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6145400/0x14b4f8542d4efbcb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f7f expref: 28 pid: 8429 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.894487:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.894489:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.894492:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f481c00/0x14b4f8542d4f0008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.894499:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f481c00/0x14b4f8542d4f0008 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.894516:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.894531:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881260519168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 191us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.894536:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4674 00000100:00100000:0.0:1746065107.894563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.894572:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260517888 00000100:00100000:0.0:1746065107.894574:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260517888 00010000:00010000:0.0:1746065107.894582:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4efcdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59020 expref: 26 pid: 8851 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746065107.894595:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4675 00000100:00100000:0.0:1746065107.894599:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260517888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.894605:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.894612:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4efcdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59020 expref: 26 pid: 8851 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746065107.894619:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4efcdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59020 expref: 26 pid: 8851 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746065107.894629:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4efcdc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59020 expref: 26 pid: 8851 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746065107.894638:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.894651:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260517888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.894657:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4675 00000100:00100000:0.0:1746065107.894710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.894737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.894748:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260518784 00000100:00100000:0.0:1746065107.894751:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260518784 00010000:00010000:0.0:1746065107.894760:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8a00/0x14b4f8542d4eff52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4632576->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5919a expref: 27 pid: 8428 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.894776:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4676 00000100:00100000:0.0:1746065107.894780:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881260518784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.894786:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.894792:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8a00/0x14b4f8542d4eff52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4632576->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5919a expref: 27 pid: 8428 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.894798:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8a00/0x14b4f8542d4eff52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4632576->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5919a expref: 27 pid: 8428 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.894807:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8b8a00/0x14b4f8542d4eff52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4632576->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5919a expref: 27 pid: 8428 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.894836:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.894850:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260518784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.894855:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4676 00000100:00100000:0.0:1746065107.897001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065107.897427:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0x14b4f8542d4f000f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.897435:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0x14b4f8542d4f000f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.897450:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0x14b4f8542d4f000f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.897461:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0x14b4f8542d4f000f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.897475:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0x14b4f8542d4f000f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.897480:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8b8c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065107.897483:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0x14b4f8542d4f000f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.897488:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0x14b4f8542d4f000f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.897497:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0x14b4f8542d4f000f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.897502:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8b8c00/0x14b4f8542d4f000f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065107.897537:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260517248:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 9883us (10190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.897543:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9527 00000100:00100000:0.0:1746065107.897679:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.906723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.906749:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260519552 00000100:00100000:0.0:1746065107.906755:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260519552 00010000:00010000:0.0:1746065107.906780:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f481200/0x14b4f8542d4eff4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59193 expref: 43 pid: 4544 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.906809:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4679 00000100:00100000:0.0:1746065107.906835:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135004000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260519552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.906849:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.906868:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f481200/0x14b4f8542d4eff4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59193 expref: 43 pid: 4544 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.906883:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f481200/0x14b4f8542d4eff4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59193 expref: 43 pid: 4544 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.906912:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f481200/0x14b4f8542d4eff4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59193 expref: 43 pid: 4544 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.906927:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.906928:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.906931:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb7a600/0x14b4f8542d4f001d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.906938:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb7a600/0x14b4f8542d4f001d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.906972:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.906997:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135004000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881260519552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 181us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.907003:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4679 00000100:00100000:0.0:1746065107.910872:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.910946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.913639:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260520064 00000100:00100000:0.0:1746065107.913647:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260520064 00000100:00100000:0.0:1746065107.913679:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8758 00000100:00100000:0.0:1746065107.913686:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28312:x1830881260520064:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:0.0:1746065107.913723:0:20754:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.913741:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8b8600/0x14b4f8542d4f0001 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59218 expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.913755:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065107.913758:0:20754:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065107.913779:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.913789:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ace00/0x14b4f8542d4efb46 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f1d expref: 23 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.913795:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4efb4d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f24 expref: 266 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.913801:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4c800/0x14b4f8542d4efc7a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fef expref: 266 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.913807:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4efcce lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59019 expref: 23 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.913812:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4efd22 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59051 expref: 266 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.913845:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.913867:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4efd22 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59051 expref: 266 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.913876:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4efd22 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59051 expref: 266 pid: 20754 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.913887:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259525120:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065107.913965:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4efcce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59019 expref: 23 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.913972:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4efcce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59019 expref: 23 pid: 14645 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.913980:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c124380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259525248:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065107.914008:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4c800/0x14b4f8542d4efc7a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fef expref: 266 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.914015:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4c800/0x14b4f8542d4efc7a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58fef expref: 266 pid: 20754 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.914022:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259525376:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065107.914047:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4efb4d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f24 expref: 266 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.914059:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4efb4d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f24 expref: 266 pid: 20754 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.914065:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259525504:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065107.914089:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ace00/0x14b4f8542d4efb46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f1d expref: 23 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.914094:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ace00/0x14b4f8542d4efb46 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f1d expref: 23 pid: 16767 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.914101:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259525632:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065107.914150:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065107.916264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.916285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.916330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.916349:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260520192 00000100:00100000:0.0:1746065107.916354:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260520192 00010000:00010000:0.0:1746065107.916377:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4efd22 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59051 expref: 267 pid: 20754 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.916403:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260520320 00000100:00100000:0.0:1746065107.916406:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260520320 00010000:00010000:0.0:1746065107.916416:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4efcce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59019 expref: 24 pid: 14645 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.916431:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4683 00000100:00100000:0.0:1746065107.916436:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881260520320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.916444:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.916450:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4efcce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59019 expref: 24 pid: 14645 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.916459:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4efcce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59019 expref: 24 pid: 14645 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.917331:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4efcce lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59019 expref: 24 pid: 14645 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.917342:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065107.917345:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.917351:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.917383:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260520320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 947us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.917389:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4683 00000100:00100000:0.0:1746065107.917498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.917510:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260520832 00000100:00100000:0.0:1746065107.917512:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260520832 00010000:00010000:0.0:1746065107.917524:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ace00/0x14b4f8542d4efb46 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f1d expref: 23 pid: 16767 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.918163:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260520704 00000100:00100000:0.0:1746065107.918167:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260520704 00010000:00010000:0.0:1746065107.918179:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4efb4d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f24 expref: 267 pid: 20754 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746065107.918197:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4684 00000100:00100000:0.0:1746065107.918201:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881260520832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.918208:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.918212:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ace00/0x14b4f8542d4efb46 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f1d expref: 23 pid: 16767 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.918219:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ace00/0x14b4f8542d4efb46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f1d expref: 23 pid: 16767 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.918230:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363ace00/0x14b4f8542d4efb46 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f1d expref: 23 pid: 16767 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.918237:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065107.918241:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.918245:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.918262:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260520832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.918267:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4684 00000100:00100000:0.0:1746065107.918276:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4685 00000100:00100000:0.0:1746065107.918279:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:1961:x1830881260520704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065107.918516:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065107.918521:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4efb4d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f24 expref: 266 pid: 20754 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.918533:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4efb4d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f24 expref: 266 pid: 20754 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.918542:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4efb4d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e58f24 expref: 266 pid: 20754 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065107.918551:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065107.918554:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.918560:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.918565:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.918578:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065107.918606:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:1961:x1830881260520704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 325us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.918611:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4685 00000004:00010000:0.0:1746065107.935943:0:20754:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f9cea00 reply state ffff880090abf000 transno 8589942749 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065107.935953:0:20754:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746065107.936035:0:20754:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065107.936048:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28312:x1830881260520064:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 22359us (22436us total) trans 8589942749 rc 0/0 00000100:00100000:0.0:1746065107.936055:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8758 00010000:00010000:0.0:1746065107.936162:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.936168:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.936174:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.936178:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb4d000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065107.936182:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.936188:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.936200:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065107.936203:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065107.936206:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065107.936211:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d000/0x14b4f8542d4f0032 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065107.936225:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259526144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065107.936271:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065107.936292:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259526656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065107.936320:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065107.936329:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259527168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065107.936346:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259525760 00000100:00100000:0.0:1746065107.936351:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259525760 00000100:00100000:0.0:1746065107.936372:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259526144 00000100:00100000:0.0:1746065107.936374:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259526144 00000100:00100000:0.0:1746065107.936383:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259526656 00000100:00100000:0.0:1746065107.936384:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259526656 00000100:00100000:0.0:1746065107.936393:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259526784 00000100:00100000:0.0:1746065107.936395:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259526784 00000100:00100000:0.0:1746065107.936400:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259527296 00000100:00100000:0.0:1746065107.936402:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259527296 00000100:00100000:0.0:1746065107.936407:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9534 00000100:00100000:0.0:1746065107.936411:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259526144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065107.936514:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9536 00000100:00100000:0.0:1746065107.936518:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881259526656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065107.936527:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9537 00000100:00100000:0.0:1746065107.936531:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3296:x1830881259526784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065107.936627:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3296:x1830881259526784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (288us total) trans 17179872573 rc 0/0 00000100:00100000:0.0:1746065107.936631:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9537 00000100:00100000:0.0:1746065107.936711:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881259526656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (390us total) trans 21474839831 rc 0/0 00000100:00100000:0.0:1746065107.936715:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9536 00000100:00100000:0.0:1746065107.936728:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065107.936739:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259527680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065107.936754:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065107.936777:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135006680/2, rc 0, transno 21474839831 00000100:00100000:0.0:1746065107.936781:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259526656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065107.936794:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9540 00000100:00100000:0.0:1746065107.936798:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881259527680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065107.936865:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881259526144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 453us (592us total) trans 21474839833 rc 0/0 00000100:00100000:0.0:1746065107.936870:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9534 00000100:00100000:0.0:1746065107.936935:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3295:x1830881259527680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (180us total) trans 17179872576 rc 0/0 00000100:00100000:0.0:1746065107.936940:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9540 00000004:00080000:0.0:1746065107.936954:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135004700/2, rc 0, transno 21474839833 00000100:00100000:0.0:1746065107.936957:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259526144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065107.936963:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49d500/2, rc 0, transno 17179872575 00000100:00100000:0.0:1746065107.936965:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259527168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065107.936970:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc59f80/2, rc 0, transno 17179872576 00000100:00100000:0.0:1746065107.936973:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259527680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065107.937000:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259527808 00000100:00100000:0.0:1746065107.937003:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259527808 00000100:00100000:0.0:1746065107.937015:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9541 00000100:00100000:0.0:1746065107.937019:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881259527808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065107.937098:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3296:x1830881259527808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (113us total) trans 17179872577 rc 0/0 00000100:00100000:0.0:1746065107.937103:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9541 00000100:00100000:0.0:1746065107.937157:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259525888 00000100:00100000:0.0:1746065107.937159:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259525888 00000100:00100000:0.0:1746065107.937170:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259526400 00000100:00100000:0.0:1746065107.937171:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259526400 00000100:00100000:0.0:1746065107.937179:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9542 00000100:00100000:0.0:1746065107.937182:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3297:x1830881259525888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065107.937257:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3297:x1830881259525888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (111us total) trans 21474839834 rc 0/0 00000100:00100000:0.0:1746065107.937265:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9542 00000100:00100000:0.0:1746065107.937273:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259526912 00000100:00100000:0.0:1746065107.937275:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259526912 00000100:00100000:0.0:1746065107.937282:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259527424 00000100:00100000:0.0:1746065107.937284:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259527424 00000100:00100000:0.0:1746065107.937288:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259526016 00000100:00100000:0.0:1746065107.937289:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259526016 00000100:00100000:0.0:1746065107.937294:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259526528 00000100:00100000:0.0:1746065107.937295:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259526528 00000100:00100000:0.0:1746065107.937300:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259527040 00000100:00100000:0.0:1746065107.937302:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259527040 00000100:00100000:0.0:1746065107.937306:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259527552 00000100:00100000:0.0:1746065107.937308:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259527552 00000100:00100000:0.0:1746065107.937314:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9543 00000100:00100000:0.0:1746065107.937317:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881259526400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065107.937389:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065107.937391:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065107.937392:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065107.937394:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065107.937395:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065107.937408:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881259526400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (240us total) trans 21474839835 rc 0/0 00000100:00100000:0.0:1746065107.937412:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9543 00000100:00100000:0.0:1746065107.937420:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9545 00000100:00100000:0.0:1746065107.937423:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881259527424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065107.937494:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065107.937496:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065107.937498:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065107.937500:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065107.937501:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065107.937514:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881259527424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (307us total) trans 17179872579 rc 0/0 00000100:00100000:0.0:1746065107.937518:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9545 00000100:00100000:0.0:1746065107.937525:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9548 00000100:00100000:0.0:1746065107.937528:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881259527040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065107.937593:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881259527040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (317us total) trans 17179872580 rc 0/0 00000100:00100000:0.0:1746065107.937598:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9548 00000100:00100000:0.0:1746065107.940078:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260521088 00000100:00100000:0.0:1746065107.940085:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260521088 00000100:00100000:0.0:1746065107.940130:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8759 00000100:00100000:0.0:1746065107.940136:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28312:x1830881260521088:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065107.940152:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065107.940168:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d200/0x14b4f8542d4f0039 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5921f expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.940208:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d200/0x14b4f8542d4f0039 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5921f expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.940219:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb4d200/0x14b4f8542d4f0039 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5921f expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065107.940232:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065107.940234:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065107.940237:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4d200, rc 0) 00000100:00100000:0.0:1746065107.945560:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28312:x1830881260521088:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 5414us (5587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.945570:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8759 00000100:00100000:0.0:1746065107.950013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.954299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.956684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.971098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.976349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.976373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.976419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.976434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.976450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.976844:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065107.976857:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260522880 00000100:00100000:0.0:1746065107.976864:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260522880 00000100:00100000:0.0:1746065107.976879:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9552 00000100:00100000:0.0:1746065107.976884:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881260522496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065107.976891:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065107.976898:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb4ca00/0x14b4f8542d4f007f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5923b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065107.976911:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6d3, atime: 0x6812d6d3, ctime: 0x6812d6d3, blocks: 0x821 00010000:00010000:0.0:1746065107.976924:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.976925:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.976930:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb4ca00/0x14b4f8542d4f007f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5923b expref: 36 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.976940:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb4ca00/0x14b4f8542d4f007f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5923b expref: 35 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.976951:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4ca00, rc 0) 00000100:00100000:0.0:1746065107.977062:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881260522496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 177us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.977072:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9552 00000100:00100000:0.0:1746065107.977084:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9554 00000100:00100000:0.0:1746065107.977089:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881260523008:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065107.977095:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065107.977103:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb4de00/0x14b4f8542d4f009b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59257 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065107.977113:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6d4, atime: 0x6812d6d4, ctime: 0x6812d6d4, blocks: 0x102b 00010000:00010000:0.0:1746065107.977120:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.977121:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065107.977125:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb4de00/0x14b4f8542d4f009b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59257 expref: 35 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.977133:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb4de00/0x14b4f8542d4f009b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59257 expref: 35 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065107.977139:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb4de00, rc 0) 00000100:00100000:0.0:1746065107.977155:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881260523008:12345-192.168.202.46@tcp:101:cat.0 Request processed in 66us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065107.977161:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9554 00000100:00100000:0.0:1746065107.991621:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.001630:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260524032 00000100:00100000:0.0:1746065108.001636:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260524032 00000100:00100000:0.0:1746065108.001695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.001714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.008701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.009885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065108.011833:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013697bc00/0x14b4f8542d4f00b7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065108.011840:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013697bc00/0x14b4f8542d4f00b7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000040:00080000:0.0:1746065108.012913:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2384, 88 off199600 00000004:00080000:0.0:1746065108.012921:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707304104895ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065108.012957:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2340, 88 off195544 00000004:00080000:0.0:1746065108.012961:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707304145757ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065108.012987:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2341, 88 off195632 00000004:00080000:0.0:1746065108.012990:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707304174210ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065108.012997:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2385, 88 off199688 00000004:00080000:0.0:1746065108.012999:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707304183827ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065108.013005:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2386, 88 off199776 00000004:00080000:0.0:1746065108.013007:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707304191957ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065108.013013:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2342, 88 off195720 00000004:00080000:0.0:1746065108.013015:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707304200030ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065108.013021:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2343, 88 off195808 00000004:00080000:0.0:1746065108.013023:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707304207803ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065108.013029:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2344, 88 off195896 00000004:00080000:0.0:1746065108.013031:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707304215765ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065108.013037:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2387, 88 off199864 00000004:00080000:0.0:1746065108.013039:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707304223512ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065108.013045:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2345, 88 off195984 00000004:00080000:0.0:1746065108.013047:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707304231690ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065108.013053:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2388, 88 off199952 00000004:00080000:0.0:1746065108.013055:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707304239390ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065108.013061:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2346, 88 off196072 00000004:00080000:0.0:1746065108.013063:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707304247593ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065108.013069:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2389, 88 off200040 00000004:00080000:0.0:1746065108.013072:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707304257155ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065108.013078:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2390, 88 off200128 00000004:00080000:0.0:1746065108.013081:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707304265463ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065108.013086:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2391, 88 off200216 00000004:00080000:0.0:1746065108.013089:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707304273547ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065108.013094:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2392, 88 off200304 00000004:00080000:0.0:1746065108.013096:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707304281195ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065108.013103:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2347, 88 off196160 00000004:00080000:0.0:1746065108.013105:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707304289865ns, next at 666938887344ns, rc = 0 00000100:00100000:0.0:1746065108.041450:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260524928 00000100:00100000:0.0:1746065108.041458:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260524928 00000100:00100000:0.0:1746065108.041507:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8764 00000100:00100000:0.0:1746065108.041514:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:28324:x1830881260524928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.041530:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.041546:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4f00c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5926c expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.041629:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.041640:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.041648:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.041659:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.041664:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.041668:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.041755:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.041763:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.041768:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065108.041775:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065108.043263:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043273:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043278:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043284:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093883000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065108.043287:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043293:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043305:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065108.043308:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065108.043311:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 2/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043315:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093883000/0x14b4f8542d4f00da lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043326:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043331:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043334:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043338:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093882e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065108.043340:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043344:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043349:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065108.043351:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065108.043353:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043356:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093882e00/0x14b4f8542d4f00cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043364:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043368:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043372:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043375:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093883200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065108.043377:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043380:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043386:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093bfeb00) 00010000:00010000:0.0:1746065108.043388:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065108.043390:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043394:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093883200/0x14b4f8542d4f00d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065108.043431:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4f00c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5926c expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.043437:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093883800/0x14b4f8542d4f00c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5926c expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.043444:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093883800, rc 0) 00000100:00100000:0.0:1746065108.043507:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:28324:x1830881260524928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1993us (2227us total) trans 8589942755 rc 301/301 00000100:00100000:0.0:1746065108.043514:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8764 00000100:00100000:0.0:1746065108.053530:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259529984 00000100:00100000:0.0:1746065108.053534:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259529984 00000100:00100000:0.0:1746065108.053554:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9570 00000100:00100000:0.0:1746065108.053560:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881259530368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065108.053655:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881259530368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (237us total) trans 21474839843 rc 0/0 00000100:00100000:0.0:1746065108.053661:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9570 00000100:00100000:0.0:1746065108.053673:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9572 00000100:00100000:0.0:1746065108.053677:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881259529984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065108.053755:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065108.053758:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065108.053759:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065108.053761:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065108.053763:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:0.0:1746065108.053782:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881259529984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (300us total) trans 21474839845 rc 0/0 00000100:00100000:0.0:1746065108.053787:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9572 00000100:00100000:0.0:1746065108.054108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.055006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.057929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.058976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.064092:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.067267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.067305:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.070721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.070753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.070779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.070805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.070855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.070894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.070923:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260526336 00000100:00100000:0.0:1746065108.070931:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260526336 00000100:00100000:0.0:1746065108.070967:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260526464 00000100:00100000:0.0:1746065108.070971:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260526464 00000100:00100000:0.0:1746065108.070987:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260526592 00000100:00100000:0.0:1746065108.070991:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260526592 00000100:00100000:0.0:1746065108.071005:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260526720 00000100:00100000:0.0:1746065108.071007:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260526720 00000100:00100000:0.0:1746065108.071021:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260526848 00000100:00100000:0.0:1746065108.071024:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260526848 00000100:00100000:0.0:1746065108.071034:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260526976 00000100:00100000:0.0:1746065108.071036:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260526976 00000100:00100000:0.0:1746065108.071048:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9574 00000100:00100000:0.0:1746065108.071057:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881260526336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.071074:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.071091:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093882e00/0x14b4f8542d4f0120 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59288 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.071112:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071115:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071124:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093882e00/0x14b4f8542d4f0120 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59288 expref: 31 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071139:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093882e00/0x14b4f8542d4f0120 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59288 expref: 31 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071150:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093882e00, rc 0) 00000100:00100000:0.0:1746065108.071193:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881260526336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 136us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065108.071200:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9574 00000100:00100000:0.0:1746065108.071225:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9575 00000100:00100000:0.0:1746065108.071231:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260526464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.071240:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.071250:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093883000/0x14b4f8542d4f0127 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5928f expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.071262:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071264:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071269:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093883000/0x14b4f8542d4f0127 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5928f expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071279:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093883000/0x14b4f8542d4f0127 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5928f expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071286:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093883000, rc 0) 00000100:00100000:0.0:1746065108.071308:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260526464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 77us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065108.071313:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9575 00000100:00100000:0.0:1746065108.071329:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9576 00000100:00100000:0.0:1746065108.071335:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260526592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.071345:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.071353:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093883400/0x14b4f8542d4f012e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59296 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.071363:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071364:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071370:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093883400/0x14b4f8542d4f012e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59296 expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071379:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093883400/0x14b4f8542d4f012e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59296 expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071386:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093883400, rc 0) 00000100:00100000:0.0:1746065108.071408:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260526592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 72us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065108.071413:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9576 00000100:00100000:0.0:1746065108.071427:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9577 00000100:00100000:0.0:1746065108.071433:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881260526720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.071440:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.071448:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e8b400/0x14b4f8542d4f0135 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5929d expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.071459:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071460:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071477:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e8b400/0x14b4f8542d4f0135 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5929d expref: 31 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071485:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e8b400/0x14b4f8542d4f0135 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5929d expref: 31 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071492:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e8b400, rc 0) 00000100:00100000:0.0:1746065108.071506:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881260526720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 74us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065108.071510:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9577 00000100:00100000:0.0:1746065108.071520:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9578 00000100:00100000:0.0:1746065108.071524:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881260526848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.071528:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.071534:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e8be00/0x14b4f8542d4f013c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e592a4 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.071543:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071550:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e8be00/0x14b4f8542d4f013c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592a4 expref: 31 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071557:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e8be00/0x14b4f8542d4f013c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592a4 expref: 31 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071565:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e8be00, rc 0) 00000100:00100000:0.0:1746065108.071578:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881260526848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 54us (725us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065108.071582:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9578 00000100:00100000:0.0:1746065108.071592:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9579 00000100:00100000:0.0:1746065108.071595:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260526976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.071600:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.071605:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e8ba00/0x14b4f8542d4f0143 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e592ab expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.071613:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071614:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.071618:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e8ba00/0x14b4f8542d4f0143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592ab expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071624:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e8ba00/0x14b4f8542d4f0143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592ab expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.071630:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e8ba00, rc 0) 00000100:00100000:0.0:1746065108.071643:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260526976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 47us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065108.071647:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9579 00000100:00100000:0.0:1746065108.080936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.086118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.089215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.104257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.104288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.106914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.119072:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260529024 00000100:00100000:0.0:1746065108.119080:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260529024 00002000:00100000:0.0:1746065108.119115:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880095350000 x1830881260529024/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:24/0 lens 488/0 e 0 to 0 dl 1746065119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.119125:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350000 with x1830881260529024 ext(1048576->2097151) 00002000:00010000:0.0:1746065108.119130:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350000 00000100:00100000:0.0:1746065108.119165:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4255 00000100:00100000:0.0:1746065108.119172:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881260529024:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065108.149719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.155340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.157664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:0.0:1746065108.158481:0:4544:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065108 -> 1746065109 00002000:00010000:0.0:1746065108.158485:0:4544:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065108 -> 1746065109 00002000:00010000:0.0:1746065108.158486:0:4544:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065108 -> 1746065109 00000100:00100000:0.0:1746065108.158498:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259531008:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065108.158519:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5810800/0x14b4f8542d4f0151 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592b9 expref: 45 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.158527:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5810800/0x14b4f8542d4f0151 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592b9 expref: 45 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.158538:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5810800, rc 0) 00000100:00100000:0.0:1746065108.158556:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881260529280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3004us (3225us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065108.158561:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9581 00000100:00100000:0.0:1746065108.160633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.160841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.163173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.170885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.173146:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.182038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.182866:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.186161:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.201258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.202786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.208445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.214003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.214035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.214069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.234069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.237367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.240537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.245954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.257970:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.263251:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260534144 00000100:00100000:0.0:1746065108.263259:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260534144 00002000:00100000:0.0:1746065108.263295:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4636671) req@ffff88012e8b7800 x1830881260534144/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:24/0 lens 488/0 e 0 to 0 dl 1746065119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.263305:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7800 with x1830881260534144 ext(4194304->4636671) 00002000:00010000:0.0:1746065108.263311:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b7800 00000100:00100000:0.0:1746065108.263339:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4266 00000100:00100000:0.0:1746065108.263346:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+32:1958:x1830881260534144:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065108.324749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.328698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.357265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.375114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.375170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.377403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.380750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.382533:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260535296 00000100:00100000:0.0:1746065108.382538:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260535296 00000100:00100000:0.0:1746065108.382571:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9588 00000100:00100000:0.0:1746065108.382577:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260535296:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065108.382587:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.382596:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5810200/0x14b4f8542d4f01c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e592f8 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.382610:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.382612:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.382619:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5810200/0x14b4f8542d4f01c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592f8 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.382630:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5810200/0x14b4f8542d4f01c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592f8 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.382640:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5810200, rc 0) 00000100:00100000:0.0:1746065108.382672:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260535296:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 95us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065108.382678:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9588 00000100:00100000:0.0:1746065108.383239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.383339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.383571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.383913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.384195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.389036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.389253:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4697 00000100:00100000:0.0:1746065108.389261:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881260536192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065108.389274:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065108.389291:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013697a600/0x14b4f8542d4f0158 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592c0 expref: 45 pid: 4544 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065108.389300:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013697a600/0x14b4f8542d4f0158 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592c0 expref: 45 pid: 4544 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065108.389318:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013697a600/0x14b4f8542d4f0158 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592c0 expref: 45 pid: 4544 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065108.389342:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.389344:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.389350:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c02ac00/0x14b4f8542d4f01ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592f1 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.389357:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c02ac00/0x14b4f8542d4f01ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592f1 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.389380:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c02ac00/0x14b4f8542d4f01ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4399103) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592f1 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065108.389389:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259532544:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065108.389447:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065108.394094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.397327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.399278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.401417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.404042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.404056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.404077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.404287:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4699 00000100:00100000:0.0:1746065108.404292:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260537344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065108.404297:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065108.404300:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013697aa00/0x14b4f8542d4f01b3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592ea expref: 9 pid: 20754 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065108.404585:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013697aa00/0x14b4f8542d4f01b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592ea expref: 9 pid: 20754 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065108.404596:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013697aa00/0x14b4f8542d4f01b3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e592ea expref: 9 pid: 20754 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065108.404606:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065108.404608:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013697b400/0x14b4f8542d4f01f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065108.404613:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013697b400/0x14b4f8542d4f01f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065108.404616:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065108.404627:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260537344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 336us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065108.404631:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4699 00000100:00100000:0.0:1746065108.410779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.412131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.415915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.415945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.416004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.419960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.420007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.432779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.454411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.454591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.454621:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.454658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.454673:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260539776 00000100:00100000:0.0:1746065108.454676:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260539776 00002000:00100000:0.0:1746065108.454697:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88013026bb80 x1830881260539776/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:24/0 lens 488/0 e 0 to 0 dl 1746065119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.454705:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026bb80 with x1830881260539776 ext(3145728->4194303) 00002000:00010000:0.0:1746065108.454710:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013026bb80 00000100:00100000:0.0:1746065108.480590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.480913:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+32:1960:x1830881260539520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25542us (26508us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065108.480924:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4268 00002000:00100000:0.0:1746065108.480933:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88013026b800 x1830881260539520/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:24/0 lens 488/440 e 0 to 0 dl 1746065119 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.480941:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026b800 with x1830881260539520 ext(2097152->3145727) 00002000:00010000:0.0:1746065108.480945:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013026b800 00000100:00100000:0.0:1746065108.500267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.500330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.500366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.500397:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260540672 00000100:00100000:0.0:1746065108.500403:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260540672 00000100:00100000:0.0:1746065108.500432:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260540800 00000100:00100000:0.0:1746065108.500435:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260540800 00000100:00100000:0.0:1746065108.500449:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9596 00000100:00100000:0.0:1746065108.500454:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881260540672:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.500477:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.500492:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5811400/0x14b4f8542d4f0285 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5935a expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065108.500532:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f8cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259533568:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065108.500586:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065108.500603:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9597 00000100:00100000:0.0:1746065108.500608:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881260540800:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.500615:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.500623:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5810000/0x14b4f8542d4f028c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59361 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065108.500643:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259533696:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065108.500661:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065108.507812:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259533696:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065108.508639:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5810000/0x14b4f8542d4f028c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59361 expref: 37 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.509710:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5810000/0x14b4f8542d4f028c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59361 expref: 37 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.509746:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5810000, rc 0) 00000100:00100000:0.0:1746065108.529445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.529496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.563262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.569761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.570899:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.582029:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9601 00000100:00100000:0.0:1746065108.582036:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881260542336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.582043:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.582051:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5811e00/0x14b4f8542d4f02cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59384 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065108.582072:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f8cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259534336:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065108.582326:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065108.600010:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f8cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259534336:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065108.600027:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5811e00/0x14b4f8542d4f02cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59384 expref: 37 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.600037:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5811e00/0x14b4f8542d4f02cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59384 expref: 37 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.600047:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5811e00, rc 0) 00000100:00100000:0.0:1746065108.600065:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881260542336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 18031us (18479us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065108.600074:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9601 00000100:00100000:0.0:1746065108.602095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.609201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.623394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.629735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.647803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.649024:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260544000 00000100:00100000:0.0:1746065108.649033:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260544000 00000100:00100000:0.0:1746065108.653605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.664442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.671252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.674476:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.674510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.674545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.682062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.704555:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1961:x1830881260545280:12345-192.168.202.46@tcp:4:cat.0 Request processed in 21775us (22492us total) trans 17179872593 rc 0/0 00000100:00100000:0.0:1746065108.704567:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1345 00002000:00100000:0.0:1746065108.704577:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37d:0x0] (118784->860159) req@ffff88012f8cc380 x1830881260545280/t17179872593(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:24/0 lens 488/448 e 0 to 0 dl 1746065119 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.704586:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f8cc380 with x1830881260545280 ext(118784->860159) 00010000:00010000:0.0:1746065108.704595:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a400/0x14b4f8542d4f02b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 118784->860159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5936f expref: 47 pid: 21998 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746065108.704608:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a570a400/0x14b4f8542d4f02b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 118784->860159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5936f expref: 47 pid: 21998 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746065108.704619:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f8cc380 00000100:00100000:0.0:1746065108.707051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.712630:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260545792 00000100:00100000:0.0:1746065108.712637:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260545792 00002000:00100000:0.0:1746065108.712669:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37d:0x0] (241664->245759) req@ffff88012f3d0700 x1830881260545792/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:24/0 lens 488/0 e 0 to 0 dl 1746065119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.712677:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0700 with x1830881260545792 ext(241664->245759) 00002000:00010000:0.0:1746065108.712681:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d0700 00000100:00100000:0.0:1746065108.712710:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4280 00000100:00100000:0.0:1746065108.712717:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+33:1961:x1830881260545792:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065108.712869:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+33:1961:x1830881260545792:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 152us (629us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065108.712875:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4280 00002000:00100000:0.0:1746065108.712880:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37d:0x0] (241664->245759) req@ffff88012f3d0700 x1830881260545792/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:24/0 lens 488/4536 e 0 to 0 dl 1746065119 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.712886:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0700 with x1830881260545792 ext(241664->245759) 00002000:00010000:0.0:1746065108.712889:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d0700 00000100:00100000:0.0:1746065108.713014:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.713027:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260546048 00000100:00100000:0.0:1746065108.713030:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260546048 00002000:00100000:0.0:1746065108.713044:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4636671) req@ffff88012f8cd500 x1830881260546048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:24/0 lens 488/0 e 0 to 0 dl 1746065119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.713050:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f8cd500 with x1830881260546048 ext(4194304->4636671) 00002000:00010000:0.0:1746065108.713054:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f8cd500 00000100:00100000:0.0:1746065108.713064:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4281 00000100:00100000:0.0:1746065108.713068:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881260546048:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065108.721408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.722512:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.726401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.726474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.726947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.726968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.729284:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.733178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.733216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.735169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.735199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.737124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.737162:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.746036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.747737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.775544:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260549120 00000100:00100000:0.0:1746065108.775549:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260549120 00002000:00100000:0.0:1746065108.775565:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012e8b7480 x1830881260549120/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:24/0 lens 488/0 e 0 to 0 dl 1746065119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.775572:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7480 with x1830881260549120 ext(3145728->4194303) 00002000:00010000:0.0:1746065108.775574:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b7480 00000100:00100000:0.0:1746065108.775583:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260549504 00000100:00100000:0.0:1746065108.775584:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260549504 00002000:00100000:0.0:1746065108.775593:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012e8b4700 x1830881260549504/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:24/0 lens 488/0 e 0 to 0 dl 1746065119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.775599:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4700 with x1830881260549504 ext(3145728->4194303) 00002000:00010000:0.0:1746065108.775601:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b4700 00000100:00100000:0.0:1746065108.775607:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260549376 00000100:00100000:0.0:1746065108.775609:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260549376 00002000:00100000:0.0:1746065108.775615:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012e8b5500 x1830881260549376/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:24/0 lens 488/0 e 0 to 0 dl 1746065119 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065108.775619:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5500 with x1830881260549376 ext(2097152->3145727) 00002000:00010000:0.0:1746065108.775621:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b5500 00000100:00100000:0.0:1746065108.775628:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4286 00000100:00100000:0.0:1746065108.775632:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+35:1958:x1830881260549120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065108.805944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.855222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.860568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.860604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.860638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.860669:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260550400 00000100:00100000:0.0:1746065108.860674:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260550400 00010000:00010000:0.0:1746065108.860703:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c02b000/0x14b4f8542d4f0277 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59353 expref: 258 pid: 20754 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065108.860724:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260550272 00000100:00100000:0.0:1746065108.860727:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260550272 00010000:00010000:0.0:1746065108.860736:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013697a600/0x14b4f8542d4f02a8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59368 expref: 19 pid: 24350 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065108.860749:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4711 00000100:00100000:0.0:1746065108.860756:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1961:x1830881260550400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065108.860766:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065108.860771:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c02b000/0x14b4f8542d4f0277 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59353 expref: 258 pid: 20754 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065108.860779:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c02b000/0x14b4f8542d4f0277 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59353 expref: 258 pid: 20754 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065108.860796:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c02b000/0x14b4f8542d4f0277 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59353 expref: 258 pid: 20754 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065108.861623:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065108.862262:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec83600/0x14b4f8542d4f031f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065108.862270:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec83600/0x14b4f8542d4f031f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065108.862275:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065108.862671:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec83600/0x14b4f8542d4f031f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065108.862678:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec83600/0x14b4f8542d4f031f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065108.862694:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065108.863277:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec83800/0x14b4f8542d4f0318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593d1 expref: 259 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.863294:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec83600/0x14b4f8542d4f031f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593d1 expref: 257 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.863304:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065108.863307:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065108.863308:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec83600, rc 0) 00000100:00100000:0.0:1746065108.959681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.975885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.976872:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.976937:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.976962:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260551552 00000100:00100000:0.0:1746065108.976965:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260551552 00010000:00010000:0.0:1746065108.976982:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cf9e00/0x14b4f8542d4f030a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593c3 expref: 35 pid: 8427 timeout: 808 lvb_type: 1 00000100:00100000:0.0:1746065108.976999:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4714 00000100:00100000:0.0:1746065108.977004:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+35:1960:x1830881260551552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065108.977011:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065108.977028:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cf9e00/0x14b4f8542d4f030a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593c3 expref: 35 pid: 8427 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746065108.977037:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cf9e00/0x14b4f8542d4f030a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593c3 expref: 35 pid: 8427 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746065108.977053:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cf9e00/0x14b4f8542d4f030a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593c3 expref: 35 pid: 8427 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746065108.977065:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065108.977082:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+34:1960:x1830881260551552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065108.977087:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4714 00000100:00100000:0.0:1746065108.977160:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260551680 00000100:00100000:0.0:1746065108.977162:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260551680 00000100:00100000:0.0:1746065108.977175:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9615 00000100:00100000:0.0:1746065108.977180:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1958:x1830881260551680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065108.977187:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065108.977193:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f409e00/0x14b4f8542d4f037a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e593fb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.977202:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.977208:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f409e00/0x14b4f8542d4f037a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593fb expref: 49 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.977216:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f409e00/0x14b4f8542d4f037a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593fb expref: 49 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065108.977223:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f409e00, rc 0) 00000100:00100000:0.0:1746065108.977236:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1958:x1830881260551680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 57us (367us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065108.977241:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9615 00000100:00100000:0.0:1746065108.978845:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.980415:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.980429:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260551936 00000100:00100000:0.0:1746065108.980432:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260551936 00010000:00010000:0.0:1746065108.980448:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013697ba00/0x14b4f8542d4f02d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5938b expref: 46 pid: 8427 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065108.980505:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4715 00000100:00100000:0.0:1746065108.980511:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881260551936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065108.980518:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065108.980529:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013697ba00/0x14b4f8542d4f02d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5938b expref: 46 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065108.980540:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013697ba00/0x14b4f8542d4f02d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5938b expref: 46 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065108.980553:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013697ba00/0x14b4f8542d4f02d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5938b expref: 46 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065108.980561:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.980562:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065108.980567:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec83200/0x14b4f8542d4f0342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->2887679) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593e6 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.980573:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec83200/0x14b4f8542d4f0342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->2887679) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593e6 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.980591:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec83200/0x14b4f8542d4f0342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->2887679) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593e6 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065108.980601:0:7080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec83200/0x14b4f8542d4f0342 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->2887679) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e593e6 expref: 34 pid: 8427 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065108.980615:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcb8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259537280:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065108.980674:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065108.986767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.990003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.993111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065108.997364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.007280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.012164:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.012585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.015620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.019274:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260553600 00000100:00100000:0.0:1746065109.019281:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260553600 00002000:00100000:0.0:1746065109.019310:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009f720a80 x1830881260553600/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:25/0 lens 488/0 e 0 to 0 dl 1746065120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.019319:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f720a80 with x1830881260553600 ext(3145728->4194303) 00010000:00010000:0.0:1746065109.019327:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ec82200/0x14b4f8542d4f0381 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59402 expref: 40 pid: 21998 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.019338:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ec82200/0x14b4f8542d4f0381 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59402 expref: 40 pid: 21998 timeout: 808 lvb_type: 0 00002000:00010000:0.0:1746065109.019344:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f720a80 00000100:00100000:0.0:1746065109.019786:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1350 00000100:00100000:0.0:1746065109.019794:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+40:1959:x1830881260553600:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065109.040555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.040607:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.049900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.054789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065109.055431:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065109.056729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.059730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.062603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.069154:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.069286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.073245:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.090717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.092315:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260555904 00000100:00100000:0.0:1746065109.092318:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260555904 00010000:00010000:0.0:1746065109.092330:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cf9400/0x14b4f8542d4f038f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59410 expref: 50 pid: 21998 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065109.092345:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4722 00000100:00100000:0.0:1746065109.092349:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:1960:x1830881260555904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065109.092356:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065109.092366:0:7080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065109 -> 1746065110 00002000:00010000:0.0:1746065109.092369:0:7080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065109 -> 1746065110 00010000:00010000:0.0:1746065109.092372:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cf9400/0x14b4f8542d4f038f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59410 expref: 50 pid: 21998 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.092387:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cf9400/0x14b4f8542d4f038f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59410 expref: 50 pid: 21998 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.092399:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cf9400/0x14b4f8542d4f038f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59410 expref: 50 pid: 21998 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.092410:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.092412:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.092415:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350ff000/0x14b4f8542d4f0396 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59417 expref: 36 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.092421:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350ff000/0x14b4f8542d4f0396 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59417 expref: 36 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.092435:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801350ff000/0x14b4f8542d4f0396 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59417 expref: 36 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.092443:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5806d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259538816:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065109.092798:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.096725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.105315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.107220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.109020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.153740:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1959:x1830881260557824:12345-192.168.202.46@tcp:4:cat.0 Request processed in 18148us (18344us total) trans 21474839849 rc 0/0 00000100:00100000:0.0:1746065109.153749:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1355 00002000:00100000:0.0:1746065109.153757:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3633151) req@ffff88009a0c9850 x1830881260557824/t21474839849(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/448 e 0 to 0 dl 1746065120 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.153769:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0c9850 with x1830881260557824 ext(3145728->3633151) 00010000:00010000:0.0:1746065109.153776:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099cf9200/0x14b4f8542d4f03a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59425 expref: 40 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.153785:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099cf9200/0x14b4f8542d4f03a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59425 expref: 40 pid: 8427 timeout: 808 lvb_type: 0 00002000:00010000:0.0:1746065109.153791:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a0c9850 00000100:00100000:0.0:1746065109.159328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.159612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.159632:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260558336 00000100:00100000:0.0:1746065109.159637:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260558336 00010000:00010000:0.0:1746065109.159662:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099cf9200/0x14b4f8542d4f03a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59425 expref: 40 pid: 8427 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065109.159682:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260558208 00000100:00100000:0.0:1746065109.159684:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260558208 00010000:00010000:0.0:1746065109.159694:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cf8c00/0x14b4f8542d4f0388 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59409 expref: 49 pid: 8427 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065109.159707:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4723 00000100:00100000:0.0:1746065109.159713:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1958:x1830881260558336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065109.159724:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065109.159743:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099cf9200/0x14b4f8542d4f03a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59425 expref: 40 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.159757:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099cf9200/0x14b4f8542d4f03a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59425 expref: 40 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.159778:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cf9200/0x14b4f8542d4f03a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59425 expref: 40 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.159794:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.159796:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.159803:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350ff600/0x14b4f8542d4f03b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5943a expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.159812:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350ff600/0x14b4f8542d4f03b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5943a expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.159840:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.159841:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.159845:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350ff400/0x14b4f8542d4f03c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59441 expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.159850:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350ff400/0x14b4f8542d4f03c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59441 expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.159878:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801350ff400/0x14b4f8542d4f03c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59441 expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.159890:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259539328:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065109.159958:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801350ff600/0x14b4f8542d4f03b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5943a expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.159965:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259539456:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065109.159983:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.159998:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4724 00000100:00100000:0.0:1746065109.160003:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1960:x1830881260558208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065109.160010:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065109.160024:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cf8c00/0x14b4f8542d4f0388 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59409 expref: 49 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.160031:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cf8c00/0x14b4f8542d4f0388 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59409 expref: 49 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.160042:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cf8c00/0x14b4f8542d4f0388 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59409 expref: 49 pid: 8427 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.160050:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.160051:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.160054:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350ffc00/0x14b4f8542d4f03c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59448 expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.160061:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350ffc00/0x14b4f8542d4f03c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59448 expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.160079:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801350ffc00/0x14b4f8542d4f03c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59448 expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.160087:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259539584:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065109.160107:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.176011:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259539328:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065109.176062:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259539456:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065109.176078:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.176113:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881260558336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 16399us (16786us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.176122:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4723 00000100:00100000:0.0:1746065109.177105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.177191:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.177207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.177249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.177268:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260558592 00000100:00100000:0.0:1746065109.177274:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260558592 00002000:00100000:0.0:1746065109.177304:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009fb10a80 x1830881260558592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/0 e 0 to 0 dl 1746065120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.177312:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10a80 with x1830881260558592 ext(2097152->3145727) 00002000:00010000:0.0:1746065109.177317:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10a80 00000100:00100000:0.0:1746065109.177360:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260558720 00000100:00100000:0.0:1746065109.177364:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260558720 00002000:00100000:0.0:1746065109.177377:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009fb10700 x1830881260558720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/0 e 0 to 0 dl 1746065120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.177383:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881260558720 ext(3145728->4194303) 00002000:00010000:0.0:1746065109.177385:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10700 00000100:00100000:0.0:1746065109.177395:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260559360 00000100:00100000:0.0:1746065109.177396:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260559360 00002000:00100000:0.0:1746065109.177405:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x37d:0x0] (876544->880639) req@ffff88009fb11500 x1830881260559360/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:25/0 lens 488/0 e 0 to 0 dl 1746065120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.177411:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881260559360 ext(876544->880639) 00002000:00010000:0.0:1746065109.177414:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11500 00000100:00100000:0.0:1746065109.177421:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4298 00000100:00100000:0.0:1746065109.177425:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1958:x1830881260558720:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065109.177848:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259539584:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065109.177861:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.177878:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1960:x1830881260558208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 17875us (18266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.177888:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4724 00000100:00100000:0.0:1746065109.190652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.190973:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1958:x1830881260558720:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13546us (13781us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065109.190983:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4298 00002000:00100000:0.0:1746065109.190991:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009fb10700 x1830881260558720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/440 e 0 to 0 dl 1746065120 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.190999:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881260558720 ext(3145728->4194303) 00002000:00010000:0.0:1746065109.191003:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10700 00000100:00100000:0.0:1746065109.203931:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.204003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.208494:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260560000 00000100:00100000:0.0:1746065109.208498:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260560000 00000100:00100000:0.0:1746065109.208519:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9630 00000100:00100000:0.0:1746065109.208524:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881260560000:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065109.208532:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.208539:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094cba400/0x14b4f8542d4f03e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59464 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.208562:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259540096:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065109.210738:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.245251:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260561024 00000100:00100000:0.0:1746065109.245255:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260561024 00000100:00100000:0.0:1746065109.245288:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9632 00000100:00100000:0.0:1746065109.245294:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881260561024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065109.245311:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.245327:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4f03ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59472 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.245370:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259540352:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065109.245895:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.251415:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.251629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.252168:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9634 00000100:00100000:0.0:1746065109.252174:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1961:x1830881260561152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065109.252182:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.252190:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bddd400/0x14b4f8542d4f03ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59479 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.252215:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259540608:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065109.252625:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943050c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746065109.261748:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746065109.271605:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065109.274382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.274516:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.276576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.278477:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.281543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.281569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.281589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.281610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065109.281623:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065109.281882:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9636 00000100:00100000:0.0:1746065109.281889:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260562816:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065109.281896:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.281902:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bddcc00/0x14b4f8542d4f0429 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5949c expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.281912:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.281914:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.281921:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bddcc00/0x14b4f8542d4f0429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5949c expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.281932:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bddcc00/0x14b4f8542d4f0429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5949c expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.281945:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bddcc00, rc 0) 00000100:00100000:0.0:1746065109.281996:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260562816:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 108us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.282001:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9636 00000100:00080000:0.0:1746065109.282031:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065109.284854:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.287149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.288206:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260563328 00000100:00100000:0.0:1746065109.288211:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260563328 00010000:00010000:0.0:1746065109.288232:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7400/0x14b4f8542d4f041b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59487 expref: 11 pid: 24350 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065109.288253:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4728 00000100:00100000:0.0:1746065109.288259:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260563328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065109.288268:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065109.288273:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7400/0x14b4f8542d4f041b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59487 expref: 11 pid: 24350 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.288281:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7400/0x14b4f8542d4f041b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59487 expref: 11 pid: 24350 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.288298:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7400/0x14b4f8542d4f041b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59487 expref: 11 pid: 24350 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.288310:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.288314:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.288321:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.288327:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.288339:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.288365:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260563328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.288370:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4728 00010000:00010000:0.0:1746065109.288477:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.288482:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065109.288495:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065109.288603:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a6c00/0x14b4f8542d4f043e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594aa expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.288613:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594aa expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.288618:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.288620:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065109.288622:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c0a7200, rc 0) 00000100:00100000:0.0:1746065109.288644:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28372:x1830881260563200:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3678us (3792us total) trans 8589942779 rc 0/0 00000100:00100000:0.0:1746065109.288650:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8780 00000100:00100000:0.0:1746065109.292726:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260563456 00000100:00100000:0.0:1746065109.292734:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260563456 00000100:00100000:0.0:1746065109.292770:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8781 00000100:00100000:0.0:1746065109.292777:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28372:x1830881260563456:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065109.292795:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.292811:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd000/0x14b4f8542d4f0453 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e594b1 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.292892:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.292904:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594aa expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.292911:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.292935:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594aa expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.292948:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594aa expref: 11 pid: 24350 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065109.293274:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259541376:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065109.295558:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.301868:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259541376:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065109.301889:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065109.301909:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260563584 00000100:00100000:0.0:1746065109.301914:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260563584 00010000:00010000:0.0:1746065109.301937:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594aa expref: 12 pid: 24350 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746065109.301956:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4729 00000100:00100000:0.0:1746065109.301963:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260563584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065109.301973:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065109.301978:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594aa expref: 12 pid: 24350 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.301986:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594aa expref: 12 pid: 24350 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.302002:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0a7200/0x14b4f8542d4f0445 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594aa expref: 12 pid: 24350 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.302012:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.302016:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.302024:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.302029:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.302039:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.302074:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260563584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 112us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.302080:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4729 00010000:00010000:0.0:1746065109.302140:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.302146:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065109.302396:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00000004:00200000:0.0:1746065109.302401:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065109.302526:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.302554:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd000/0x14b4f8542d4f0453 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594b1 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.302565:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc800/0x14b4f8542d4f045a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594b1 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.302570:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.302572:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065109.302574:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bddc800, rc 0) 00000100:00100000:0.0:1746065109.302594:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28372:x1830881260563456:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 9819us (10036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.302600:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8781 00000100:00100000:0.0:1746065109.305840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.305874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.305890:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260563840 00000100:00100000:0.0:1746065109.305893:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260563840 00000100:00100000:0.0:1746065109.305920:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9640 00000100:00100000:0.0:1746065109.305926:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260563840:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065109.305937:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.305950:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093815400/0x14b4f8542d4f0468 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e594bf expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.305992:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259541632:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065109.306042:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.306122:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304b4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.308420:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259541632:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065109.308443:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093815400/0x14b4f8542d4f0468 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594bf expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.308462:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093815400/0x14b4f8542d4f0468 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594bf expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.308471:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093815400, rc 0) 00000100:00100000:0.0:1746065109.308501:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260563840:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2576us (2627us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065109.308506:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9640 00000100:00100000:0.0:1746065109.308542:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f720e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259541504:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065109.308552:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01b4c00/0x14b4f8542d4f0461 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594b8 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.308558:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01b4c00/0x14b4f8542d4f0461 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594b8 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.308562:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01b4c00, rc 0) 00000100:00100000:0.0:1746065109.308570:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260563712:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2654us (2739us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065109.308574:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9639 00000100:00100000:0.0:1746065109.312222:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260564096 00000100:00100000:0.0:1746065109.312230:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260564096 00000100:00100000:0.0:1746065109.312263:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8782 00000100:00100000:0.0:1746065109.312269:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28372:x1830881260564096:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065109.312285:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.312299:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddca00/0x14b4f8542d4f046f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e594c6 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.312365:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd200/0x14b4f8542d4f0476 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.312376:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd200/0x14b4f8542d4f0476 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065109.312385:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd200/0x14b4f8542d4f0476 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065109.312394:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00010000:00010000:0.0:1746065109.312479:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddca00/0x14b4f8542d4f046f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594c6 expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.312493:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd200/0x14b4f8542d4f0476 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594c6 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.312500:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.312503:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065109.312506:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bddd200, rc 0) 00000100:00100000:0.0:1746065109.312543:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28372:x1830881260564096:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 274us (352us total) trans 8589942780 rc 0/0 00000100:00100000:0.0:1746065109.312549:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8782 00000100:00100000:0.0:1746065109.315700:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260564224 00000100:00100000:0.0:1746065109.315709:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260564224 00000100:00100000:0.0:1746065109.327574:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4741 00000100:00100000:0.0:1746065109.327664:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881260566656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065109.327672:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065109.327682:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350ff400/0x14b4f8542d4f03c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59441 expref: 15 pid: 21998 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.327690:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350ff400/0x14b4f8542d4f03c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59441 expref: 15 pid: 21998 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746065109.327699:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.327700:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.327703:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f230000/0x14b4f8542d4f04a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.327709:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f230000/0x14b4f8542d4f04a7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.327719:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.327729:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881260566656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.327734:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4741 00010000:00010000:0.0:1746065109.338886:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a01b5e00/0x14b4f8542d4f0484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.338900:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01b5e00/0x14b4f8542d4f0484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.338912:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a01b5e00/0x14b4f8542d4f0484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.338917:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01b5e00/0x14b4f8542d4f0484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.338926:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a01b5e00/0x14b4f8542d4f0484 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.338931:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01b5e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065109.338933:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a01b5e00/0x14b4f8542d4f0484 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.338938:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a01b5e00/0x14b4f8542d4f0484 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.338946:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a01b5e00/0x14b4f8542d4f0484 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.338950:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01b5e00/0x14b4f8542d4f0484 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.338987:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260564224:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 23086us (23489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.338993:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9641 00000100:00100000:0.0:1746065109.341637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000040:00080000:0.0:1746065109.346719:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2393, 88 off200392 00000004:00080000:0.0:1746065109.346726:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708637910718ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.346770:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2348, 88 off196248 00000004:00080000:0.0:1746065109.346774:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708637958638ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.346805:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2349, 88 off196336 00000004:00080000:0.0:1746065109.346808:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708637992798ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.346832:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2394, 88 off200480 00000004:00080000:0.0:1746065109.346835:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708638019400ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.346841:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2395, 88 off200568 00000004:00080000:0.0:1746065109.346843:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708638028106ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.346849:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2350, 88 off196424 00000004:00080000:0.0:1746065109.346851:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708638036200ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.346857:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2351, 88 off196512 00000004:00080000:0.0:1746065109.346859:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708638043505ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.346883:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2353, 88 off196696 00000004:00080000:0.0:1746065109.346885:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708638069841ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.346892:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2396, 88 off200656 00000004:00080000:0.0:1746065109.346894:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708638078655ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.346926:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2354, 88 off196784 00000004:00080000:0.0:1746065109.346929:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708638113656ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.346939:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2397, 88 off200744 00000004:00080000:0.0:1746065109.346942:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708638126275ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.346949:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2355, 88 off196872 00000004:00080000:0.0:1746065109.346951:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708638136208ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.346957:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2398, 88 off200832 00000004:00080000:0.0:1746065109.346960:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708638144421ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.346965:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2399, 88 off200920 00000004:00080000:0.0:1746065109.346968:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708638152618ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.347059:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2400, 88 off201008 00000004:00080000:0.0:1746065109.347063:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708638247365ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.347071:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2401, 88 off201096 00000004:00080000:0.0:1746065109.347073:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708638257229ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.347080:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2356, 88 off196960 00000004:00080000:0.0:1746065109.347082:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708638266800ns, next at 666938887344ns, rc = 0 00000004:00010000:0.0:1746065109.360119:0:20754:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fb11880 reply state ffff880094237400 transno 8589942781 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942dc600/0x14b4f8542d4f04ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065109.360128:0:20754:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746065109.360212:0:20754:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065109.360302:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28372:x1830881260567168:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 18544us (18664us total) trans 8589942781 rc 0/0 00000100:00100000:0.0:1746065109.360309:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8783 00000100:00100000:0.0:1746065109.360741:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259545216 00000100:00100000:0.0:1746065109.360745:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259545216 00000100:00100000:0.0:1746065109.360759:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9649 00000100:00100000:0.0:1746065109.360763:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881259544704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065109.360800:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9651 00000100:00100000:0.0:1746065109.360805:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3296:x1830881259545344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065109.360920:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3296:x1830881259545344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (213us total) trans 21474839851 rc 0/0 00000100:00100000:0.0:1746065109.360924:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9651 00000100:00100000:0.0:1746065109.360944:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839845 gen 2 00000004:00080000:0.0:1746065109.360947:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095356300, transno 21474839796 00000004:00080000:0.0:1746065109.360950:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095354000, transno 21474839797 00000004:00080000:0.0:1746065109.360951:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c127480, transno 21474839798 00000004:00080000:0.0:1746065109.360953:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380df80, transno 21474839799 00000004:00080000:0.0:1746065109.360954:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f723b80, transno 21474839800 00000004:00080000:0.0:1746065109.360955:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f721880, transno 21474839801 00000004:00080000:0.0:1746065109.360957:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095355500, transno 21474839802 00000004:00080000:0.0:1746065109.360958:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f723100, transno 21474839803 00000004:00080000:0.0:1746065109.360959:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3df80, transno 21474839807 00000004:00080000:0.0:1746065109.360960:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d97100, transno 21474839808 00000004:00080000:0.0:1746065109.360961:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d95880, transno 21474839809 00000004:00080000:0.0:1746065109.360962:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d97800, transno 21474839810 00000004:00080000:0.0:1746065109.360964:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3d180, transno 21474839811 00000004:00080000:0.0:1746065109.360965:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d94e00, transno 21474839812 00000004:00080000:0.0:1746065109.360966:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d96a00, transno 21474839813 00000004:00080000:0.0:1746065109.360967:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d96d80, transno 21474839814 00000004:00080000:0.0:1746065109.360968:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7ac000, transno 21474839815 00000004:00080000:0.0:1746065109.360970:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdf800, transno 21474839816 00000004:00080000:0.0:1746065109.360971:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7aea00, transno 21474839817 00000004:00080000:0.0:1746065109.360972:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3ed80, transno 21474839818 00000004:00080000:0.0:1746065109.360973:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7adf80, transno 21474839819 00000004:00080000:0.0:1746065109.360974:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3c700, transno 21474839820 00000004:00080000:0.0:1746065109.360975:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7ace00, transno 21474839821 00000004:00080000:0.0:1746065109.360976:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7aed80, transno 21474839822 00000004:00080000:0.0:1746065109.360978:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135006300, transno 21474839830 00000004:00080000:0.0:1746065109.360979:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135006680, transno 21474839831 00000004:00080000:0.0:1746065109.360980:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd72680, transno 21474839832 00000004:00080000:0.0:1746065109.360981:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135004700, transno 21474839833 00000004:00080000:0.0:1746065109.360983:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd70e00, transno 21474839834 00000004:00080000:0.0:1746065109.360984:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135005c00, transno 21474839835 00000004:00080000:0.0:1746065109.360986:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095355880, transno 21474839836 00000004:00080000:0.0:1746065109.360987:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135004000, transno 21474839837 00000004:00080000:0.0:1746065109.360988:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880e00, transno 21474839838 00000004:00080000:0.0:1746065109.360989:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f14df80, transno 21474839839 00000004:00080000:0.0:1746065109.360990:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5882a00, transno 21474839840 00000004:00080000:0.0:1746065109.360992:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009009d500, transno 21474839841 00000004:00080000:0.0:1746065109.360993:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5881180, transno 21474839842 00000004:00080000:0.0:1746065109.360994:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009009fb80, transno 21474839843 00000004:00080000:0.0:1746065109.360995:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5881500, transno 21474839844 00000004:00080000:0.0:1746065109.360996:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5883100, transno 21474839845 00000100:00100000:0.0:1746065109.360998:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012f3d2d80 x1830881259545344/t21474839851(21474839851) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065125 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746065109.361004:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d2d80/2, rc 0, transno 21474839851 00000100:00100000:0.0:1746065109.361006:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259545344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065109.361070:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3295:x1830881259544704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 306us (430us total) trans 21474839854 rc 0/0 00000100:00100000:0.0:1746065109.361075:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9649 00000100:00100000:0.0:1746065109.361082:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259544064 00000100:00100000:0.0:1746065109.361085:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259544064 00000100:00100000:0.0:1746065109.361163:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259544576 00000100:00100000:0.0:1746065109.361166:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259544576 00000100:00100000:0.0:1746065109.361177:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9654 00000100:00100000:0.0:1746065109.361179:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881259545088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065109.361244:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065109.361246:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065109.361248:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065109.361250:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065109.361251:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065109.361270:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881259545088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (170us total) trans 21474839855 rc 0/0 00000100:00100000:0.0:1746065109.361274:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9654 00000100:00100000:0.0:1746065109.361284:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9655 00000100:00100000:0.0:1746065109.361289:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1830881259544448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.361360:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3298:x1830881259544448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (238us total) trans 17179872600 rc 0/0 00000100:00100000:0.0:1746065109.361365:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9655 00000100:00100000:0.0:1746065109.361373:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9657 00000100:00100000:0.0:1746065109.361377:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881259544576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065109.361473:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881259544576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (388us total) trans 21474839857 rc 0/0 00000100:00100000:0.0:1746065109.361478:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9657 00000004:00080000:0.0:1746065109.361765:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 40 done 00010000:00010000:0.0:1746065109.361847:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942dc600/0x14b4f8542d4f04ae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065109.361853:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942dc600/0x14b4f8542d4f04ae lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065109.361857:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942dc600/0x14b4f8542d4f04ae lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065109.361860:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942dc600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065109.361863:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942dc600/0x14b4f8542d4f04ae lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065109.361869:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942dc600/0x14b4f8542d4f04ae lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065109.361879:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.361881:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065109.361883:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942dc600/0x14b4f8542d4f04ae lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065109.361886:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942dc600/0x14b4f8542d4f04ae lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065109.361981:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260567808 00000100:00100000:0.0:1746065109.361983:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260567808 00000100:00100000:0.0:1746065109.362004:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8784 00000100:00100000:0.0:1746065109.362007:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28372:x1830881260567808:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065109.362017:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.362025:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c200/0x14b4f8542d4f04b5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e594cd expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.362051:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c200/0x14b4f8542d4f04b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594cd expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.362058:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c200/0x14b4f8542d4f04b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594cd expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.362066:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.362067:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065109.362069:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0c200, rc 0) 00000100:00100000:0.0:1746065109.362087:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28372:x1830881260567808:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 79us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.362093:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8784 00000100:00100000:0.0:1746065109.362106:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259545472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.362125:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065109.362138:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259545984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.362153:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065109.362172:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259546112 00000100:00100000:0.0:1746065109.362174:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259546112 00000100:00100000:0.0:1746065109.362187:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9659 00000100:00100000:0.0:1746065109.362190:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881259545600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065109.362255:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065109.362257:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065109.362259:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065109.362260:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065109.362262:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065109.362281:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881259545600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (167us total) trans 17179872602 rc 0/0 00000100:00100000:0.0:1746065109.362285:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9659 00000100:00100000:0.0:1746065109.362293:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9663 00000100:00100000:0.0:1746065109.362298:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881259545856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.362388:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3295:x1830881259545856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (149us total) trans 17179872605 rc 0/0 00000100:00100000:0.0:1746065109.362392:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9663 00000004:00080000:0.0:1746065109.362411:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130268a80/2, rc 0, transno 17179872603 00000100:00100000:0.0:1746065109.362414:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259545472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065109.362421:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013026b100/2, rc 0, transno 17179872604 00000100:00100000:0.0:1746065109.362424:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259545984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065109.362438:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130268380/2, rc 0, transno 17179872602 00000100:00100000:0.0:1746065109.362440:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259545600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065109.362446:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013026aa00/2, rc 0, transno 17179872606 00000100:00100000:0.0:1746065109.362448:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259546112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.364309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.367130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.368165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.368535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.368560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.368580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.368599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.368625:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260568192 00000100:00100000:0.0:1746065109.368628:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260568192 00000100:00100000:0.0:1746065109.368645:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260568448 00000100:00100000:0.0:1746065109.368647:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260568448 00000100:00100000:0.0:1746065109.368657:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260568704 00000100:00100000:0.0:1746065109.368658:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260568704 00000100:00100000:0.0:1746065109.368668:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9667 00000100:00100000:0.0:1746065109.368673:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260568192:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065109.368680:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.368688:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c870c00/0x14b4f8542d4f04df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e594e2 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065109.368700:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6d6, atime: 0x6812d6d5, ctime: 0x6812d6d6, blocks: 0x821 00010000:00010000:0.0:1746065109.368708:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.368710:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.368715:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870c00/0x14b4f8542d4f04df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594e2 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.368724:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c870c00/0x14b4f8542d4f04df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594e2 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.368731:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c870c00, rc 0) 00000100:00100000:0.0:1746065109.368748:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260568192:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.368753:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9667 00000100:00100000:0.0:1746065109.368773:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9669 00000100:00100000:0.0:1746065109.368778:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260568704:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065109.368784:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.368790:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f04ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e594fe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065109.369246:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6d6, atime: 0x6812d6d6, ctime: 0x6812d6d6, blocks: 0x1029 00010000:00010000:0.0:1746065109.369254:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.369256:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.369260:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f04ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594fe expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.369269:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f04ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594fe expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.369275:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c870a00, rc 0) 00000100:00100000:0.0:1746065109.369292:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260568704:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 515us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.369298:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9669 00000100:00100000:0.0:1746065109.374554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.374605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.381103:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4308 00000100:00100000:0.0:1746065109.381113:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260570112:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065109.381130:0:8434:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.381137:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.381138:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.381140:0:8434:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.381148:0:8434:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.390179:0:8433:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013697ae00/0x14b4f8542d4f04fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.391030:0:8433:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013697ae00/0x14b4f8542d4f04fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.391045:0:8433:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013697ae00/0x14b4f8542d4f04fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.391052:0:8433:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013697ae00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065109.391055:0:8433:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013697ae00/0x14b4f8542d4f04fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.391063:0:8433:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013697ae00/0x14b4f8542d4f04fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.391080:0:8433:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013697ae00/0x14b4f8542d4f04fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.391086:0:8433:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013697ae00/0x14b4f8542d4f04fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.391134:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260569216:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 16408us (16525us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065109.391142:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4305 00010000:00010000:0.0:1746065109.393600:0:8434:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.393613:0:8434:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.393619:0:8434:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.393625:0:8434:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094758400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065109.393629:0:8434:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.393636:0:8434:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.393655:0:8434:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.393660:0:8434:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094758400/0x14b4f8542d4f0510 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.393710:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260570112:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 12596us (13010us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065109.393720:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4308 00000100:00100000:0.0:1746065109.408344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.410647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.410833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.410852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.410880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.410894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.410923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.414020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.416042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065109.416423:0:14646:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14646 initiator: MDT0 00010000:00010000:0.0:1746065109.416430:0:14646:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14646 initiator: MDT0 00000040:00080000:0.0:1746065109.417065:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2402, 88 off201184 00000004:00080000:0.0:1746065109.417071:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708708255104ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.417255:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2357, 88 off197048 00000004:00080000:0.0:1746065109.417265:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708708449130ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.417291:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2358, 88 off197136 00000004:00080000:0.0:1746065109.417293:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708708478238ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.417301:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2403, 88 off201272 00000004:00080000:0.0:1746065109.417303:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708708488294ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.417311:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2404, 88 off201360 00000004:00080000:0.0:1746065109.417313:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708708497667ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.417318:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2359, 88 off197224 00000004:00080000:0.0:1746065109.417320:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708708505229ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.417326:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2360, 88 off197312 00000004:00080000:0.0:1746065109.417328:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708708513065ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.417340:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2361, 88 off197400 00000004:00080000:0.0:1746065109.417342:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708708526748ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.417349:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2405, 88 off201448 00000004:00080000:0.0:1746065109.417351:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708708535779ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.417357:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2362, 88 off197488 00000004:00080000:0.0:1746065109.417359:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708708543364ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.417364:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2406, 88 off201536 00000004:00080000:0.0:1746065109.417366:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708708551118ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.417372:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2363, 88 off197576 00000004:00080000:0.0:1746065109.417375:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708708559465ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065109.417380:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2407, 88 off201624 00000004:00080000:0.0:1746065109.417382:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708708567090ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.417388:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2408, 88 off201712 00000004:00080000:0.0:1746065109.417390:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708708574704ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.417396:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2409, 88 off201800 00000004:00080000:0.0:1746065109.417398:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708708582874ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.417404:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2410, 88 off201888 00000004:00080000:0.0:1746065109.417406:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708708591214ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065109.417412:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2364, 88 off197664 00000004:00080000:0.0:1746065109.417414:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708708599097ns, next at 666938887344ns, rc = 0 00000004:00010000:0.0:1746065109.441094:0:14646:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094ff6a00 reply state ffff880099c29400 transno 8589942783 ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14646 initiator: MDT0 00000100:00100000:0.0:1746065109.441106:0:14646:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065109.441115:0:14646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.441118:0:14646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065109.441125:0:14646:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd200/0x14b4f8542d4f0476 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594c6 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746065109.441206:0:14646:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065109.441215:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28372:x1830881260572032:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 27021us (27199us total) trans 8589942783 rc 0/0 00000100:00100000:0.0:1746065109.441224:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3525 00000100:00100000:0.0:1746065109.441251:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259546624:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746065109.441342:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14646 initiator: MDT0 00010000:00010000:0.0:1746065109.441349:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14646 initiator: MDT0 00010000:00010000:0.0:1746065109.441356:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14646 initiator: MDT0 00010000:00010000:0.0:1746065109.441361:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800953d3000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065109.441365:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14646 initiator: MDT0 00010000:00010000:0.0:1746065109.441374:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14646 initiator: MDT0 00010000:00010000:0.0:1746065109.441385:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.441387:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065109.441390:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14646 initiator: MDT0 00010000:00010000:0.0:1746065109.441394:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f0533 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14646 initiator: MDT0 00000004:00080000:0.0:1746065109.441516:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047800/2, rc 0, transno 17179872610 00000100:00100000:0.0:1746065109.441524:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259546496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065109.441558:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fcbb100/2, rc 0, transno 21474839863 00000100:00100000:0.0:1746065109.441562:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fcbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259547008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065109.441565:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065109.441570:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259548416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.441587:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065109.442889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.442906:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260572288 00000100:00100000:0.0:1746065109.442909:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260572288 00000100:00100000:0.0:1746065109.442930:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8787 00000100:00100000:0.0:1746065109.442934:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:28372:x1830881260572288:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065109.442946:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.442956:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0400/0x14b4f8542d4f053a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59505 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.442989:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0400/0x14b4f8542d4f053a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59505 expref: 7 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.442998:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0400/0x14b4f8542d4f053a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59505 expref: 7 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.443010:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065109.443012:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065109.443014:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b0400, rc 0) 00000100:00100000:0.0:1746065109.443034:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28372:x1830881260572288:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.443038:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8787 00000004:00080000:0.0:1746065109.443092:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff7100/2, rc 0, transno 17179872614 00000100:00100000:0.0:1746065109.443096:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259548416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065109.443102:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046300/2, rc 0, transno 17179872613 00000100:00100000:0.0:1746065109.443104:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259547904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065109.443110:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f044000/2, rc 0, transno 17179872612 00000100:00100000:0.0:1746065109.443112:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259547520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065109.443150:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f045f80/2, rc 0, transno 17179872615 00000100:00100000:0.0:1746065109.443152:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259548032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.443537:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259548160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (200us total) trans 17179872617 rc 0/0 00000100:00100000:0.0:1746065109.443544:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9692 00000004:00080000:0.0:1746065109.443565:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f044700/2, rc 0, transno 17179872617 00000100:00100000:0.0:1746065109.443568:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259548160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.445154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.467920:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.474148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.477471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.483163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.483246:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.483432:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9694 00000100:00100000:0.0:1746065109.483440:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+7:28383:x1830881260573568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065109.483448:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.483484:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1000/0x14b4f8542d4f05a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59528 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.483497:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.483498:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.483503:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1000/0x14b4f8542d4f05a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59528 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.483511:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1000/0x14b4f8542d4f05a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59528 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.483518:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b1000, rc 0) 00000100:00100000:0.0:1746065109.483542:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+8:28383:x1830881260573568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.483548:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9694 00000100:00100000:0.0:1746065109.497479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.501670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.520300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.523148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.529024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.537195:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.544584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.549662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.549742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.552708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.558157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.559106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.579850:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9703 00000100:00100000:0.0:1746065109.579860:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3297:x1830881259549184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.579891:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9704 00000100:00100000:0.0:1746065109.579895:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3297:x1830881259549696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065109.581155:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259550208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065109.581178:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065109.581189:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259550720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065109.581201:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065109.581209:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065109.581213:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259550336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065109.581224:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065109.581230:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259550848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065109.581240:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746065109.582224:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065109.582226:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065109.582228:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065109.582229:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065109.582231:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065109.582253:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3297:x1830881259549696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2357us (3922us total) trans 17179872624 rc 0/0 00000100:00100000:0.0:1746065109.582259:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9704 00000100:00100000:0.0:1746065109.582855:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fcba300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259548800:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065109.582862:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fcbb800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259548928:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065109.582906:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d4c00/0x14b4f8542d4f05b8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5953d expref: 250 pid: 24350 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065109.582920:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f05bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5953d expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.582947:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b917a00, rc 0) 00000100:00100000:0.0:1746065109.582983:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28379:x1830881260575104:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 38119us (38404us total) trans 8589942788 rc 0/0 00000100:00100000:0.0:1746065109.582988:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8791 00000100:00100000:0.0:1746065109.596950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.596997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.600837:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.600894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.600925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.600944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.605662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.607490:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260577664 00000100:00100000:0.0:1746065109.607494:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260577664 00002000:00100000:0.0:1746065109.607520:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1839104->1843199) req@ffff88009fcb7b80 x1830881260577664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/0 e 0 to 0 dl 1746065120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.607529:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcb7b80 with x1830881260577664 ext(1839104->1843199) 00002000:00010000:0.0:1746065109.607533:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fcb7b80 00000100:00100000:0.0:1746065109.607546:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4318 00000100:00100000:0.0:1746065109.607552:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881260577664:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065109.607673:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881260577664:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 121us (274us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065109.607679:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4318 00002000:00100000:0.0:1746065109.607684:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1839104->1843199) req@ffff88009fcb7b80 x1830881260577664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/4536 e 0 to 0 dl 1746065120 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.607691:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcb7b80 with x1830881260577664 ext(1839104->1843199) 00002000:00010000:0.0:1746065109.607694:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fcb7b80 00000100:00100000:0.0:1746065109.607721:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259551744:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065109.607730:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.607747:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260577280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6384us (6802us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.607753:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4753 00000100:00100000:0.0:1746065109.609715:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259551872:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065109.609725:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.609739:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260577408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3934us (4085us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.609745:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4754 00000100:00100000:0.0:1746065109.615024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.615069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.616243:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.616277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.620566:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259552000:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065109.620582:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800911e1a00/0x14b4f8542d4f05f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->2641919] (req 2097152->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5956e expref: 12 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.620590:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911e1a00, rc 0) 00000100:00100000:0.0:1746065109.620621:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+12:28380:x1830881260578048:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5276us (5603us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.620626:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9718 00000100:00100000:0.0:1746065109.621615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.621644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.621670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.621704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.621716:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260578944 00000100:00100000:0.0:1746065109.621718:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260578944 00010000:00010000:0.0:1746065109.621729:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e46a00/0x14b4f8542d4f04d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594e9 expref: 11 pid: 8851 timeout: 808 lvb_type: 1 00000100:00100000:0.0:1746065109.621742:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4755 00000100:00100000:0.0:1746065109.621747:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801332f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260578688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065109.621757:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065109.621775:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c39fa00/0x14b4f8542d4f04d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594f7 expref: 10 pid: 8851 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746065109.621783:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c39fa00/0x14b4f8542d4f04d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594f7 expref: 10 pid: 8851 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746065109.621799:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c39fa00/0x14b4f8542d4f04d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594f7 expref: 10 pid: 8851 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746065109.621813:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.621830:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.621839:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911e1a00/0x14b4f8542d4f05f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5956e expref: 11 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.621846:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800911e1a00/0x14b4f8542d4f05f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5956e expref: 11 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.621869:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800911e1a00/0x14b4f8542d4f05f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5956e expref: 11 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.621879:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801332f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259552640:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065109.621928:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.625159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.626596:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801332f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259552640:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065109.626611:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.626627:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260578688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4879us (5013us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.626633:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4755 00000100:00100000:0.0:1746065109.628674:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.631471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.634778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.634811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.634909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.635877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.645390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.649129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.654014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.654602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.654994:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9723 00000100:00100000:0.0:1746065109.655001:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260581248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065109.655008:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.655017:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f0613 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59591 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.655027:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.655029:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.655036:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f0613 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59591 expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.655049:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f0613 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59591 expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.655062:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e8f800, rc 0) 00000100:00100000:0.0:1746065109.655081:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881260581248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 82us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.655087:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9723 00000100:00100000:0.0:1746065109.656910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.657173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.657219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.657644:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4327 00000100:00100000:0.0:1746065109.657651:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881260582016:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065109.676841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.690254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.695907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.705060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.705692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.708213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.708224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.722737:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881260583296:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15215us (17679us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065109.722745:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4329 00002000:00100000:0.0:1746065109.722752:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800a90ae680 x1830881260583296/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/440 e 0 to 0 dl 1746065120 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.722759:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ae680 with x1830881260583296 ext(3145728->4194303) 00002000:00010000:0.0:1746065109.722762:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ae680 00000100:00100000:0.0:1746065109.723659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.724960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.725051:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.725061:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260584192 00000100:00100000:0.0:1746065109.725063:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260584192 00000100:00100000:0.0:1746065109.725094:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9728 00000100:00100000:0.0:1746065109.725099:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881260584192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065109.725107:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.725115:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093f0ca00/0x14b4f8542d4f0636 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e595b4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.725125:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.725127:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065109.725133:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093f0ca00/0x14b4f8542d4f0636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e595b4 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.725145:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093f0ca00/0x14b4f8542d4f0636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e595b4 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065109.725154:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0ca00, rc 0) 00000100:00100000:0.0:1746065109.725170:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260584192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.725175:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9728 00000100:00100000:0.0:1746065109.734281:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.745097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.745131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.751905:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9731 00000100:00100000:0.0:1746065109.751913:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881260585344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065109.751922:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.751936:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f0da00/0x14b4f8542d4f064b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e595c9 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.751974:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259554048:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065109.752029:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065109.766892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.835784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.841464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.844354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.848120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.853369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.860589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.860626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.860647:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260586752 00000100:00100000:0.0:1746065109.860653:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260586752 00010000:00010000:0.0:1746065109.860686:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f04ed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594fe expref: 10 pid: 8428 timeout: 809 lvb_type: 1 00000100:00100000:0.0:1746065109.860709:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260586624 00000100:00100000:0.0:1746065109.860712:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260586624 00010000:00010000:0.0:1746065109.860721:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f0613 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59591 expref: 19 pid: 8851 timeout: 809 lvb_type: 1 00000100:00100000:0.0:1746065109.860750:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4763 00000100:00100000:0.0:1746065109.860757:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260586752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065109.860770:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065109.860788:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f04ed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594fe expref: 10 pid: 8428 timeout: 809 lvb_type: 1 00010000:00010000:0.0:1746065109.860797:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f04ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e594fe expref: 10 pid: 8428 timeout: 809 lvb_type: 1 00010000:00010000:0.0:1746065109.860837:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.860870:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260586752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 114us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.860875:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4763 00000100:00100000:0.0:1746065109.860939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.860950:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260586880 00000100:00100000:0.0:1746065109.860953:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260586880 00010000:00010000:0.0:1746065109.860962:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012edd9800/0x14b4f8542d4f0605 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59583 expref: 8 pid: 8429 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746065109.860981:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4765 00000100:00100000:0.0:1746065109.860985:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+8:1959:x1830881260586880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065109.860990:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065109.860996:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012edd9800/0x14b4f8542d4f0605 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59583 expref: 8 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065109.861004:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012edd9800/0x14b4f8542d4f0605 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59583 expref: 8 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065109.861014:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012edd9800/0x14b4f8542d4f0605 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59583 expref: 8 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065109.861174:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065109.861189:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+7:1959:x1830881260586880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 202us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065109.861194:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4765 00000100:00100000:0.0:1746065109.869328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.872081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.874908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.877124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.890883:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.890925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.890955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.891042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.891063:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260588160 00000100:00100000:0.0:1746065109.891066:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260588160 00002000:00100000:0.0:1746065109.891092:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8801332fa680 x1830881260588160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/0 e 0 to 0 dl 1746065120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.891101:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801332fa680 with x1830881260588160 ext(0->1048575) 00002000:00010000:0.0:1746065109.891105:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801332fa680 00000100:00100000:0.0:1746065109.891116:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260588416 00000100:00100000:0.0:1746065109.891118:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260588416 00002000:00100000:0.0:1746065109.891128:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1839103) req@ffff8801332fbb80 x1830881260588416/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/0 e 0 to 0 dl 1746065120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.891135:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801332fbb80 with x1830881260588416 ext(1048576->1839103) 00010000:00010000:0.0:1746065109.891140:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b8d5e00/0x14b4f8542d4f05e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59560 expref: 17 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065109.891151:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b8d5e00/0x14b4f8542d4f05e2 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59560 expref: 17 pid: 8427 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746065109.891157:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801332fbb80 00000100:00100000:0.0:1746065109.891166:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260588800 00000100:00100000:0.0:1746065109.891169:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260588800 00002000:00100000:0.0:1746065109.891178:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37a:0x0] (1445888->2097151) req@ffff8800a90ace00 x1830881260588800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:25/0 lens 488/0 e 0 to 0 dl 1746065120 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065109.891185:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ace00 with x1830881260588800 ext(1445888->2097151) 00002000:00010000:0.0:1746065109.891188:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ace00 00000100:00100000:0.0:1746065109.891197:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1360 00000100:00100000:0.0:1746065109.891202:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801332fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881260588416:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065109.901222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.909725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.911280:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.914183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.918386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.922391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.922633:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.932293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.936858:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.961760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.961795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.961854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.961881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.962054:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4341 00000100:00100000:0.0:1746065109.962062:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260591360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065109.962175:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4342 00000100:00100000:0.0:1746065109.962304:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260591616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065109.989688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.994287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065109.995276:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9739 00000100:00100000:0.0:1746065109.995282:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881260592256:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065109.995289:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065109.995297:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8c00/0x14b4f8542d4f06ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59616 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065109.995327:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259555968:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065109.995993:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065110.001235:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.001333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065110.002534:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065110.037855:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065110.044518:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065110.056173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.068201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.078373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.084421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.117521:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.117576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.123184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.125311:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.125500:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.132733:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.133056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.133081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.138365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.146926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.146966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.148312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.155098:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.155174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.155201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.156536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.169438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.169549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.173898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.173927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.180195:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259558272:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065110.180218:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f0771 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065110.181866:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065110.182512:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f0771 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182517:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f0771 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065110.182550:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8830528 00000004:00200000:0.0:1746065110.182554:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065110.182567:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f0771 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182575:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f0771 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182583:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec21400/0x14b4f8542d4f0763 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182588:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec21400/0x14b4f8542d4f0763 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182593:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec21400/0x14b4f8542d4f0763 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182601:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec21400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065110.182604:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec21400/0x14b4f8542d4f0763 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182611:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec21400/0x14b4f8542d4f0763 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182618:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065110.182621:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065110.182624:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec21400/0x14b4f8542d4f0763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182628:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec21400/0x14b4f8542d4f0763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182639:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20200/0x14b4f8542d4f076a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182644:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20200/0x14b4f8542d4f076a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182648:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20200/0x14b4f8542d4f076a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182652:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec20200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065110.182654:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20200/0x14b4f8542d4f076a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182658:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20200/0x14b4f8542d4f076a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182663:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a54e6600) 00010000:00010000:0.0:1746065110.182665:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065110.182668:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20200/0x14b4f8542d4f076a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182671:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20200/0x14b4f8542d4f076a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.182697:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20800/0x14b4f8542d4f075c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5966a expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.182707:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f0771 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5966a expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.182713:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065110.182715:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065110.182717:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec20000, rc 0) 00000100:00100000:0.0:1746065110.182739:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28409:x1830881260597632:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 8373us (8844us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.182745:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8799 00000100:00100000:0.0:1746065110.188791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.188808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.188860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.188873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.188885:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260598528 00000100:00100000:0.0:1746065110.188891:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260598528 00000100:00100000:0.0:1746065110.188914:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260598784 00000100:00100000:0.0:1746065110.188916:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260598784 00000100:00100000:0.0:1746065110.188941:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260599040 00000100:00100000:0.0:1746065110.188943:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260599040 00000100:00100000:0.0:1746065110.188952:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260598400 00000100:00100000:0.0:1746065110.188953:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260598400 00000100:00100000:0.0:1746065110.188963:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9749 00000100:00100000:0.0:1746065110.188969:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260598528:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065110.188981:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.190040:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecd9a00/0x14b4f8542d4f0778 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59678 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065110.190067:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d137100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259558656:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065110.190091:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065110.196165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.196583:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260599296 00000100:00100000:0.0:1746065110.196586:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260599296 00000100:00100000:0.0:1746065110.196612:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8800 00000100:00100000:0.0:1746065110.196618:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28409:x1830881260599296:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065110.196631:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.196644:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecd9200/0x14b4f8542d4f07a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5969b expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.196708:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecd9000/0x14b4f8542d4f07a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.196719:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f0771 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5966a expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.196724:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecd9000/0x14b4f8542d4f07a9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.196739:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f0771 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5966a expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.196838:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f0771 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5966a expref: 8 pid: 24350 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746065110.196848:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d136680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259559040:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065110.199167:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.202249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.204122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.204783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.204840:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.204855:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260600448 00000100:00100000:0.0:1746065110.204857:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260600448 00002000:00100000:0.0:1746065110.204875:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d135c00 x1830881260600448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.204881:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135c00 with x1830881260600448 ext(3145728->4194303) 00002000:00010000:0.0:1746065110.204884:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d135c00 00000100:00100000:0.0:1746065110.204894:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260600576 00000100:00100000:0.0:1746065110.204897:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260600576 00002000:00100000:0.0:1746065110.204908:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009fb16a00 x1830881260600576/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.204914:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb16a00 with x1830881260600576 ext(3145728->4194303) 00002000:00010000:0.0:1746065110.204916:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb16a00 00000100:00100000:0.0:1746065110.206041:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4355 00000100:00100000:0.0:1746065110.206053:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1959:x1830881260600576:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065110.218498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.218523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.218547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.218557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.218570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.218591:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.218870:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9755 00000100:00100000:0.0:1746065110.218878:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260600832:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065110.218913:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ec20600/0x14b4f8542d4f07d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.218927:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b18000/0x14b4f8542d4f0740 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5964e expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.218933:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065110.218935:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065110.218937:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec20600/0x14b4f8542d4f07d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.218958:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b18000/0x14b4f8542d4f0740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5964e expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.218968:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b18000/0x14b4f8542d4f0740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5964e expref: 15 pid: 8429 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746065110.218979:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259559168:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065110.219027:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065110.222094:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:1959:x1830881260600448:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 17164us (17307us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065110.222103:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4354 00002000:00100000:0.0:1746065110.222111:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d135c00 x1830881260600448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:26/0 lens 488/440 e 0 to 0 dl 1746065121 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.222119:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135c00 with x1830881260600448 ext(3145728->4194303) 00010000:00010000:0.0:1746065110.222126:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4f0755 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59663 expref: 14 pid: 25185 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.222134:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4f0755 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59663 expref: 14 pid: 25185 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746065110.222139:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d135c00 00000100:00100000:0.0:1746065110.233967:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260601600 00000100:00100000:0.0:1746065110.233972:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260601600 00002000:00100000:0.0:1746065110.234064:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (991232->1048575) req@ffff88009f044a80 x1830881260601600/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.234074:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044a80 with x1830881260601600 ext(991232->1048575) 00010000:00010000:0.0:1746065110.234084:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b18000/0x14b4f8542d4f0740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5964e expref: 16 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.234095:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b18000/0x14b4f8542d4f0740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5964e expref: 16 pid: 8429 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746065110.234101:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f044a80 00000100:00100000:0.0:1746065110.234121:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1368 00000100:00100000:0.0:1746065110.234127:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881260601600:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065110.234307:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260601856 00000100:00100000:0.0:1746065110.234310:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260601856 00010000:00010000:0.0:1746065110.234327:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f0701 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5962b expref: 14 pid: 8429 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746065110.234341:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4781 00000100:00100000:0.0:1746065110.234346:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260601856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065110.234353:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065110.234363:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f0701 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5962b expref: 14 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.234371:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f0701 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5962b expref: 14 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.234384:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.234386:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.234390:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d59a00/0x14b4f8542d4f07e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.234397:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d59a00/0x14b4f8542d4f07e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.234409:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065110.234429:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260601856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.234435:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4781 00000100:00100000:0.0:1746065110.234529:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259560192:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065110.234556:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259560320:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065110.234575:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065110.235096:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260600576:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 29044us (30255us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065110.235102:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4355 00002000:00100000:0.0:1746065110.235107:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009fb16a00 x1830881260600576/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:26/0 lens 488/440 e 0 to 0 dl 1746065121 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.235114:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb16a00 with x1830881260600576 ext(3145728->4194303) 00010000:00010000:0.0:1746065110.235119:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b53cee00/0x14b4f8542d4f0739 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59647 expref: 15 pid: 8428 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.235126:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b53cee00/0x14b4f8542d4f0739 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59647 expref: 15 pid: 8428 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746065110.235131:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb16a00 00010000:00010000:0.0:1746065110.235146:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.235151:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.235164:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.235169:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.235180:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.235184:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecd8400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065110.235187:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.235192:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.235200:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.235205:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecd8400/0x14b4f8542d4f07f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065110.235253:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260601216:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 15886us (16666us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.235258:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9759 00000100:00100000:0.0:1746065110.236066:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260601600:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 1939us (3948us total) trans 17179872631 rc 0/0 00000100:00100000:0.0:1746065110.236073:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1368 00002000:00100000:0.0:1746065110.236078:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (991232->1048575) req@ffff88009f044a80 x1830881260601600/t17179872631(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:26/0 lens 488/448 e 0 to 0 dl 1746065121 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.236084:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044a80 with x1830881260601600 ext(991232->1048575) 00010000:00010000:0.0:1746065110.236089:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b18000/0x14b4f8542d4f0740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5964e expref: 15 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.236097:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b18000/0x14b4f8542d4f0740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5964e expref: 15 pid: 8429 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746065110.236103:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f044a80 00000100:00100000:0.0:1746065110.240976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.242731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.244719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.246320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.246334:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260603648 00000100:00100000:0.0:1746065110.246337:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260603648 00010000:00010000:0.0:1746065110.246350:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f074e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5965c expref: 12 pid: 25185 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746065110.246365:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4788 00000100:00100000:0.0:1746065110.246369:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260603648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065110.246376:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065110.246385:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f074e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5965c expref: 12 pid: 25185 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.246392:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f074e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5965c expref: 12 pid: 25185 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.246404:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f074e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5965c expref: 12 pid: 25185 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.246424:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.246425:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.246428:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b530c400/0x14b4f8542d4f07e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246434:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b530c400/0x14b4f8542d4f07e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246459:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065110.246474:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881260603648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.246480:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4788 00010000:00010000:0.0:1746065110.246874:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4e00/0x14b4f8542d4f07ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246882:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4e00/0x14b4f8542d4f07ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246897:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4e00/0x14b4f8542d4f07ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246904:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4e00/0x14b4f8542d4f07ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246910:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4e00/0x14b4f8542d4f07ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246919:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b4e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065110.246922:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4e00/0x14b4f8542d4f07ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246929:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4e00/0x14b4f8542d4f07ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246938:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4e00/0x14b4f8542d4f07ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.246943:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4e00/0x14b4f8542d4f07ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065110.246982:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260601472:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 27566us (28389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.246989:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9760 00000100:00100000:0.0:1746065110.247779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.250214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.250579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.250594:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260604288 00000100:00100000:0.0:1746065110.250597:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260604288 00000100:00100000:0.0:1746065110.250617:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9763 00000100:00100000:0.0:1746065110.250621:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260604288:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065110.250628:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.250637:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944f2800/0x14b4f8542d4f083c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e596da expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065110.250649:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6d6, atime: 0x6812d6d6, ctime: 0x6812d6d6, blocks: 0x81f 00010000:00010000:0.0:1746065110.250657:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.250658:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.250662:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f2800/0x14b4f8542d4f083c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596da expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.250671:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944f2800/0x14b4f8542d4f083c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596da expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.250677:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f2800, rc 0) 00000100:00100000:0.0:1746065110.250691:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260604288:12345-192.168.202.46@tcp:101:cat.0 Request processed in 70us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.250696:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9763 00000100:00100000:0.0:1746065110.250784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.250795:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260604544 00000100:00100000:0.0:1746065110.250798:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260604544 00000100:00100000:0.0:1746065110.250811:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9764 00000100:00100000:0.0:1746065110.250835:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260604544:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065110.250841:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.250848:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c756000/0x14b4f8542d4f0843 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e596e8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065110.250858:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6d7, atime: 0x6812d6d6, ctime: 0x6812d6d7, blocks: 0x1029 00010000:00010000:0.0:1746065110.250865:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.250867:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.250871:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756000/0x14b4f8542d4f0843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596e8 expref: 22 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.250879:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c756000/0x14b4f8542d4f0843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596e8 expref: 22 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.250886:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756000, rc 0) 00000100:00100000:0.0:1746065110.250899:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260604544:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.250904:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9764 00000100:00100000:0.0:1746065110.253117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.253149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.253893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065110.255494:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4f07da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.255503:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4f07da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.255520:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4f07da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.255526:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4f07da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.255533:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4f07da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.255544:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c757400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065110.255546:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4f07da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.255552:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4f07da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.255562:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.255563:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.255567:0:4545:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4400/0x14b4f8542d4f0820 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596b7 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.255573:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4400/0x14b4f8542d4f0820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596b7 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.255592:0:4545:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4400/0x14b4f8542d4f0820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596b7 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065110.255601:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259560576:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065110.255642:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065110.260720:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.271800:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.271886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.271897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.271923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.272466:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4790 00000100:00100000:0.0:1746065110.272475:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1961:x1830881260605312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065110.272486:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065110.272491:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bdddc00/0x14b4f8542d4f082e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596be expref: 262 pid: 20754 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.272502:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bdddc00/0x14b4f8542d4f082e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596be expref: 262 pid: 20754 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.272578:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bdddc00/0x14b4f8542d4f082e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596be expref: 262 pid: 20754 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.272739:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065110.272741:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc000/0x14b4f8542d4f085f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.272746:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065110.272755:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1961:x1830881260605312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 283us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.272759:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4790 00000100:00100000:0.0:1746065110.272791:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.272800:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260605952 00000100:00100000:0.0:1746065110.272802:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260605952 00010000:00010000:0.0:1746065110.272811:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f05bf lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5953d expref: 260 pid: 24350 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746065110.272843:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4794 00000100:00100000:0.0:1746065110.272847:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1958:x1830881260605952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065110.272852:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065110.272855:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f05bf lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5953d expref: 260 pid: 24350 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.272861:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f05bf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5953d expref: 260 pid: 24350 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.272869:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065110.272872:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc000/0x14b4f8542d4f085f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.272876:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065110.272885:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1958:x1830881260605952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 38us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.272889:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4794 00000100:00100000:0.0:1746065110.272926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.272933:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260605824 00000100:00100000:0.0:1746065110.272936:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260605824 00010000:00010000:0.0:1746065110.272943:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094759e00/0x14b4f8542d4f05d4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59552 expref: 15 pid: 20754 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746065110.272959:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4795 00000100:00100000:0.0:1746065110.272964:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260605824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065110.272970:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065110.272973:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094759e00/0x14b4f8542d4f05d4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59552 expref: 15 pid: 20754 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.272980:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094759e00/0x14b4f8542d4f05d4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59552 expref: 15 pid: 20754 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.272992:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065110.272994:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc000/0x14b4f8542d4f085f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.273000:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc000/0x14b4f8542d4f085f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.273006:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc000/0x14b4f8542d4f085f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.273018:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065110.273029:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260605824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.273033:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4795 00000100:00100000:0.0:1746065110.273063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.273081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.273095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.273105:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260606208 00000100:00100000:0.0:1746065110.273107:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260606208 00002000:00100000:0.0:1746065110.273125:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f15f800 x1830881260606208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.273133:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15f800 with x1830881260606208 ext(0->1048575) 00002000:00010000:0.0:1746065110.273136:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15f800 00000100:00100000:0.0:1746065110.273145:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260606464 00000100:00100000:0.0:1746065110.273146:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260606464 00002000:00100000:0.0:1746065110.273154:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f15dc00 x1830881260606464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.273160:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15dc00 with x1830881260606464 ext(1048576->2097151) 00002000:00010000:0.0:1746065110.273163:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15dc00 00000100:00100000:0.0:1746065110.273171:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260606720 00000100:00100000:0.0:1746065110.273173:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260606720 00002000:00100000:0.0:1746065110.273180:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f15e300 x1830881260606720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.273186:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15e300 with x1830881260606720 ext(1048576->2097151) 00002000:00010000:0.0:1746065110.273188:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15e300 00000100:00100000:0.0:1746065110.273202:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4357 00000100:00100000:0.0:1746065110.273206:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260606208:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065110.275644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.275658:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260606976 00000100:00100000:0.0:1746065110.275663:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260606976 00002000:00100000:0.0:1746065110.275686:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f15fb80 x1830881260606976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.275695:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15fb80 with x1830881260606976 ext(1048576->2097151) 00002000:00010000:0.0:1746065110.275699:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15fb80 00000100:00100000:0.0:1746065110.275712:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4360 00000100:00100000:0.0:1746065110.275717:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260606976:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065110.290924:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260606208:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17709us (17851us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065110.290936:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4357 00002000:00100000:0.0:1746065110.290946:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f15f800 x1830881260606208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:26/0 lens 488/440 e 0 to 0 dl 1746065121 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.290956:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15f800 with x1830881260606208 ext(0->1048575) 00002000:00010000:0.0:1746065110.290961:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15f800 00000100:00100000:0.0:1746065110.303438:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260606976:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27719us (27796us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065110.303459:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4360 00002000:00100000:0.0:1746065110.303466:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f15fb80 x1830881260606976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:26/0 lens 488/440 e 0 to 0 dl 1746065121 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.303473:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15fb80 with x1830881260606976 ext(1048576->2097151) 00002000:00010000:0.0:1746065110.303477:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15fb80 00000100:00100000:0.0:1746065110.313981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.314072:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.314096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.314111:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260607872 00000100:00100000:0.0:1746065110.314114:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260607872 00010000:00010000:0.0:1746065110.314130:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4f07be lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596a2 expref: 8 pid: 24350 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746065110.314146:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4796 00000100:00100000:0.0:1746065110.314151:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260607872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065110.314159:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065110.314163:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4f07be lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596a2 expref: 8 pid: 24350 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.314172:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4f07be lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596a2 expref: 8 pid: 24350 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.314186:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065110.314189:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25dc00/0x14b4f8542d4f0890 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065110.314196:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25dc00/0x14b4f8542d4f0890 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065110.314200:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25dc00/0x14b4f8542d4f0890 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065110.314212:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065110.314230:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260607872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.314235:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4796 00000100:00100000:0.0:1746065110.315291:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9783 00000100:00100000:0.0:1746065110.315297:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801332f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881259563392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065110.315374:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065110.315377:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.315378:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.315380:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.315382:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065110.315401:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801332f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3296:x1830881259563392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (443us total) trans 21474839888 rc 0/0 00000100:00100000:0.0:1746065110.315407:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9783 00000100:00100000:0.0:1746065110.315453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.316758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.319271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.319300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.319322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.319343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.319356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.319374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.319393:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260608384 00000100:00100000:0.0:1746065110.319398:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260608384 00000100:00100000:0.0:1746065110.319422:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260608640 00000100:00100000:0.0:1746065110.319424:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260608640 00000100:00100000:0.0:1746065110.319433:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260608896 00000100:00100000:0.0:1746065110.319434:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260608896 00000100:00100000:0.0:1746065110.319441:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260608512 00000100:00100000:0.0:1746065110.319453:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260608512 00000100:00100000:0.0:1746065110.319468:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260609024 00000100:00100000:0.0:1746065110.319470:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260609024 00000100:00100000:0.0:1746065110.319784:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9787 00000100:00100000:0.0:1746065110.319790:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260608640:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065110.319797:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.319805:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093486600/0x14b4f8542d4f08ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59727 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.319834:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.319835:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.319840:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093486600/0x14b4f8542d4f08ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59727 expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.319850:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093486600/0x14b4f8542d4f08ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59727 expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.319856:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093486600, rc 0) 00000100:00100000:0.0:1746065110.319877:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881260608640:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 87us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.319882:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9787 00000100:00100000:0.0:1746065110.319898:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9788 00000100:00100000:0.0:1746065110.319902:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260608896:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065110.319908:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.319914:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093486a00/0x14b4f8542d4f08c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59735 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.319922:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.319924:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.319927:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093486a00/0x14b4f8542d4f08c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59735 expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.319935:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093486a00/0x14b4f8542d4f08c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59735 expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.319941:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093486a00, rc 0) 00000100:00100000:0.0:1746065110.320108:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260608896:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 204us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.320113:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9788 00000100:00100000:0.0:1746065110.321506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.323105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.332480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.336366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.336381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.336401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.336417:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260610048 00000100:00100000:0.0:1746065110.336422:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260610048 00010000:00010000:0.0:1746065110.336451:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecd8800/0x14b4f8542d4f089e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5970b expref: 9 pid: 14643 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746065110.336481:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4797 00000100:00100000:0.0:1746065110.336487:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260609920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065110.336497:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065110.336502:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f08ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59712 expref: 9 pid: 20754 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.336515:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f08ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59712 expref: 9 pid: 20754 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.336532:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f08ac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59712 expref: 9 pid: 20754 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.336547:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065110.336550:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25dc00/0x14b4f8542d4f08e4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.336557:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25dc00/0x14b4f8542d4f08e4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.336561:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065110.336579:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260609920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.336584:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4797 00000100:00100000:0.0:1746065110.337868:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260610304 00000100:00100000:0.0:1746065110.337872:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260610304 00000100:00100000:0.0:1746065110.337909:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8812 00000100:00100000:0.0:1746065110.337915:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+11:28405:x1830881260610304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065110.337929:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.337939:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c000/0x14b4f8542d4f08eb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5974a expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.337973:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25dc00/0x14b4f8542d4f08e4 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.337980:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c000/0x14b4f8542d4f08eb lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5974a expref: 12 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.337992:0:20754:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25dc00/0x14b4f8542d4f08e4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065110.338000:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c000/0x14b4f8542d4f08eb lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5974a expref: 12 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.338009:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065110.338012:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065110.338014:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c000/0x14b4f8542d4f08eb lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5974a expref: 12 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.338019:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0c000, rc 0) 00000100:00100000:0.0:1746065110.338040:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+12:28405:x1830881260610304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 125us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.338045:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8812 00000100:00100000:0.0:1746065110.362754:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259564672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065110.362799:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065110.362845:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259565184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065110.362860:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065110.362873:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065110.362877:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259564544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065110.362887:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065110.362901:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259564672 00000100:00100000:0.0:1746065110.362906:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259564672 00000100:00100000:0.0:1746065110.362931:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259565184 00000100:00100000:0.0:1746065110.362933:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259565184 00000100:00100000:0.0:1746065110.362940:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259564544 00000100:00100000:0.0:1746065110.362942:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259564544 00000100:00100000:0.0:1746065110.362952:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9792 00000100:00100000:0.0:1746065110.362958:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3296:x1830881259564672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065110.363095:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065110.363097:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065111 -> 1746065111 00002000:00010000:0.0:1746065110.363099:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065110 -> 1746065110 00002000:00010000:0.0:1746065110.363101:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065111 -> 1746065111 00002000:00010000:0.0:1746065110.363103:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746065110.363123:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3296:x1830881259564672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (325us total) trans 21474839891 rc 0/0 00000100:00100000:0.0:1746065110.363129:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9792 00000100:00100000:0.0:1746065110.363144:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9794 00000100:00100000:0.0:1746065110.363148:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3296:x1830881259564544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065110.363204:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065110.363207:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065110 -> 1746065110 00002000:00010000:0.0:1746065110.363209:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065110 -> 1746065110 00002000:00010000:0.0:1746065110.363210:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065110 -> 1746065110 00002000:00010000:0.0:1746065110.363212:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065110.363228:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3296:x1830881259564544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (340us total) trans 21474839893 rc 0/0 00000100:00100000:0.0:1746065110.363233:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9794 00000100:00100000:0.0:1746065110.363243:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9796 00000100:00100000:0.0:1746065110.363247:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3298:x1830881259564928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065110.363307:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065110.363309:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065110.363311:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.363312:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065110.363314:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:0.0:1746065110.363330:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881259564928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (338us total) trans 21474839895 rc 0/0 00000100:00100000:0.0:1746065110.363336:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9796 00000100:00100000:0.0:1746065110.363431:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9798 00000100:00100000:0.0:1746065110.363436:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3298:x1830881259565312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065110.363516:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881259565312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (475us total) trans 21474839897 rc 0/0 00000100:00100000:0.0:1746065110.363521:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9798 00000004:00080000:0.0:1746065110.363546:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd72300/2, rc 0, transno 21474839893 00000100:00100000:0.0:1746065110.363550:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259564544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065110.364651:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259565056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065110.364672:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065110.364686:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd71180/2, rc 0, transno 21474839891 00000100:00100000:0.0:1746065110.364689:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259564672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065110.364696:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5882a00/2, rc 0, transno 21474839892 00000100:00100000:0.0:1746065110.364699:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259565184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065110.364712:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9805 00000100:00100000:0.0:1746065110.364717:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881259566336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065110.364772:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9806 00000100:00100000:0.0:1746065110.364776:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3295:x1830881259565952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065110.364848:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 4636224 -> 4636224 00002000:00010000:0.0:1746065110.364850:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065111 -> 1746065111 00002000:00010000:0.0:1746065110.364852:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065110 -> 1746065110 00002000:00010000:0.0:1746065110.364854:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065111 -> 1746065111 00002000:00010000:0.0:1746065110.364856:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5023 -> 5023 00000100:00100000:0.0:1746065110.364872:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3295:x1830881259565952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (252us total) trans 17179872649 rc 0/0 00000100:00100000:0.0:1746065110.364877:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9806 00000100:00100000:0.0:1746065110.364885:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9808 00000100:00100000:0.0:1746065110.364889:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3296:x1830881259565056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065110.364946:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065110.364948:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.364949:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.364951:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.364953:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065110.364970:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3296:x1830881259565056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (297us total) trans 21474839898 rc 0/0 00000100:00100000:0.0:1746065110.364974:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9808 00002000:00010000:0.0:1746065110.365004:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065110.365006:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.365008:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.365010:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065110.365011:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065110.365026:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3295:x1830881259566336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 310us (432us total) trans 17179872648 rc 0/0 00000100:00100000:0.0:1746065110.365031:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9805 00000004:00080000:0.0:1746065110.365045:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880e00/2, rc 0, transno 21474839898 00000100:00100000:0.0:1746065110.365048:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259565056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065110.366373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.366404:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.371808:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260611072 00000100:00100000:0.0:1746065110.371812:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260611072 00002000:00100000:0.0:1746065110.371852:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009fb15880 x1830881260611072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.371860:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb15880 with x1830881260611072 ext(1048576->2097151) 00002000:00010000:0.0:1746065110.371864:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb15880 00000100:00100000:0.0:1746065110.371885:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4363 00000100:00100000:0.0:1746065110.371891:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260611072:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065110.375257:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260611584 00000100:00100000:0.0:1746065110.375263:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260611584 00000100:00100000:0.0:1746065110.375286:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260611456 00000100:00100000:0.0:1746065110.375288:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260611456 00000100:00100000:0.0:1746065110.375312:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9811 00000100:00100000:0.0:1746065110.375318:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260611584:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065110.375331:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.375344:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbcc400/0x14b4f8542d4f0907 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5976d expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.375360:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.375361:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.375368:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbcc400/0x14b4f8542d4f0907 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5976d expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.375378:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbcc400/0x14b4f8542d4f0907 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5976d expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065110.375385:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbcc400, rc 0) 00000100:00100000:0.0:1746065110.375407:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260611584:12345-192.168.202.46@tcp:101:cat.0 Request processed in 90us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.375412:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9811 00000100:00100000:0.0:1746065110.386005:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.399712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.401250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.407377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.407505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.408779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.412622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.412654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.412795:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4366 00000100:00100000:0.0:1746065110.412804:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881260613248:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065110.413311:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260613248:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 508us (695us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065110.413326:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4366 00002000:00100000:0.0:1746065110.413333:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2670592->2674687) req@ffff8800a5883800 x1830881260613248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:26/0 lens 488/4536 e 0 to 0 dl 1746065121 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.413341:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883800 with x1830881260613248 ext(2670592->2674687) 00002000:00010000:0.0:1746065110.413343:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5883800 00000100:00100000:0.0:1746065110.415413:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.417646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.418115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.418778:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.419107:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260614400 00000100:00100000:0.0:1746065110.419110:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260614400 00002000:00100000:0.0:1746065110.419132:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2473984->2478079) req@ffff8800a90ad500 x1830881260614400/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.419140:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad500 with x1830881260614400 ext(2473984->2478079) 00010000:00010000:0.0:1746065110.419146:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c02b200/0x14b4f8542d4f0938 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->2670591] (req 2174976->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5977b expref: 16 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.419153:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c02b200/0x14b4f8542d4f0938 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->2670591] (req 2174976->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5977b expref: 16 pid: 8429 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746065110.419159:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a90ad500 00000100:00100000:0.0:1746065110.419182:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1371 00000100:00100000:0.0:1746065110.419187:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260614400:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065110.419311:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260614400:12345-192.168.202.46@tcp:3:cat.0 Request processed in 123us (532us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065110.419317:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1371 00002000:00100000:0.0:1746065110.419322:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2473984->2478079) req@ffff8800a90ad500 x1830881260614400/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:26/0 lens 488/4536 e 0 to 0 dl 1746065121 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.419329:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad500 with x1830881260614400 ext(2473984->2478079) 00010000:00010000:0.0:1746065110.419334:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c02b200/0x14b4f8542d4f0938 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->2670591] (req 2174976->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5977b expref: 16 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.419341:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c02b200/0x14b4f8542d4f0938 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->2670591] (req 2174976->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5977b expref: 16 pid: 8429 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746065110.419347:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a90ad500 00000100:00100000:0.0:1746065110.421806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.423627:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260614784 00000100:00100000:0.0:1746065110.423632:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260614784 00002000:00100000:0.0:1746065110.423655:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2174976->2478079) req@ffff88009fb12d80 x1830881260614784/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:26/0 lens 488/0 e 0 to 0 dl 1746065121 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.423663:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12d80 with x1830881260614784 ext(2174976->2478079) 00010000:00010000:0.0:1746065110.423670:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c02b200/0x14b4f8542d4f0938 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->2670591] (req 2174976->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5977b expref: 16 pid: 8429 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746065110.423678:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c02b200/0x14b4f8542d4f0938 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->2670591] (req 2174976->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5977b expref: 16 pid: 8429 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746065110.423685:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb12d80 00000100:00100000:0.0:1746065110.424468:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1373 00000100:00100000:0.0:1746065110.424475:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260614784:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065110.431938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.444366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.444407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.453742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.453792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.482558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.498259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.533610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.538196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.539693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.540400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.542568:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.552224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.557395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.557430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.557471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.601729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.601955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.602001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.617096:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.626163:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259567872:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065110.626172:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259568000:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065110.626178:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259568128:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065110.626203:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4f09af lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3538944->4194303] (req 3538944->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e597b3 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.626216:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14e200, rc 0) 00000100:00100000:0.0:1746065110.626233:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f14e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28426:x1830881260620032:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7318us (9146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.626239:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9818 00000100:00100000:0.0:1746065110.634884:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260620672 00000100:00100000:0.0:1746065110.634892:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260620672 00000100:00100000:0.0:1746065110.634937:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9819 00000100:00100000:0.0:1746065110.634945:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:28427:x1830881260620672:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065110.634959:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.634973:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4f09d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e597c1 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.634994:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.634996:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.635002:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4f09d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e597c1 expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.635014:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4f09d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e597c1 expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.635022:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5574800, rc 0) 00000100:00100000:0.0:1746065110.635070:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:28427:x1830881260620672:12345-192.168.202.46@tcp:101:cat.0 Request processed in 125us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065110.635076:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9819 00000100:00100000:0.0:1746065110.637135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.638353:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.640893:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.648372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.648409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.648463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.648786:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4385 00000100:00100000:0.0:1746065110.648886:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f14e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260622080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065110.648968:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f14e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260622080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 85us (505us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065110.648973:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4385 00002000:00100000:0.0:1746065110.648977:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3538944->3543039) req@ffff88012f14e300 x1830881260622080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:26/0 lens 488/4536 e 0 to 0 dl 1746065121 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065110.648984:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f14e300 with x1830881260622080 ext(3538944->3543039) 00002000:00010000:0.0:1746065110.648986:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f14e300 00000100:00100000:0.0:1746065110.656583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.662802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.662856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.667062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.667086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.667108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.681005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.682071:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.683364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.692996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.693386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.701511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.701544:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.701559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.701941:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4812 00000100:00100000:0.0:1746065110.701948:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881260624640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065110.701956:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065110.701964:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ecd9400/0x14b4f8542d4f0835 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596cc expref: 24 pid: 9716 timeout: 809 lvb_type: 1 00010000:00010000:0.0:1746065110.701972:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ecd9400/0x14b4f8542d4f0835 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596cc expref: 24 pid: 9716 timeout: 809 lvb_type: 1 00010000:00010000:0.0:1746065110.701984:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.701985:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065110.701991:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093486400/0x14b4f8542d4f0a26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e597eb expref: 18 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.701997:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093486400/0x14b4f8542d4f0a26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e597eb expref: 18 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.702027:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093486400/0x14b4f8542d4f0a26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e597eb expref: 18 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065110.702037:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259569408:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065110.702079:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065110.702604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.708313:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.708395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.710624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.710656:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.710680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.712056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.716306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.716325:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260626176 00000100:00100000:0.0:1746065110.716332:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260626176 00000100:00100000:0.0:1746065110.716366:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9827 00000100:00100000:0.0:1746065110.716373:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:28427:x1830881260626176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065110.716387:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.716400:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f0a42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59807 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.716421:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0400/0x14b4f8542d4f0a1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e597e4 expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.716427:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065110.716429:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065110.716432:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f0a42 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [4194304->4636671] (req 4194304->4636671) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59807 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.716468:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0400/0x14b4f8542d4f0a1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e597e4 expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065110.716477:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0400/0x14b4f8542d4f0a1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e597e4 expref: 30 pid: 9716 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065110.716487:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259570048:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065110.716545:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065110.716626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.716641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.716671:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.722299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.728729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.733640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.737237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.747005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.747044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.765276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.765334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.769607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.776772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.776837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.777087:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9832 00000100:00100000:0.0:1746065110.777095:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260628736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065110.777108:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065110.777121:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f0a5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5982a expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065110.777164:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f8cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259570816:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065110.777230:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065110.781431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.781541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.792319:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065110.798107:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065110.860219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.906366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.913129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.924748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.931483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.931533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.968971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065110.969051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.013910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.019040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.019109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.025233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.027029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.028090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.028111:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.028154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.036765:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259571840:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065111.036790:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801355ed600/0x14b4f8542d4f0b14 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59869 expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.036800:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801355ed600/0x14b4f8542d4f0b14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59869 expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.036861:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355ed600, rc 0) 00000100:00100000:0.0:1746065111.036895:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260632448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8485us (8781us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065111.036901:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9837 00000100:00100000:0.0:1746065111.056244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.056805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.056913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.062947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.070056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.072966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.080386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.096926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.101471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.113291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.124504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.138935:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.145276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.153629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.159190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.159223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.161278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.162167:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.163347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.163358:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260635904 00000100:00100000:0.0:1746065111.163361:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260635904 00000100:00100000:0.0:1746065111.163381:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260635776 00000100:00100000:0.0:1746065111.163384:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260635776 00000100:00100000:0.0:1746065111.163394:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9846 00000100:00100000:0.0:1746065111.163399:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881260635904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065111.163405:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.163410:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a60a6a00/0x14b4f8542d4f0b76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e598b6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.163429:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5805500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259573376:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065111.163459:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.163494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.163507:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260636032 00000100:00100000:0.0:1746065111.163509:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260636032 00000100:00100000:0.0:1746065111.163523:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9847 00000100:00100000:0.0:1746065111.163528:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260635776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065111.163533:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.163539:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f0b7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e598af expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.163549:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.163550:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.163555:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f0b7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598af expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.163564:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f0b7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598af expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.163571:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53cf400, rc 0) 00000100:00100000:0.0:1746065111.163583:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881260635776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.163588:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9847 00000100:00100000:0.0:1746065111.163600:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9848 00000100:00100000:0.0:1746065111.163605:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260636032:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065111.163609:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.163614:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4f0b84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e598bd expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.163629:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5807b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259573504:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065111.163644:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87780 going to sleep for 11 seconds 00002000:00010000:0.0:1746065111.166652:0:21235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065111 -> 1746065112 00002000:00010000:0.0:1746065111.166655:0:21235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065111 -> 1746065112 00000100:00100000:0.0:1746065111.166664:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5807b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259573504:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065111.166681:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4f0b84 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598bd expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.166688:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4f0b84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598bd expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.166697:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53ce800, rc 0) 00000100:00100000:0.0:1746065111.167291:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260636032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3684us (3794us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065111.167297:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9848 00000100:00100000:0.0:1746065111.169964:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.170029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.175645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.175677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.176476:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4405 00000100:00100000:0.0:1746065111.176484:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260636544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065111.199889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.199924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.199964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.207997:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.209042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.218884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.222912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.226532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.228114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.233486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.248445:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260639744 00000100:00100000:0.0:1746065111.248449:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260639744 00002000:00100000:0.0:1746065111.248473:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012f3d0a80 x1830881260639744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.248482:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0a80 with x1830881260639744 ext(3145728->4194303) 00010000:00010000:0.0:1746065111.248487:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c395600/0x14b4f8542d4f0b8b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598c4 expref: 33 pid: 8427 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.248495:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c395600/0x14b4f8542d4f0b8b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598c4 expref: 33 pid: 8427 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.248501:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3d0a80 00000100:00100000:0.0:1746065111.248511:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260639872 00000100:00100000:0.0:1746065111.248512:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260639872 00002000:00100000:0.0:1746065111.248521:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2625536->3145727) req@ffff88012f3d3b80 x1830881260639872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.248527:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3b80 with x1830881260639872 ext(2625536->3145727) 00010000:00010000:0.0:1746065111.248531:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c394400/0x14b4f8542d4f0b99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3837951] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598d2 expref: 25 pid: 8427 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.248536:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c394400/0x14b4f8542d4f0b99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3837951] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598d2 expref: 25 pid: 8427 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.248545:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3d3b80 00000100:00100000:0.0:1746065111.248559:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260640128 00000100:00100000:0.0:1746065111.248561:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260640128 00002000:00100000:0.0:1746065111.248568:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3837951) req@ffff88012f3d0700 x1830881260640128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.248573:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0700 with x1830881260640128 ext(3145728->3837951) 00010000:00010000:0.0:1746065111.248576:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c394400/0x14b4f8542d4f0b99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3837951] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598d2 expref: 26 pid: 8427 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.248582:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c394400/0x14b4f8542d4f0b99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3837951] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598d2 expref: 26 pid: 8427 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.248586:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3d0700 00000100:00100000:0.0:1746065111.248594:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1381 00000100:00100000:0.0:1746065111.248598:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260639744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065111.250511:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1382 00000100:00100000:0.0:1746065111.250523:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881260639872:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065111.259203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.266320:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260639744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17720us (17995us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065111.266326:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1381 00002000:00100000:0.0:1746065111.266331:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012f3d0a80 x1830881260639744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/440 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.266343:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0a80 with x1830881260639744 ext(3145728->4194303) 00010000:00010000:0.0:1746065111.266348:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c395600/0x14b4f8542d4f0b8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598c4 expref: 33 pid: 8427 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.266356:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c395600/0x14b4f8542d4f0b8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598c4 expref: 33 pid: 8427 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.266361:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3d0a80 00000100:00100000:0.0:1746065111.266609:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260639872:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16089us (18254us total) trans 0 rc 520192/520192 00000100:00100000:0.0:1746065111.266614:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1382 00002000:00100000:0.0:1746065111.266619:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2625536->3145727) req@ffff88012f3d3b80 x1830881260639872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/440 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 520192/520192 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.266625:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3b80 with x1830881260639872 ext(2625536->3145727) 00010000:00010000:0.0:1746065111.266629:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c394400/0x14b4f8542d4f0b99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3837951] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598d2 expref: 27 pid: 8427 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.266636:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c394400/0x14b4f8542d4f0b99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3837951] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598d2 expref: 27 pid: 8427 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746065111.266640:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3d3b80 00000100:00100000:0.0:1746065111.275681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.289048:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4409 00000100:00100000:0.0:1746065111.289056:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881260641280:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065111.307196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.307249:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.310349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.318169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.320224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.324915:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.328222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.328249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.330884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.331016:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260643968 00000100:00100000:0.0:1746065111.331021:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260643968 00000100:00100000:0.0:1746065111.331048:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3555 00000100:00100000:0.0:1746065111.331054:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094491850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28409:x1830881260643968:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065111.331208:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094491850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28409:x1830881260643968:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 155us (225us total) trans 8589942833 rc 0/0 00000100:00100000:0.0:1746065111.331213:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3555 00000100:00100000:0.0:1746065111.331460:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260643712 00000100:00100000:0.0:1746065111.331464:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260643712 00002000:00100000:0.0:1746065111.331882:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009b9ff480 x1830881260643712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.331892:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff480 with x1830881260643712 ext(3145728->4194303) 00002000:00010000:0.0:1746065111.331897:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9ff480 00000100:00100000:0.0:1746065111.331920:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4413 00000100:00100000:0.0:1746065111.331926:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260643712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065111.346617:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260643712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14689us (18320us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065111.346625:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4413 00002000:00100000:0.0:1746065111.346632:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009b9ff480 x1830881260643712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/440 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.346640:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff480 with x1830881260643712 ext(3145728->4194303) 00002000:00010000:0.0:1746065111.346644:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9ff480 00000100:00100000:0.0:1746065111.349111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.364100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.369676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.373291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.373372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.375169:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.395622:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4414 00002000:00100000:1.0:1746065111.395633:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009b9fd880 x1830881260645120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/440 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.395642:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fd880 with x1830881260645120 ext(3145728->4194303) 00002000:00010000:1.0:1746065111.395647:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fd880 00000100:00100000:0.0:1746065111.406077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.413266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.413336:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260646016 00000100:00100000:1.0:1746065111.413345:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260646016 00002000:00100000:1.0:1746065111.413382:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4771839) req@ffff880134d84000 x1830881260646016/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.413392:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84000 with x1830881260646016 ext(4194304->4771839) 00002000:00010000:1.0:1746065111.413396:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d84000 00000100:00100000:1.0:1746065111.413425:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4417 00000100:00100000:1.0:1746065111.413441:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260646016:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065111.427457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.432667:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.436597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.436882:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260646528 00000100:00100000:1.0:1746065111.436885:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260646528 00010000:00010000:1.0:1746065111.436901:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135cd9000/0x14b4f8542d4f0bdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598fc expref: 22 pid: 8428 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746065111.436928:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4832 00000100:00100000:1.0:1746065111.436933:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881260646528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065111.436942:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065111.436957:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135cd9000/0x14b4f8542d4f0bdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598fc expref: 22 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746065111.436966:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135cd9000/0x14b4f8542d4f0bdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598fc expref: 22 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746065111.436986:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cd9000/0x14b4f8542d4f0bdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598fc expref: 22 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746065111.436999:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065111.437016:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881260646528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065111.437021:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4832 00000100:00100000:0.0:1746065111.437636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.439474:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260646656 00000100:00100000:1.0:1746065111.439482:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260646656 00010000:00010000:1.0:1746065111.439509:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c9ba00/0x14b4f8542d4f0bd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598ee expref: 34 pid: 8428 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746065111.439544:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4833 00000100:00100000:1.0:1746065111.439550:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881260646656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065111.439560:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065111.439575:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c9ba00/0x14b4f8542d4f0bd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598ee expref: 34 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746065111.439585:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c9ba00/0x14b4f8542d4f0bd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598ee expref: 34 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746065111.439602:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c9ba00/0x14b4f8542d4f0bd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598ee expref: 34 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746065111.439614:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065111.439616:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065111.439621:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cd8600/0x14b4f8542d4f0c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3821567) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59918 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.439628:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cd8600/0x14b4f8542d4f0c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3821567) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59918 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.439653:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135cd8600/0x14b4f8542d4f0c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59918 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065111.439662:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259576192:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065111.439718:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065111.443464:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259576192:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065111.443482:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065111.444305:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260646656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4751us (6665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065111.444314:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4833 00000100:00100000:0.0:1746065111.445039:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.451643:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.453470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.546446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.547282:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260647808 00000100:00100000:1.0:1746065111.547290:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260647808 00000100:00100000:1.0:1746065111.547338:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 595 00000100:00100000:1.0:1746065111.547348:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260647808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065111.547362:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065111.547382:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cd8e00/0x14b4f8542d4f0c33 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5991f expref: 26 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.547403:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065111.547407:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065111.547758:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260647808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 408us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065111.547764:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 595 00000100:00100000:0.0:1746065111.581262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.594629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.594664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.624547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.640351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.644224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.645722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.645745:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260649088 00000100:00100000:1.0:1746065111.645749:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260649088 00010000:00010000:1.0:1746065111.645768:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9e200/0x14b4f8542d4f0b6f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598a8 expref: 23 pid: 8429 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746065111.645787:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4836 00000100:00100000:1.0:1746065111.645791:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881260649088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065111.645799:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065111.645829:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c9e200/0x14b4f8542d4f0b6f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598a8 expref: 23 pid: 8429 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746065111.645839:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c9e200/0x14b4f8542d4f0b6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598a8 expref: 23 pid: 8429 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746065111.645858:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065111.645878:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881260649088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065111.645884:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4836 00000100:00100000:0.0:1746065111.650763:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260649216 00000100:00100000:0.0:1746065111.650770:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260649216 00010000:00010000:0.0:1746065111.650796:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b2a00/0x14b4f8542d4f0b29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5987e expref: 27 pid: 8428 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.650830:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4837 00000100:00100000:0.0:1746065111.650836:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260649216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.650847:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.650863:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938b2a00/0x14b4f8542d4f0b29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5987e expref: 27 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.650873:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938b2a00/0x14b4f8542d4f0b29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5987e expref: 27 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.650893:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2a00/0x14b4f8542d4f0b29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5987e expref: 27 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.650907:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.650908:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.650914:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f50e200/0x14b4f8542d4f0c56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5992d expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.650922:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f50e200/0x14b4f8542d4f0c56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5992d expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.650945:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f50e200/0x14b4f8542d4f0c56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5992d expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.650960:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d84700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259576832:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065111.651023:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065111.654949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.659008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.669467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.669511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.669570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.669863:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260649856 00000100:00100000:0.0:1746065111.669866:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260649856 00010000:00010000:0.0:1746065111.669884:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4f0b30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59885 expref: 26 pid: 8428 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.669901:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260649728 00000100:00100000:0.0:1746065111.669903:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260649728 00010000:00010000:0.0:1746065111.669909:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f0b7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598af expref: 22 pid: 21235 timeout: 810 lvb_type: 1 00000100:00100000:0.0:1746065111.669925:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4838 00000100:00100000:0.0:1746065111.669929:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260649856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.669938:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.669953:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4f0b30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59885 expref: 26 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.669962:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4f0b30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59885 expref: 26 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.669984:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4f0b30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59885 expref: 26 pid: 8428 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746065111.670009:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065111.670037:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260649856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.670042:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4838 00000100:00100000:0.0:1746065111.670074:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4839 00000100:00100000:0.0:1746065111.670078:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881260649728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.670083:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.670089:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f0b7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598af expref: 22 pid: 21235 timeout: 810 lvb_type: 1 00010000:00010000:0.0:1746065111.670097:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f0b7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598af expref: 22 pid: 21235 timeout: 810 lvb_type: 1 00010000:00010000:0.0:1746065111.670106:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f0b7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598af expref: 22 pid: 21235 timeout: 810 lvb_type: 1 00010000:00010000:0.0:1746065111.670117:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.670118:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.670124:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cd9400/0x14b4f8542d4f0c5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59934 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.670131:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135cd9400/0x14b4f8542d4f0c5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59934 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.670154:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135cd9400/0x14b4f8542d4f0c5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59934 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.670164:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259577216:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065111.670203:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.676539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.677013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.683989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.685844:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.685861:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260650752 00000100:00100000:1.0:1746065111.685866:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260650752 00000100:00100000:1.0:1746065111.685889:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9863 00000100:00100000:1.0:1746065111.685893:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260650752:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065111.685903:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065111.685913:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd35800/0x14b4f8542d4f0cb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59949 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065111.685941:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259577472:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065111.685990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.686024:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260651008 00000100:00100000:1.0:1746065111.686027:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260651008 00000100:00100000:1.0:1746065111.686045:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9864 00000100:00100000:1.0:1746065111.686049:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260651008:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065111.686056:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065111.686064:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd35400/0x14b4f8542d4f0cb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59957 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065111.686086:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259577600:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065111.687649:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.689581:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:0.0:1746065111.692646:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065111 -> 1746065112 00000100:00100000:0.0:1746065111.692656:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259577472:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065111.692670:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd35800/0x14b4f8542d4f0cb1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59949 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.692678:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd35800/0x14b4f8542d4f0cb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59949 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.692686:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd35800, rc 0) 00000100:00100000:0.0:1746065111.692699:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260650752:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6806us (6857us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065111.692703:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9863 00000100:00100000:1.0:1746065111.703451:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.703478:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.703524:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260651648 00000100:00100000:0.0:1746065111.703528:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260651648 00000100:00100000:0.0:1746065111.703561:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3559 00000100:00100000:0.0:1746065111.703566:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+27:28465:x1830881260651648:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065111.703720:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+28:28465:x1830881260651648:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 153us (240us total) trans 8589942842 rc 0/0 00000100:00100000:0.0:1746065111.703726:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3559 00000100:00100000:0.0:1746065111.703743:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260651392 00000100:00100000:0.0:1746065111.703746:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260651392 00000100:00100000:0.0:1746065111.703764:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9865 00000100:00100000:0.0:1746065111.703768:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:28475:x1830881260651392:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065111.703776:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.703793:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffbf600/0x14b4f8542d4f0cbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5995e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.703828:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f50e200/0x14b4f8542d4f0c56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5992d expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.703835:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.703837:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.703840:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffbf600/0x14b4f8542d4f0cbf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5995e expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.703860:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f50e200/0x14b4f8542d4f0c56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5992d expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.703870:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f50e200/0x14b4f8542d4f0c56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5992d expref: 20 pid: 8428 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746065111.703879:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259578496:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065111.703922:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.707136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.711956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.712773:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259578496:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065111.712798:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffbf600/0x14b4f8542d4f0cbf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5995e expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.712834:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffbf600, rc 0) 00000100:00100000:0.0:1746065111.712868:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:28475:x1830881260651392:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9098us (9419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.712875:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9865 00000100:00100000:0.0:1746065111.718921:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259578624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065111.719955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.732810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.742287:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.742760:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.742779:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260652800 00000100:00100000:0.0:1746065111.742785:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260652800 00000100:00100000:0.0:1746065111.742832:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9866 00000100:00100000:0.0:1746065111.742838:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:28474:x1830881260652800:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065111.742854:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.742868:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8df600/0x14b4f8542d4f0cc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59965 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.742892:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cd8600/0x14b4f8542d4f0c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59918 expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.742903:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.742904:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065111.742907:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8df600/0x14b4f8542d4f0cc6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59965 expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.742930:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135cd8600/0x14b4f8542d4f0c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3821567) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59918 expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.742940:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135cd8600/0x14b4f8542d4f0c17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3821567) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59918 expref: 32 pid: 8428 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065111.742951:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259578880:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065111.743009:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.754213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.773253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.779800:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881260652928:12345-192.168.202.46@tcp:4:cat.0 Request processed in 24785us (25579us total) trans 17179872657 rc 0/0 00000100:00100000:1.0:1746065111.779811:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1391 00002000:00100000:1.0:1746065111.779835:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2588672->3821567) req@ffff88009baa2a00 x1830881260652928/t17179872657(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 504/448 e 0 to 0 dl 1746065122 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.779844:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2a00 with x1830881260652928 ext(2588672->3821567) 00010000:00010000:1.0:1746065111.779854:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cd8600/0x14b4f8542d4f0c17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59918 expref: 35 pid: 8428 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065111.779865:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cd8600/0x14b4f8542d4f0c17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59918 expref: 35 pid: 8428 timeout: 811 lvb_type: 0 00002000:00010000:1.0:1746065111.779871:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009baa2a00 00000100:00100000:0.0:1746065111.787556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.787624:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260653440 00000100:00100000:1.0:1746065111.787632:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260653440 00000100:00100000:1.0:1746065111.787674:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8832 00000100:00100000:1.0:1746065111.787681:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:28478:x1830881260653440:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065111.787700:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065111.787720:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0cd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59973 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.787796:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.787806:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.787833:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.787843:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.787848:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.787853:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.787930:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2600/0x14b4f8542d4f0ce9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.787936:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2600/0x14b4f8542d4f0ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.787942:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2600/0x14b4f8542d4f0ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065111.787948:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065111.788003:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788009:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788014:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788019:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ea2200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065111.788022:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788027:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788035:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065111.788037:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065111.788040:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788044:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0cdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788070:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788074:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788079:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788082:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ea2400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065111.788084:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788091:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788095:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f400) 00010000:00010000:1.0:1746065111.788097:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065111.788099:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788103:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0ce2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.788132:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0cd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59973 expref: 268 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.788141:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2600/0x14b4f8542d4f0ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59973 expref: 267 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.788146:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065111.788148:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065111.788151:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ea2600, rc 0) 00000100:00100000:1.0:1746065111.788190:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:28478:x1830881260653440:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 509us (643us total) trans 8589942843 rc 0/0 00000100:00100000:1.0:1746065111.788196:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8832 00000100:00100000:0.0:1746065111.788850:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.791483:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260653696 00000100:00100000:0.0:1746065111.791488:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260653696 00000100:00100000:0.0:1746065111.791517:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 596 00000100:00100000:0.0:1746065111.791523:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:1958:x1830881260653696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.791533:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.791552:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2600/0x14b4f8542d4f0ce9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59973 expref: 267 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.791581:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065111.791585:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065111.791606:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:1958:x1830881260653696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.791611:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 596 00000100:00100000:0.0:1746065111.792670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.795285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.795328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.802216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.817908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.829962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.829997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.838554:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260654848:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19469us (20639us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065111.838565:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4428 00002000:00100000:0.0:1746065111.838574:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009ba3c000 x1830881260654848/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/440 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.838582:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c000 with x1830881260654848 ext(1048576->2097151) 00002000:00010000:0.0:1746065111.838587:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3c000 00000100:00100000:0.0:1746065111.849610:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.852337:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8833 00000100:00100000:1.0:1746065111.852356:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+28:28480:x1830881260655360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065111.852381:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065111.852398:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf5e00/0x14b4f8542d4f0d05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59988 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.852504:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852516:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852525:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852537:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852542:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852547:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852644:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0d1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852652:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0d1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852658:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0d1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065111.852665:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065111.852726:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852731:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852736:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852740:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ea2800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065111.852743:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852748:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852756:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065111.852758:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065111.852761:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852764:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2800/0x14b4f8542d4f0d0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852796:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852800:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852804:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852807:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ea2200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065111.852809:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852825:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852830:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6fd00) 00010000:00010000:1.0:1746065111.852832:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065111.852834:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852837:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2200/0x14b4f8542d4f0d13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065111.852863:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cf5e00/0x14b4f8542d4f0d05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59988 expref: 31 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.852872:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ea2400/0x14b4f8542d4f0d1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59988 expref: 30 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.852877:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065111.852879:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065111.852881:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ea2400, rc 0) 00000100:00100000:1.0:1746065111.852923:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:28480:x1830881260655360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 576us (3321us total) trans 8589942845 rc 0/0 00000100:00100000:1.0:1746065111.852928:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8833 00000100:00100000:0.0:1746065111.865054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.865465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.868877:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9871 00000100:00100000:1.0:1746065111.868884:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:28475:x1830881260656000:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065111.868892:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065111.868903:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ea3c00/0x14b4f8542d4f0d2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59996 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.868920:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065111.868921:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065111.868927:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ea3c00/0x14b4f8542d4f0d2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59996 expref: 35 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.868937:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ea3c00/0x14b4f8542d4f0d2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59996 expref: 35 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.868945:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ea3c00, rc 0) 00000100:00100000:1.0:1746065111.868971:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:28475:x1830881260656000:12345-192.168.202.46@tcp:101:cat.0 Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065111.868976:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9871 00000100:00100000:1.0:1746065111.868987:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9872 00000100:00100000:1.0:1746065111.868992:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:28478:x1830881260656128:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065111.868998:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065111.869007:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5999d expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.869019:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cd9000/0x14b4f8542d4f0ccd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5996c expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.869025:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a003fc00/0x14b4f8542d4f0cf7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59981 expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065111.869030:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065111.869031:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065111.869033:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1355776->1888255] (req 1355776->1888255) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.869047:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a003fc00/0x14b4f8542d4f0cf7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59981 expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065111.869054:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a003fc00/0x14b4f8542d4f0cf7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59981 expref: 24 pid: 8429 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065111.869061:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259579776:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065111.869087:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135cd9000/0x14b4f8542d4f0ccd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5996c expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.869094:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135cd9000/0x14b4f8542d4f0ccd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5996c expref: 28 pid: 8427 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065111.869100:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259580032:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065111.869114:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.875246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.875271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.876069:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259579776:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065111.876080:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259580032:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065111.876278:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1355776->1888255] (req 1355776->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.876286:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065111.876288:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065111.876292:0:4544:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1888255) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.876299:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1888255) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065111.877549:0:4544:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1355776->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065111.877561:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259580160:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065111.877937:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065111.880352:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260656640 00000100:00100000:0.0:1746065111.880356:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260656640 00010000:00010000:0.0:1746065111.880371:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbcc400/0x14b4f8542d4f0907 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5976d expref: 23 pid: 9716 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746065111.880386:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260656768 00000100:00100000:0.0:1746065111.880389:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260656768 00010000:00010000:0.0:1746065111.880397:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f2800/0x14b4f8542d4f083c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596da expref: 35 pid: 8428 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746065111.880411:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4845 00000100:00100000:0.0:1746065111.880417:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260656256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065111.880427:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.880459:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c25cc00/0x14b4f8542d4f08cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5972e expref: 10 pid: 25185 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065111.880468:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c25cc00/0x14b4f8542d4f08cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5972e expref: 10 pid: 25185 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065111.880487:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c25cc00/0x14b4f8542d4f08cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5972e expref: 10 pid: 25185 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065111.880503:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065111.880505:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4846 00000100:00100000:1.0:1746065111.880511:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881260656640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065111.880517:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065111.880525:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbcc400/0x14b4f8542d4f0907 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5976d expref: 23 pid: 9716 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746065111.880533:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260656256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 116us (2165us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065111.880537:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbcc400/0x14b4f8542d4f0907 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5976d expref: 23 pid: 9716 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746065111.880538:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4845 00010000:00010000:1.0:1746065111.880547:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbcc400/0x14b4f8542d4f0907 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5976d expref: 23 pid: 9716 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746065111.880549:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4847 00000100:00100000:0.0:1746065111.880554:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881260656768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065111.880558:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065111.880560:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065111.880566:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944f2800/0x14b4f8542d4f083c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596da expref: 35 pid: 8428 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065111.880572:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260656640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 62us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065111.880577:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4846 00010000:00010000:0.0:1746065111.880578:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944f2800/0x14b4f8542d4f083c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596da expref: 35 pid: 8428 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065111.880588:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944f2800/0x14b4f8542d4f083c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596da expref: 35 pid: 8428 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065111.880596:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.880597:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065111.880602:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.880610:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065111.880633:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.880643:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259580288:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065111.881270:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065111.881287:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259580160:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065111.881323:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ea3a00, rc 0) 00000100:00100000:1.0:1746065111.881339:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:28478:x1830881260656128:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 12347us (12578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065111.881344:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9872 00000100:00100000:1.0:1746065111.881375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.881721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.881752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.881778:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260657792 00000100:00100000:1.0:1746065111.881780:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260657792 00002000:00100000:1.0:1746065111.881791:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009ba1dc00 x1830881260657792/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.881797:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1dc00 with x1830881260657792 ext(2097152->3145727) 00002000:00010000:1.0:1746065111.881800:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1dc00 00000100:00100000:1.0:1746065111.881809:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4431 00000100:00100000:1.0:1746065111.881829:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881260657536:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065111.881856:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4432 00000100:00100000:1.0:1746065111.881861:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260657792:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065111.887458:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259580288:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065111.887478:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065111.887510:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881260656768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6955us (8082us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065111.887519:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4847 00000100:00100000:0.0:1746065111.889462:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259580416:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065111.889482:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d12a400/0x14b4f8542d4f0d3d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599a4 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.889492:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d12a400/0x14b4f8542d4f0d3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599a4 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065111.889501:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d12a400, rc 0) 00000100:00100000:0.0:1746065111.889523:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260656896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8634us (8679us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065111.889528:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9873 00000100:00100000:0.0:1746065111.893312:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881260657280:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11499us (11926us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065111.893324:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4430 00002000:00100000:0.0:1746065111.893336:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ba1ca80 x1830881260657280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/440 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065111.893343:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ca80 with x1830881260657280 ext(2097152->3145727) 00002000:00010000:0.0:1746065111.893348:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1ca80 00000100:00100000:1.0:1746065111.893668:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260657792:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11805us (11913us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065111.893674:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4432 00002000:00100000:1.0:1746065111.893679:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009ba1dc00 x1830881260657792/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/440 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.893685:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1dc00 with x1830881260657792 ext(2097152->3145727) 00002000:00010000:1.0:1746065111.893689:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1dc00 00000100:00100000:1.0:1746065111.893864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.893992:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260658432 00000100:00100000:0.0:1746065111.893998:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260658432 00000100:00100000:0.0:1746065111.894041:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9875 00000100:00100000:0.0:1746065111.894048:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260658432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065111.894061:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065111.894075:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd34e00/0x14b4f8542d4f0d4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e599b2 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065111.894120:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259580672:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065111.894183:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065111.895214:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881260657536:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13397us (13490us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065111.895222:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4431 00002000:00100000:1.0:1746065111.895228:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009ba1c700 x1830881260657536/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/440 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.895236:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c700 with x1830881260657536 ext(3145728->4194303) 00002000:00010000:1.0:1746065111.895239:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1c700 00000100:00100000:0.0:1746065111.899069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.899114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.899235:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260658816 00000100:00100000:1.0:1746065111.899242:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260658816 00002000:00100000:1.0:1746065111.899278:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1884160->1888255) req@ffff88009ba3d880 x1830881260658816/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.899287:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d880 with x1830881260658816 ext(1884160->1888255) 00002000:00010000:1.0:1746065111.899292:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3d880 00000100:00100000:1.0:1746065111.899305:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260658944 00000100:00100000:1.0:1746065111.899307:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260658944 00002000:00100000:1.0:1746065111.899317:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1769472->1773567) req@ffff88009ba3fb80 x1830881260658944/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.899323:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3fb80 with x1830881260658944 ext(1769472->1773567) 00002000:00010000:1.0:1746065111.899326:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3fb80 00000100:00100000:1.0:1746065111.899337:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4435 00000100:00100000:1.0:1746065111.899343:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260658816:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065111.899981:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260658816:12345-192.168.202.46@tcp:3:cat.0 Request processed in 638us (919us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065111.899987:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4435 00002000:00100000:1.0:1746065111.899991:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1884160->1888255) req@ffff88009ba3d880 x1830881260658816/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/4536 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.899997:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d880 with x1830881260658816 ext(1884160->1888255) 00002000:00010000:1.0:1746065111.900000:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3d880 00000100:00100000:0.0:1746065111.908608:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.908972:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.909130:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260659328 00000100:00100000:1.0:1746065111.909134:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260659328 00000100:00100000:1.0:1746065111.909156:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3561 00000100:00100000:1.0:1746065111.909162:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094492450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+29:28480:x1830881260659328:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065111.909626:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094492450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+30:28480:x1830881260659328:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 462us (652us total) trans 8589942846 rc 0/0 00000100:00100000:1.0:1746065111.909633:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3561 00000100:00100000:0.0:1746065111.916248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.916302:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260659584 00000100:00100000:1.0:1746065111.916310:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260659584 00002000:00100000:1.0:1746065111.916347:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4771839) req@ffff88009ba3f480 x1830881260659584/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/0 e 0 to 0 dl 1746065122 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.916357:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f480 with x1830881260659584 ext(4194304->4771839) 00002000:00010000:1.0:1746065111.916362:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3f480 00000100:00100000:1.0:1746065111.916392:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4437 00000100:00100000:1.0:1746065111.916400:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881260659584:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065111.920496:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881260659584:12345-192.168.202.46@tcp:3:cat.0 Request processed in 4089us (4247us total) trans 0 rc 577536/577536 00000100:00100000:1.0:1746065111.920506:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4437 00002000:00100000:1.0:1746065111.920515:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4771839) req@ffff88009ba3f480 x1830881260659584/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:27/0 lens 488/440 e 0 to 0 dl 1746065122 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065111.920524:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f480 with x1830881260659584 ext(4194304->4771839) 00002000:00010000:1.0:1746065111.920529:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3f480 00000100:00100000:0.0:1746065111.923124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.926676:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065111.936114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065111.936320:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260660096 00000100:00100000:1.0:1746065111.936327:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260660096 00000100:00100000:1.0:1746065111.936376:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3562 00000100:00100000:1.0:1746065111.936382:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:28475:x1830881260660096:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065111.937136:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:28475:x1830881260660096:12345-192.168.202.46@tcp:35:cat.0 Request processed in 753us (1029us total) trans 8589942847 rc 0/0 00000100:00100000:1.0:1746065111.937142:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3562 00000100:00100000:0.0:1746065112.034096:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.042726:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260660736 00000100:00100000:0.0:1746065112.042735:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260660736 00000100:00100000:0.0:1746065112.042793:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 598 00000100:00100000:0.0:1746065112.042800:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+32:1958:x1830881260660736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.042812:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.042850:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d12b800/0x14b4f8542d4f0d7c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ce expref: 32 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.043436:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260660608 00000100:00100000:1.0:1746065112.043441:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260660608 00000100:00100000:1.0:1746065112.043474:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3563 00000100:00100000:1.0:1746065112.043480:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+32:28488:x1830881260660608:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065112.043646:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+33:28488:x1830881260660608:12345-192.168.202.46@tcp:35:cat.0 Request processed in 165us (2586us total) trans 8589942849 rc 0/0 00000100:00100000:1.0:1746065112.043652:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3563 00010000:00010000:0.0:1746065112.044281:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065112.044286:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.044330:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+32:1958:x1830881260660736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1531us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.044337:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 598 00000100:00100000:0.0:1746065112.047177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.047357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.047562:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260660992 00000100:00100000:0.0:1746065112.047565:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260660992 00000100:00100000:0.0:1746065112.047599:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9879 00000100:00100000:0.0:1746065112.047607:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260660992:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065112.047621:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.047636:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd35400/0x14b4f8542d4f0d8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e599dc expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065112.047692:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259581184:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065112.048017:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.051257:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259581184:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065112.051258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065112.051674:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35400/0x14b4f8542d4f0d8a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599dc expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.051685:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd35400/0x14b4f8542d4f0d8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599dc expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.051982:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd35400, rc 0) 00000100:00100000:1.0:1746065112.052006:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260660992:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4401us (4649us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065112.052011:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9879 00000100:00100000:0.0:1746065112.053269:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.060228:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.060264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.060287:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260661760 00000100:00100000:0.0:1746065112.060289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.060295:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260661760 00000100:00100000:1.0:1746065112.060308:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260662016 00000100:00100000:1.0:1746065112.060310:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260662016 00000100:00100000:0.0:1746065112.060310:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.060323:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260661888 00000100:00100000:0.0:1746065112.060325:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260661888 00000100:00100000:1.0:1746065112.060358:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9880 00000100:00100000:1.0:1746065112.060366:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260662016:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065112.060381:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.060395:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e599f8 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.060413:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.060415:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.060422:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f8 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.060447:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f8 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.060456:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ea3200, rc 0) 00000100:00100000:1.0:1746065112.060493:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260662016:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 128us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.060499:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9880 00000100:00100000:1.0:1746065112.060514:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9881 00000100:00100000:1.0:1746065112.060518:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260661888:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065112.060524:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.060530:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ea3600/0x14b4f8542d4f0db4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e599f1 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.060561:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259581440:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065112.060606:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.060712:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9882 00000100:00100000:0.0:1746065112.060719:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260661504:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065112.060726:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.060735:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd34e00/0x14b4f8542d4f0dbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e599e3 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.060746:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.060747:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.060751:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd34e00/0x14b4f8542d4f0dbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599e3 expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.060760:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd34e00/0x14b4f8542d4f0dbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599e3 expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065112.060764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065112.060769:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd34e00, rc 0) 00000100:00100000:1.0:1746065112.060775:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260662144 00000100:00100000:1.0:1746065112.060778:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260662144 00000100:00100000:0.0:1746065112.060784:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260661504:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 66us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.060789:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9882 00000100:00100000:1.0:1746065112.060791:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9884 00000100:00100000:1.0:1746065112.060795:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260662144:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065112.060801:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.060807:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e599ff expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.060840:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.060841:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065112.060843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065112.060845:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ff expref: 13 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.060854:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ff expref: 13 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.060861:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ea2000, rc 0) 00000100:00100000:1.0:1746065112.060875:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260662144:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 79us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.060880:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9884 00000100:00100000:1.0:1746065112.060895:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260662272 00000100:00100000:1.0:1746065112.060897:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260662272 00002000:00100000:1.0:1746065112.060915:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880094d97b80 x1830881260662272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.060923:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97b80 with x1830881260662272 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.060927:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97b80 00000100:00100000:1.0:1746065112.061509:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4438 00000100:00100000:1.0:1746065112.061515:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881260662272:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:1.0:1746065112.067845:0:4544:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065112 -> 1746065113 00000100:00100000:0.0:1746065112.067904:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259581440:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065112.067922:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ea3600/0x14b4f8542d4f0db4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f1 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.067932:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ea3600/0x14b4f8542d4f0db4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f1 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.067943:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ea3600, rc 0) 00000100:00100000:0.0:1746065112.068129:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260661888:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 7609us (7816us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065112.068135:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9881 00000100:00100000:1.0:1746065112.074331:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881260662272:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12806us (13477us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.074342:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4438 00002000:00100000:1.0:1746065112.074353:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880094d97b80 x1830881260662272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.074362:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97b80 with x1830881260662272 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.074367:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97b80 00000100:00100000:0.0:1746065112.076794:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.079529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.089710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.089762:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260662656 00000100:00100000:1.0:1746065112.089770:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260662656 00000100:00100000:1.0:1746065112.090167:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9885 00000100:00100000:1.0:1746065112.090175:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+24:28488:x1830881260662656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065112.090187:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.090206:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0155600/0x14b4f8542d4f0dde lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59a0d expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.090228:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.090234:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065112.090235:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065112.090238:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0155600/0x14b4f8542d4f0dde lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a0d expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.090260:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1888255) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.090269:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1888255) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 26 pid: 4544 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.090278:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259581824:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.090742:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.094383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.100224:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260663168 00000100:00100000:0.0:1746065112.100231:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260663168 00002000:00100000:0.0:1746065112.100282:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1355776->1888255) req@ffff88012e8b4e00 x1830881260663168/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.100297:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4e00 with x1830881260663168 ext(1355776->1888255) 00010000:00010000:0.0:1746065112.100306:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 27 pid: 4544 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.100318:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093ea3a00/0x14b4f8542d4f0d36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5999d expref: 27 pid: 4544 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746065112.100325:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e8b4e00 00000100:00100000:1.0:1746065112.100381:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1393 00000100:00100000:1.0:1746065112.100395:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260663168:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065112.104163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.109583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.109788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.109831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.109848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.109861:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.110123:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260663808 00000100:00100000:0.0:1746065112.110126:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260663808 00000100:00100000:0.0:1746065112.110385:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9887 00000100:00100000:0.0:1746065112.110391:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260663680:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065112.110407:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.110415:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746065112.110417:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9888 00010000:00010000:0.0:1746065112.110420:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0155600/0x14b4f8542d4f0dde lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a0d expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.110423:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260663936:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065112.110425:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065112.110439:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110445:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0e16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110453:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8df600/0x14b4f8542d4f0cc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59965 expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110459:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f8 expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.110461:0:21235:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0155600/0x14b4f8542d4f0dde lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a0d expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110465:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ea3c00/0x14b4f8542d4f0d2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59996 expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110469:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.110470:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110471:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.110472:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0e16 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110485:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ea3c00/0x14b4f8542d4f0d2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59996 expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110492:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ea3c00/0x14b4f8542d4f0d2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59996 expref: 33 pid: 4544 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.110499:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259582208:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065112.110511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.110525:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260664064 00000100:00100000:1.0:1746065112.110528:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260664064 00000100:00100000:1.0:1746065112.110538:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9889 00000100:00100000:1.0:1746065112.110542:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881260663552:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065112.110555:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0155a00/0x14b4f8542d4f0e1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110564:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffbf600/0x14b4f8542d4f0cbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5995e expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110570:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd34e00/0x14b4f8542d4f0dbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599e3 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.110576:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a003f800/0x14b4f8542d4f0cfe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5997a expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.110580:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.110581:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.110583:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0155a00/0x14b4f8542d4f0e1d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110596:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a003f800/0x14b4f8542d4f0cfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5997a expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.110607:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a003f800/0x14b4f8542d4f0cfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5997a expref: 24 pid: 8429 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.110615:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259582336:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.110642:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9890 00000100:00100000:1.0:1746065112.110647:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260663808:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065112.110661:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0154e00/0x14b4f8542d4f0e24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110670:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110674:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065112.110675:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065112.110677:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0154e00/0x14b4f8542d4f0e24 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110690:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110697:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 21 pid: 8429 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.110705:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259582464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.110750:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9891 00000100:00100000:1.0:1746065112.110756:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881260664064:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065112.110770:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110779:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cd8a00/0x14b4f8542d4f0be6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59903 expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110785:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ff expref: 13 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.110791:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135cd9a00/0x14b4f8542d4f0bed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5990a expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110796:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e23400/0x14b4f8542d4f0bc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598e0 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110801:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065112.110802:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065112.110804:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 7/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110836:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e23400/0x14b4f8542d4f0bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598e0 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.110843:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e23400/0x14b4f8542d4f0bc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598e0 expref: 24 pid: 8427 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.110851:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259582592:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065112.112480:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f8 expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.112491:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f8 expref: 12 pid: 4544 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.112501:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259582976:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065112.112559:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8df600/0x14b4f8542d4f0cc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59965 expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.112567:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b8df600/0x14b4f8542d4f0cc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59965 expref: 21 pid: 8427 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.112575:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259583104:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.112595:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.113250:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259582208:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065112.113274:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135cd9a00/0x14b4f8542d4f0bed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5990a expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.113282:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135cd9a00/0x14b4f8542d4f0bed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5990a expref: 28 pid: 8428 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.113290:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259583616:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065112.113376:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ff expref: 13 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.113389:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ff expref: 13 pid: 8428 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.113396:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259583744:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065112.113420:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135cd8a00/0x14b4f8542d4f0be6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59903 expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.113437:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135cd8a00/0x14b4f8542d4f0be6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59903 expref: 24 pid: 8428 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.113444:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259583872:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.113457:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.113465:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.114406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.118299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.118339:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065112.118540:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e23400/0x14b4f8542d4f0bc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e598e0 expref: 24 pid: 8427 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.118555:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259582592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.121370:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.121388:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260665472 00000100:00100000:1.0:1746065112.121393:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260665472 00010000:00010000:1.0:1746065112.121416:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003f800/0x14b4f8542d4f0cfe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5997a expref: 24 pid: 8429 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.121446:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4853 00000100:00100000:1.0:1746065112.121453:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260665472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.121465:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.121482:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a003f800/0x14b4f8542d4f0cfe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5997a expref: 24 pid: 8429 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.121492:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a003f800/0x14b4f8542d4f0cfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5997a expref: 24 pid: 8429 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.121510:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.121565:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259583616:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065112.121573:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259583744:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065112.121580:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259583872:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065112.121597:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.122067:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260665472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 613us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.122074:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4853 00000100:00100000:1.0:1746065112.122129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.122616:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260665088 00000100:00100000:0.0:1746065112.122619:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260665088 00010000:00010000:0.0:1746065112.122641:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4f0858 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596c5 expref: 34 pid: 21235 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746065112.122669:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4854 00000100:00100000:0.0:1746065112.122675:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881260665088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.122682:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.122696:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4f0858 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596c5 expref: 34 pid: 21235 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065112.122704:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4f0858 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596c5 expref: 34 pid: 21235 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065112.122716:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4f0858 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e596c5 expref: 34 pid: 21235 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065112.122724:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.122738:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260665088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.122742:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4854 00000100:00100000:1.0:1746065112.125240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.127472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.128044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.128058:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260665216 00000100:00100000:0.0:1746065112.128061:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260665216 00010000:00010000:0.0:1746065112.128082:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffbf600/0x14b4f8542d4f0cbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5995e expref: 27 pid: 8427 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.128098:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4857 00000100:00100000:0.0:1746065112.128103:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260665216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.128111:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.128124:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ffbf600/0x14b4f8542d4f0cbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5995e expref: 27 pid: 8427 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.128131:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ffbf600/0x14b4f8542d4f0cbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5995e expref: 27 pid: 8427 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.128142:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffbf600/0x14b4f8542d4f0cbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5995e expref: 27 pid: 8427 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.128151:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.128175:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260665216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.128180:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4857 00000100:00100000:0.0:1746065112.128209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.128219:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260665600 00000100:00100000:0.0:1746065112.128221:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260665600 00010000:00010000:0.0:1746065112.128231:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135cd8a00/0x14b4f8542d4f0be6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59903 expref: 23 pid: 8428 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.128243:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4858 00000100:00100000:0.0:1746065112.128248:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881260665600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.128253:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065112.128259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065112.128262:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135cd8a00/0x14b4f8542d4f0be6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59903 expref: 23 pid: 8428 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.128269:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135cd8a00/0x14b4f8542d4f0be6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59903 expref: 23 pid: 8428 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.128273:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260664704 00000100:00100000:1.0:1746065112.128276:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260664704 00010000:00010000:0.0:1746065112.128284:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135cd8a00/0x14b4f8542d4f0be6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59903 expref: 23 pid: 8428 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.128288:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f8 expref: 12 pid: 4544 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065112.128292:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.128303:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4859 00000100:00100000:1.0:1746065112.128307:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260664704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065112.128309:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260665600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (98us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065112.128313:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065112.128314:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4858 00010000:00010000:1.0:1746065112.128321:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f8 expref: 12 pid: 4544 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.128328:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f8 expref: 12 pid: 4544 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746065112.128339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065112.128343:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ea3200/0x14b4f8542d4f0dad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599f8 expref: 12 pid: 4544 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746065112.128348:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260664960 00000100:00100000:0.0:1746065112.128351:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260664960 00010000:00010000:1.0:1746065112.128355:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065112.128360:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd34e00/0x14b4f8542d4f0dbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599e3 expref: 14 pid: 21235 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.128370:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260664704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 62us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.128372:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4860 00000100:00100000:1.0:1746065112.128375:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4859 00000100:00100000:0.0:1746065112.128376:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260664960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.128382:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.128388:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd34e00/0x14b4f8542d4f0dbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599e3 expref: 14 pid: 21235 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065112.128394:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd34e00/0x14b4f8542d4f0dbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599e3 expref: 14 pid: 21235 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.128402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065112.128403:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd34e00/0x14b4f8542d4f0dbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599e3 expref: 14 pid: 21235 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.128411:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260665344 00000100:00100000:1.0:1746065112.128413:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260665344 00010000:00010000:0.0:1746065112.128413:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.128415:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.128418:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0155a00/0x14b4f8542d4f0e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.128423:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ff expref: 14 pid: 8428 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065112.128423:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0155a00/0x14b4f8542d4f0e1d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.128451:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4861 00010000:00010000:0.0:1746065112.128966:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.128982:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260664960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 605us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.129251:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881260665344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.129258:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.129267:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ff expref: 13 pid: 8428 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.129274:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ff expref: 13 pid: 8428 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.129284:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ea2000/0x14b4f8542d4f0dc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e599ff expref: 13 pid: 8428 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.129296:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.129297:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.129300:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065112.129462:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4860 00000100:00100000:0.0:1746065112.129506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.129530:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.129562:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.129572:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260665856 00000100:00100000:0.0:1746065112.129574:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260665856 00010000:00010000:0.0:1746065112.129584:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8df600/0x14b4f8542d4f0cc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59965 expref: 23 pid: 8427 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.129596:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260666240 00000100:00100000:0.0:1746065112.129598:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260666240 00010000:00010000:0.0:1746065112.129604:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 24 pid: 8429 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.129617:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4862 00000100:00100000:0.0:1746065112.129621:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881260665856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.129628:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.129636:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8df600/0x14b4f8542d4f0cc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59965 expref: 24 pid: 8427 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.129643:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8df600/0x14b4f8542d4f0cc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59965 expref: 24 pid: 8427 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.129655:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8df600/0x14b4f8542d4f0cc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59965 expref: 24 pid: 8427 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.129664:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.129678:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260665856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.129684:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4862 00000100:00100000:0.0:1746065112.129694:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4863 00000100:00100000:0.0:1746065112.129699:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260666240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.129705:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.129712:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 22 pid: 8429 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.129719:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 22 pid: 8429 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.129729:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a003f400/0x14b4f8542d4f0d28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->1773567) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5998f expref: 22 pid: 8429 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.129740:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.129741:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.129744:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0154e00/0x14b4f8542d4f0e24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.129750:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129750:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0154e00/0x14b4f8542d4f0e24 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129763:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065112.129766:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.129777:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260666240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.129782:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260665344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 533us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.129782:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4863 00000100:00100000:1.0:1746065112.129788:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4861 00010000:00010000:0.0:1746065112.129801:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129807:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129835:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129840:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129845:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129855:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0154800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065112.129857:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129863:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129872:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.129877:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0e2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065112.129905:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260664064:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 19149us (19393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.129910:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9891 00000100:00100000:0.0:1746065112.140898:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260666624 00000100:00100000:0.0:1746065112.140905:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260666624 00000100:00100000:0.0:1746065112.140953:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8839 00000100:00100000:0.0:1746065112.140960:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:28492:x1830881260666624:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065112.140980:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.140994:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f0e32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59a22 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.141069:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34200/0x14b4f8542d4f0e39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.141080:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34200/0x14b4f8542d4f0e39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.141087:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34200/0x14b4f8542d4f0e39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.141094:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f0e40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.141098:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f0e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.141100:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f0e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.141164:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34a00/0x14b4f8542d4f0e47 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.141171:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d12a800/0x14b4f8542d4f0df3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a14 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.141175:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34a00/0x14b4f8542d4f0e47 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.141194:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d12a800/0x14b4f8542d4f0df3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a14 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.141200:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d12a800/0x14b4f8542d4f0df3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a14 expref: 11 pid: 24350 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.141208:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259584000:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065112.141254:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.146941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.148909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.149757:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065112.150237:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.150245:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.150284:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.150291:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.150296:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.150302:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd35e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065112.150305:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.150311:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.150321:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.150331:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd35e00/0x14b4f8542d4f0e0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065112.150391:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260663680:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 39999us (40601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.150397:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9887 00000100:00100000:0.0:1746065112.151643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.152707:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.157552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.157675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.157716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.157776:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260667904 00000100:00100000:1.0:1746065112.157784:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260667904 00002000:00100000:1.0:1746065112.157848:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (327680->331775) req@ffff88008fd04380 x1830881260667904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.157857:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04380 with x1830881260667904 ext(327680->331775) 00002000:00010000:1.0:1746065112.157862:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04380 00000100:00100000:1.0:1746065112.157880:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4439 00000100:00100000:1.0:1746065112.157887:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260667904:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065112.158026:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260667904:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 139us (350us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065112.158032:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4439 00002000:00100000:1.0:1746065112.158037:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (327680->331775) req@ffff88008fd04380 x1830881260667904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.158049:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04380 with x1830881260667904 ext(327680->331775) 00002000:00010000:1.0:1746065112.158051:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04380 00000100:00100000:1.0:1746065112.161218:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260668416 00000100:00100000:1.0:1746065112.161225:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260668416 00000100:00100000:1.0:1746065112.161263:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8842 00000100:00100000:1.0:1746065112.161269:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:28496:x1830881260668416:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065112.161283:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.161298:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b400/0x14b4f8542d4f0e86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59a3e expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.161370:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161381:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161390:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161400:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161405:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161410:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161501:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161512:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161517:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065112.161525:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065112.161579:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161585:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161590:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161595:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f13ba00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065112.161598:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161604:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161613:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065112.161615:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065112.161619:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161623:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f0e9b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161645:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161653:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161657:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161660:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f13b600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065112.161662:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161667:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161672:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065112.161674:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065112.161676:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161680:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b600/0x14b4f8542d4f0e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161687:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161692:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161696:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161699:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f13b800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065112.161700:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161708:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161713:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6fe00) 00010000:00010000:1.0:1746065112.161714:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065112.161716:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161719:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f0e94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.161746:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b400/0x14b4f8542d4f0e86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a3e expref: 271 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.161752:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b400/0x14b4f8542d4f0e86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a3e expref: 271 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.161758:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f13b400, rc 0) 00000100:00100000:1.0:1746065112.161791:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:28496:x1830881260668416:12345-192.168.202.46@tcp:101:cat.0 Request processed in 522us (627us total) trans 8589942855 rc 301/301 00000100:00100000:1.0:1746065112.161796:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8842 00000100:00100000:0.0:1746065112.163537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.163568:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.164472:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260668928 00000100:00100000:0.0:1746065112.164481:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260668928 00002000:00100000:0.0:1746065112.164524:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (409600->413695) req@ffff88008fd07b80 x1830881260668928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.164533:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07b80 with x1830881260668928 ext(409600->413695) 00002000:00010000:0.0:1746065112.164539:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd07b80 00000100:00100000:0.0:1746065112.164557:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4441 00000100:00100000:0.0:1746065112.164564:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260668928:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065112.164695:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260668928:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 130us (1125us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065112.164700:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4441 00002000:00100000:0.0:1746065112.164705:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (409600->413695) req@ffff88008fd07b80 x1830881260668928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.164711:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07b80 with x1830881260668928 ext(409600->413695) 00002000:00010000:0.0:1746065112.164714:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd07b80 00000100:00100000:1.0:1746065112.172314:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260668672 00000100:00100000:1.0:1746065112.172327:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260668672 00000100:00100000:1.0:1746065112.172391:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3565 00000100:00100000:1.0:1746065112.172400:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28489:x1830881260668672:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065112.172585:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28489:x1830881260668672:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 186us (9053us total) trans 8589942856 rc 0/0 00000100:00100000:1.0:1746065112.172592:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3565 00000100:00100000:0.0:1746065112.175316:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260669056 00000100:00100000:0.0:1746065112.175323:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260669056 00000100:00100000:0.0:1746065112.175364:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260669312 00000100:00100000:0.0:1746065112.175366:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260669312 00000100:00100000:0.0:1746065112.175376:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260669568 00000100:00100000:0.0:1746065112.175377:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260669568 00000100:00100000:0.0:1746065112.175387:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9894 00000100:00100000:0.0:1746065112.175394:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260669056:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065112.175409:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.175424:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd34c00/0x14b4f8542d4f0ea9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59a45 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065112.175457:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6d8, atime: 0x6812d6d7, ctime: 0x6812d6d8, blocks: 0x821 00010000:00010000:0.0:1746065112.175472:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.175474:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.175481:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd34c00/0x14b4f8542d4f0ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a45 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.175495:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd34c00/0x14b4f8542d4f0ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a45 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.175503:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd34c00, rc 0) 00000100:00100000:0.0:1746065112.175538:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881260669056:12345-192.168.202.46@tcp:101:cat.0 Request processed in 144us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.175547:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9894 00000100:00100000:0.0:1746065112.175563:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9895 00000100:00100000:0.0:1746065112.175568:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260669312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065112.175574:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.175582:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd34000/0x14b4f8542d4f0eb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59a53 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.175592:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.175594:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.175597:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd34000/0x14b4f8542d4f0eb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a53 expref: 34 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.175606:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd34000/0x14b4f8542d4f0eb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a53 expref: 34 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.175613:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd34000, rc 0) 00000100:00100000:0.0:1746065112.175628:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881260669312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 60us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.175632:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9895 00000100:00100000:0.0:1746065112.175641:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9896 00000100:00100000:0.0:1746065112.175645:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260669568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065112.175650:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.175656:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd35a00/0x14b4f8542d4f0eb7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59a61 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065112.175666:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6d8, atime: 0x6812d6d7, ctime: 0x6812d6d8, blocks: 0x1029 00010000:00010000:0.0:1746065112.175673:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.175674:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.175678:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd35a00/0x14b4f8542d4f0eb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a61 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.175685:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35a00/0x14b4f8542d4f0eb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a61 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.175691:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd35a00, rc 0) 00000100:00100000:0.0:1746065112.175704:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881260669568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 59us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.175709:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9896 00000100:00100000:0.0:1746065112.175747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.175781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.175886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.175899:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260669184 00000100:00100000:0.0:1746065112.175901:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260669184 00000100:00100000:0.0:1746065112.175913:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260669440 00000100:00100000:0.0:1746065112.175914:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260669440 00000100:00100000:0.0:1746065112.175921:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9897 00000100:00100000:0.0:1746065112.175925:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881260669184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065112.175931:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.175937:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f0ebe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59a4c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065112.175947:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6d8, atime: 0x6812d6d8, ctime: 0x6812d6d8, blocks: 0x821 00010000:00010000:0.0:1746065112.175956:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.175957:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.175961:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f0ebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a4c expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.175969:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f0ebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a4c expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.175975:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd35c00, rc 0) 00000100:00100000:0.0:1746065112.175992:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881260669184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.175996:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9897 00000100:00100000:0.0:1746065112.176005:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9898 00000100:00100000:0.0:1746065112.176009:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881260669440:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065112.176014:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.176019:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd35200/0x14b4f8542d4f0ec5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59a5a expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065112.176030:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 4771328, mtime: 0x6812d6d8, atime: 0x6812d6d7, ctime: 0x6812d6d8, blocks: 0x139f 00010000:00010000:0.0:1746065112.176035:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.176036:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.176039:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd35200/0x14b4f8542d4f0ec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a5a expref: 35 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.176046:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd35200/0x14b4f8542d4f0ec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a5a expref: 35 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.176051:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd35200, rc 0) 00000100:00100000:0.0:1746065112.176062:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881260669440:12345-192.168.202.46@tcp:101:cat.0 Request processed in 53us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.176066:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9898 00000100:00100000:0.0:1746065112.177531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.177594:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260670080 00000100:00100000:1.0:1746065112.177599:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260670080 00000100:00100000:1.0:1746065112.177617:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3567 00000100:00100000:1.0:1746065112.177621:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094493450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28489:x1830881260670080:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065112.177710:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094493450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28489:x1830881260670080:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 88us (180us total) trans 8589942858 rc 0/0 00000100:00100000:1.0:1746065112.177715:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3567 00000100:00100000:0.0:1746065112.188680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.192889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.202626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.202667:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.202693:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.202714:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260670976 00000100:00100000:0.0:1746065112.202721:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260670976 00002000:00100000:0.0:1746065112.202759:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88008fd05f80 x1830881260670976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 504/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.202769:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05f80 with x1830881260670976 ext(0->1048575) 00002000:00010000:0.0:1746065112.202774:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05f80 00000100:00100000:0.0:1746065112.202800:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260671232 00000100:00100000:0.0:1746065112.202803:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260671232 00002000:00100000:0.0:1746065112.202838:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd04000 x1830881260671232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.202845:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04000 with x1830881260671232 ext(1048576->2097151) 00002000:00010000:0.0:1746065112.202847:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd04000 00000100:00100000:0.0:1746065112.202857:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260671488 00000100:00100000:0.0:1746065112.202859:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260671488 00002000:00100000:0.0:1746065112.202868:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88008fd05880 x1830881260671488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.202875:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05880 with x1830881260671488 ext(1048576->2097151) 00002000:00010000:0.0:1746065112.202878:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05880 00000100:00100000:0.0:1746065112.202889:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4442 00000100:00100000:0.0:1746065112.202895:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881260670976:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.203985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.204867:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4445 00000100:00100000:1.0:1746065112.204874:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881260671744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.214325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.214938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.214955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.214969:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.215358:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881260670976:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12461us (12737us total) trans 0 rc 962560/962560 00000100:00100000:0.0:1746065112.215369:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4442 00002000:00100000:0.0:1746065112.215379:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88008fd05f80 x1830881260670976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 504/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 962560/962560 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.215388:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05f80 with x1830881260670976 ext(0->1048575) 00002000:00010000:0.0:1746065112.215392:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05f80 00000100:00100000:0.0:1746065112.215412:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260672128 00000100:00100000:0.0:1746065112.215418:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260672128 00002000:00100000:0.0:1746065112.215455:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009009fb80 x1830881260672128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.215462:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009fb80 with x1830881260672128 ext(2097152->3145727) 00002000:00010000:0.0:1746065112.215465:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009fb80 00000100:00100000:0.0:1746065112.215475:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260672256 00000100:00100000:0.0:1746065112.215478:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260672256 00002000:00100000:0.0:1746065112.215486:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009009dc00 x1830881260672256/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.215492:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009dc00 with x1830881260672256 ext(3145728->4194303) 00002000:00010000:0.0:1746065112.215495:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009dc00 00000100:00100000:0.0:1746065112.215503:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260672640 00000100:00100000:0.0:1746065112.215505:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260672640 00002000:00100000:0.0:1746065112.215515:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009009d180 x1830881260672640/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.215521:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009d180 with x1830881260672640 ext(3145728->4194303) 00002000:00010000:0.0:1746065112.215523:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009009d180 00000100:00100000:0.0:1746065112.215530:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260672512 00000100:00100000:0.0:1746065112.215532:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260672512 00002000:00100000:0.0:1746065112.215540:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009009f480 x1830881260672512/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.215545:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009f480 with x1830881260672512 ext(2097152->3145727) 00002000:00010000:0.0:1746065112.215547:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009009f480 00000100:00100000:0.0:1746065112.215555:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4446 00000100:00100000:0.0:1746065112.215562:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260672128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065112.216831:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4447 00000100:00100000:1.0:1746065112.216840:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881260672256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.240690:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881260672128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25127us (26372us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065112.240698:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4446 00002000:00100000:0.0:1746065112.240703:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009009fb80 x1830881260672128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.240710:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009fb80 with x1830881260672128 ext(2097152->3145727) 00002000:00010000:0.0:1746065112.240714:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009fb80 00000100:00100000:1.0:1746065112.246381:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881260672256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29538us (31439us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.246390:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4447 00002000:00100000:1.0:1746065112.246398:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009009dc00 x1830881260672256/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.246407:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009dc00 with x1830881260672256 ext(3145728->4194303) 00002000:00010000:1.0:1746065112.246411:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009dc00 00000100:00100000:0.0:1746065112.250009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.256657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.256707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.257634:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260673152 00000100:00100000:1.0:1746065112.257640:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260673152 00000100:00100000:1.0:1746065112.257676:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260673024 00000100:00100000:1.0:1746065112.257678:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260673024 00000100:00100000:0.0:1746065112.257699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.257973:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260673280 00000100:00100000:0.0:1746065112.257976:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260673280 00010000:00010000:0.0:1746065112.257994:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0154600/0x14b4f8542d4f0ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a7d expref: 27 pid: 21235 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746065112.260733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.260762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.260790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.260835:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.260848:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260673536 00000100:00100000:0.0:1746065112.260851:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260673536 00002000:00100000:0.0:1746065112.260868:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009009d880 x1830881260673536/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.260875:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009d880 with x1830881260673536 ext(2097152->3145727) 00010000:00010000:0.0:1746065112.260882:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd35200/0x14b4f8542d4f0ec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a5a expref: 35 pid: 8427 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746065112.260894:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd35200/0x14b4f8542d4f0ec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a5a expref: 36 pid: 8427 timeout: 811 lvb_type: 1 00002000:00010000:0.0:1746065112.260899:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009009d880 00000100:00100000:0.0:1746065112.260910:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260674048 00000100:00100000:0.0:1746065112.260912:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260674048 00002000:00100000:0.0:1746065112.260923:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009009c700 x1830881260674048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.260928:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009c700 with x1830881260674048 ext(2097152->3145727) 00002000:00010000:0.0:1746065112.260931:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009009c700 00000100:00100000:0.0:1746065112.261132:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1397 00000100:00100000:0.0:1746065112.261140:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881260673792:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065112.262099:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4450 00000100:00100000:1.0:1746065112.262109:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260674176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.274233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.274935:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881260673792:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13795us (14142us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.274943:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1397 00002000:00100000:1.0:1746065112.274951:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009009c000 x1830881260673792/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.274959:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009c000 with x1830881260673792 ext(3145728->4194303) 00010000:00010000:1.0:1746065112.274965:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd35200/0x14b4f8542d4f0ec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a5a expref: 35 pid: 8427 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.274976:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd35200/0x14b4f8542d4f0ec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a5a expref: 35 pid: 8427 timeout: 811 lvb_type: 1 00002000:00010000:1.0:1746065112.274982:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009009c000 00000100:00100000:1.0:1746065112.278882:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260674176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16769us (18149us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.278892:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4450 00002000:00100000:1.0:1746065112.278902:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009009ed80 x1830881260674176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.278910:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009ed80 with x1830881260674176 ext(3145728->4194303) 00002000:00010000:1.0:1746065112.278915:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009009ed80 00000100:00100000:0.0:1746065112.283800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.287110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.287759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.290204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.293694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.293998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.294042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.294435:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9909 00000100:00100000:0.0:1746065112.294443:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260675584:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065112.294452:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.294465:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009facd600/0x14b4f8542d4f0f12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59aae expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065112.294503:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259584768:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065112.294554:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.295879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.296128:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260675840 00000100:00100000:1.0:1746065112.296133:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260675840 00000100:00100000:1.0:1746065112.296169:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9911 00000100:00100000:1.0:1746065112.296175:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+24:28493:x1830881260675840:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065112.296185:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.296196:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59abc expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.296214:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd35a00/0x14b4f8542d4f0eb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a61 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.296222:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0154400/0x14b4f8542d4f0ee8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a84 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.296227:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.296229:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.296232:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->2228223] (req 2097152->2228223) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.296252:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0154400/0x14b4f8542d4f0ee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a84 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.296261:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0154400/0x14b4f8542d4f0ee8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a84 expref: 25 pid: 8428 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.296276:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259584896:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065112.296330:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd35a00/0x14b4f8542d4f0eb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a61 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.296337:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35a00/0x14b4f8542d4f0eb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a61 expref: 28 pid: 8427 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.296346:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259585024:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.296362:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.299903:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259584768:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065112.299942:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009facd600/0x14b4f8542d4f0f12 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59aae expref: 25 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.299955:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009facd600/0x14b4f8542d4f0f12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59aae expref: 25 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.299979:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facd600, rc 0) 00000100:00100000:0.0:1746065112.300024:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881260675584:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5582us (6026us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065112.300033:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9909 00000100:00100000:0.0:1746065112.302641:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259584896:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065112.302649:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259585024:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065112.302671:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->2228223] (req 2097152->2228223) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.302687:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f54c600, rc 0) 00000100:00100000:0.0:1746065112.302705:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+25:28493:x1830881260675840:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6531us (6831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.302711:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9911 00000100:00100000:0.0:1746065112.302727:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260676096 00000100:00100000:0.0:1746065112.302729:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260676096 00000100:00100000:1.0:1746065112.302903:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9912 00000100:00100000:0.0:1746065112.302911:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9913 00000100:00100000:1.0:1746065112.302914:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260675968:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065112.302915:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260676096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065112.302928:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.302928:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.302939:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f54cc00/0x14b4f8542d4f0f27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59ac3 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.302939:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009facd000/0x14b4f8542d4f0f2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59aca expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.302958:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009facd000/0x14b4f8542d4f0f2e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59aca expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.302965:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009facd000/0x14b4f8542d4f0f2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59aca expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065112.302972:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259585152:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065112.302973:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facd000, rc 0) 00000100:00100000:0.0:1746065112.302987:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881260676096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 72us (311us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065112.302991:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9913 00000100:00100000:1.0:1746065112.303004:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.304230:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.304405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.304960:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4870 00000100:00100000:1.0:1746065112.304966:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260676480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.304972:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.304985:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0154400/0x14b4f8542d4f0ee8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a84 expref: 25 pid: 8428 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.304993:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0154400/0x14b4f8542d4f0ee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a84 expref: 25 pid: 8428 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.305004:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0154400/0x14b4f8542d4f0ee8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a84 expref: 25 pid: 8428 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.305019:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.305021:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.305026:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.305033:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.305054:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.305063:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259585280:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065112.305350:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.305385:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259585152:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065112.305401:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f54cc00/0x14b4f8542d4f0f27 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ac3 expref: 25 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.305409:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f54cc00/0x14b4f8542d4f0f27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ac3 expref: 25 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.305417:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f54cc00, rc 0) 00000100:00100000:1.0:1746065112.305446:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881260675968:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2533us (2795us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065112.305452:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9912 00000100:00100000:0.0:1746065112.306099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.306251:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260676608 00000100:00100000:1.0:1746065112.306255:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260676608 00000100:00100000:1.0:1746065112.306388:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9915 00000100:00100000:1.0:1746065112.306394:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:28496:x1830881260676608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065112.306405:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.306413:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f54c800/0x14b4f8542d4f0f3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59ad8 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.306438:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.306444:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065112.306445:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065112.306448:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f54c800/0x14b4f8542d4f0f3c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ad8 expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.306463:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.306471:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 24 pid: 4544 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.306479:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259585408:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.306853:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.308228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.308547:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259585280:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065112.308557:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.308590:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260676480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3624us (4185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.308598:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4870 00000100:00100000:1.0:1746065112.308648:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259585408:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065112.308664:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f54c800/0x14b4f8542d4f0f3c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ad8 expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.308974:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f54c800, rc 0) 00000100:00100000:1.0:1746065112.308991:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:28496:x1830881260676608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2598us (2894us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.308996:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9915 00000100:00100000:0.0:1746065112.312023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.312070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.316054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.316545:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260677504 00000100:00100000:1.0:1746065112.316551:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260677504 00010000:00010000:1.0:1746065112.316572:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 26 pid: 4544 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.316695:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4871 00000100:00100000:1.0:1746065112.316703:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881260677504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.316717:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065112.316731:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065112 -> 1746065113 00002000:00010000:1.0:1746065112.316733:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065112 -> 1746065113 00010000:00010000:1.0:1746065112.316738:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 26 pid: 4544 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.316748:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 26 pid: 4544 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.316767:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f54c600/0x14b4f8542d4f0f20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59abc expref: 26 pid: 4544 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.316783:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.316785:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.316790:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f54c800/0x14b4f8542d4f0f3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ad8 expref: 28 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.316797:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f54c800/0x14b4f8542d4f0f3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ad8 expref: 28 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.316849:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f54c800/0x14b4f8542d4f0f3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ad8 expref: 28 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.316859:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259585536:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065112.316930:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.319138:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259585536:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065112.319250:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.319288:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260677504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2585us (3236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.319296:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4871 00000100:00100000:0.0:1746065112.321686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.336158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.340659:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.353464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.358610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.364002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.413562:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.423596:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.425675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.426350:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3570 00000100:00100000:1.0:1746065112.426358:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+36:28506:x1830881260679424:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065112.426673:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+37:28506:x1830881260679424:12345-192.168.202.46@tcp:35:cat.0 Request processed in 314us (998us total) trans 8589942863 rc 0/0 00000100:00100000:1.0:1746065112.426679:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3570 00000100:00100000:0.0:1746065112.428346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.428454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.428510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.428521:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260679808 00000100:00100000:0.0:1746065112.428524:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260679808 00000100:00100000:0.0:1746065112.428538:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9920 00000100:00100000:0.0:1746065112.428542:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260679680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065112.428547:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.428552:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fa5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59b09 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.428565:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fa5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b09 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.428572:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fa5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b09 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.428587:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0155400, rc 0) 00000100:00100000:0.0:1746065112.428608:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260679680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (153us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065112.428613:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9920 00000100:00100000:0.0:1746065112.433616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.438210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.443795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.443930:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260680192 00000100:00100000:1.0:1746065112.443938:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260680192 00010000:00010000:1.0:1746065112.443963:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f54de00/0x14b4f8542d4f0e7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->413695) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a37 expref: 37 pid: 21235 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.443998:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4872 00000100:00100000:1.0:1746065112.444005:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881260680192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.444018:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.444034:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f54de00/0x14b4f8542d4f0e7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 327680->413695) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a37 expref: 37 pid: 21235 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.444044:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f54de00/0x14b4f8542d4f0e7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 327680->413695) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a37 expref: 37 pid: 21235 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.444064:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f54de00/0x14b4f8542d4f0e7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 327680->413695) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a37 expref: 37 pid: 21235 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.444239:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.444241:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.444248:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ea2800/0x14b4f8542d4f0fb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b17 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.444256:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ea2800/0x14b4f8542d4f0fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b17 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.444285:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093ea2800/0x14b4f8542d4f0fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b17 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.444300:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259585920:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065112.444894:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.447121:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259585920:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065112.447139:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.447177:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881260680192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3171us (3386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.447186:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4872 00000100:00100000:0.0:1746065112.452409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.452452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.452478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.452516:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.469061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.469094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.469280:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260681216 00000100:00100000:1.0:1746065112.469285:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260681216 00010000:00010000:1.0:1746065112.469308:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd34000/0x14b4f8542d4f0eb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a53 expref: 38 pid: 8427 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.469330:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260681344 00000100:00100000:1.0:1746065112.469331:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260681344 00010000:00010000:1.0:1746065112.469338:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f54d400/0x14b4f8542d4f0e55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a29 expref: 27 pid: 21998 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.469415:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4874 00000100:00100000:1.0:1746065112.469420:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881260681344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.469438:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.469450:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f54d400/0x14b4f8542d4f0e55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a29 expref: 27 pid: 21998 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.469459:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f54d400/0x14b4f8542d4f0e55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a29 expref: 27 pid: 21998 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.469476:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f54d400/0x14b4f8542d4f0e55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a29 expref: 27 pid: 21998 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.469490:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.469492:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.469498:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ea2400/0x14b4f8542d4f0fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b1e expref: 36 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.469505:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ea2400/0x14b4f8542d4f0fba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b1e expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.469531:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093ea2400/0x14b4f8542d4f0fba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b1e expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.469541:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259586304:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065112.469601:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.482296:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259586304:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065112.482313:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.482340:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260681344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 12920us (13244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.482348:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4874 00000100:00100000:0.0:1746065112.482421:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260681600 00000100:00100000:0.0:1746065112.482438:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260681600 00002000:00100000:0.0:1746065112.482464:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1835008->1839103) req@ffff880095350e00 x1830881260681600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.482472:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350e00 with x1830881260681600 ext(1835008->1839103) 00002000:00010000:0.0:1746065112.482475:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350e00 00000100:00100000:0.0:1746065112.482501:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4460 00000100:00100000:0.0:1746065112.482508:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881260681600:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065112.482636:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881260681600:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 128us (238us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065112.482642:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4460 00002000:00100000:0.0:1746065112.482647:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1835008->1839103) req@ffff880095350e00 x1830881260681600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.482653:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350e00 with x1830881260681600 ext(1835008->1839103) 00002000:00010000:0.0:1746065112.482656:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350e00 00000100:00100000:0.0:1746065112.487875:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.490543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.492535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.493581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.493899:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1401 00000100:00100000:0.0:1746065112.493911:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881260681984:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065112.496619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.496703:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260682624 00000100:00100000:0.0:1746065112.496710:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260682624 00000100:00100000:0.0:1746065112.496759:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8845 00000100:00100000:0.0:1746065112.496766:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28509:x1830881260682624:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065112.496785:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.496798:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154600/0x14b4f8542d4f0fcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59b3a expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.498408:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498437:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498451:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498463:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498468:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498473:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498565:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0fe4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498573:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498578:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065112.498603:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00000004:00200000:0.0:1746065112.498606:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065112.498617:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498624:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498630:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498634:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498643:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498647:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0155400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065112.498650:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498655:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498664:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065112.498667:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065112.498670:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498675:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155400/0x14b4f8542d4f0fd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498686:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498691:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498694:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498697:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0154800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065112.498699:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498703:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498711:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5a36200) 00010000:00010000:0.0:1746065112.498712:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065112.498714:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498717:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154800/0x14b4f8542d4f0fdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.498738:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0154600/0x14b4f8542d4f0fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b3a expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.498747:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b3a expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.498753:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065112.498755:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065112.498757:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0155e00, rc 0) 00000100:00100000:0.0:1746065112.498792:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28509:x1830881260682624:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2026us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.498797:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8845 00000100:00100000:0.0:1746065112.499063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.499522:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881260681984:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5615us (6986us total) trans 17179872660 rc 0/0 00000100:00100000:1.0:1746065112.499529:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1401 00002000:00100000:1.0:1746065112.499535:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1835008->2097151) req@ffff88009ba1c380 x1830881260681984/t17179872660(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.499542:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c380 with x1830881260681984 ext(1835008->2097151) 00010000:00010000:1.0:1746065112.499549:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093ea2400/0x14b4f8542d4f0fba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b1e expref: 39 pid: 21235 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.499560:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093ea2400/0x14b4f8542d4f0fba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b1e expref: 39 pid: 21235 timeout: 811 lvb_type: 0 00002000:00010000:1.0:1746065112.499565:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ba1c380 00000100:00100000:1.0:1746065112.499583:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260682880 00000100:00100000:1.0:1746065112.499586:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260682880 00000100:00100000:1.0:1746065112.499617:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3571 00000100:00100000:1.0:1746065112.499622:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:28503:x1830881260682880:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065112.500557:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:28503:x1830881260682880:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 931us (1491us total) trans 8589942865 rc 0/0 00000100:00100000:1.0:1746065112.500565:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3571 00000100:00100000:0.0:1746065112.502581:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.502613:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.502642:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.502669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.502683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.502695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.502703:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260683008 00000100:00100000:1.0:1746065112.502710:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260683008 00000100:00100000:0.0:1746065112.502724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.502740:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260683136 00000100:00100000:1.0:1746065112.502742:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260683136 00000100:00100000:1.0:1746065112.502751:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260683264 00000100:00100000:1.0:1746065112.502753:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260683264 00000100:00100000:1.0:1746065112.502761:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260683392 00000100:00100000:1.0:1746065112.502762:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260683392 00000100:00100000:1.0:1746065112.502771:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260683520 00000100:00100000:1.0:1746065112.502772:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260683520 00000100:00100000:1.0:1746065112.502777:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260683776 00000100:00100000:1.0:1746065112.502778:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260683776 00000100:00100000:1.0:1746065112.502788:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9926 00000100:00100000:1.0:1746065112.502794:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260683008:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065112.502808:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.502838:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f54d800/0x14b4f8542d4f1000 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59b41 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.502860:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.502862:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.502868:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f54d800/0x14b4f8542d4f1000 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b41 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.502881:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f54d800/0x14b4f8542d4f1000 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b41 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.502888:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f54d800, rc 0) 00000100:00100000:1.0:1746065112.502919:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260683008:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 125us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.502925:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9926 00000100:00100000:0.0:1746065112.503169:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9929 00000100:00100000:0.0:1746065112.503175:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260683392:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065112.503181:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.503187:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0154a00/0x14b4f8542d4f1015 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59b56 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.503212:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9931 00000100:00100000:1.0:1746065112.503219:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260683776:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065112.503226:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.503232:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f54d400/0x14b4f8542d4f1023 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59b64 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.503245:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.503246:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.503250:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f54d400/0x14b4f8542d4f1023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b64 expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.503259:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f54d400/0x14b4f8542d4f1023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b64 expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.503312:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f54d400, rc 0) 00000100:00100000:0.0:1746065112.503433:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259586688:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065112.503438:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260683776:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 219us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.503473:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9931 00000100:00100000:1.0:1746065112.503502:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260683648 00000100:00100000:1.0:1746065112.503505:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260683648 00010000:00010000:1.0:1746065112.503517:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ea2400/0x14b4f8542d4f0fba lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b1e expref: 43 pid: 21235 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.503537:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4875 00000100:00100000:1.0:1746065112.503542:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1959:x1830881260683648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.503550:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065112.503556:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832000 going to sleep for 11 seconds 00002000:00010000:1.0:1746065112.503562:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065112 -> 1746065113 00002000:00010000:1.0:1746065112.503564:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065112 -> 1746065113 00010000:00010000:1.0:1746065112.503569:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ea2400/0x14b4f8542d4f0fba lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b1e expref: 43 pid: 21235 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.503581:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ea2400/0x14b4f8542d4f0fba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b1e expref: 43 pid: 21235 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.503592:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.503594:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.503598:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe13e00/0x14b4f8542d4f0fc8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b2c expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.503604:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe13e00/0x14b4f8542d4f0fc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b2c expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.503618:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe13e00/0x14b4f8542d4f0fc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b2c expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.503625:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259586816:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065112.503645:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065112.505846:0:4545:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88009a4ead80 x1830881259586688) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880093ea2400/0x14b4f8542d4f0fba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b1e expref: 42 pid: 21235 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.505875:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259586688:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065112.505898:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0154a00/0x14b4f8542d4f1015 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b56 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.505910:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0154a00/0x14b4f8542d4f1015 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b56 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.505921:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0154a00, rc 0) 00000100:00100000:1.0:1746065112.505962:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260683392:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2787us (3291us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065112.505968:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9929 00000100:00100000:1.0:1746065112.506093:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259586816:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065112.506101:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.506297:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881260683648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2752us (3570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.506304:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4875 00000100:00100000:0.0:1746065112.507288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.507337:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260684416 00000100:00100000:1.0:1746065112.507343:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260684416 00002000:00100000:1.0:1746065112.507369:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009a4e9c00 x1830881260684416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.507377:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9c00 with x1830881260684416 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.507381:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e9c00 00000100:00100000:1.0:1746065112.507403:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4462 00000100:00100000:1.0:1746065112.507410:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260684416:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.510652:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.516101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.516173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.516194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.516224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.516548:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4877 00000100:00100000:1.0:1746065112.516554:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1960:x1830881260685312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.516562:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.516566:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0fe4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b3a expref: 15 pid: 24350 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.516573:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0155e00/0x14b4f8542d4f0fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b3a expref: 15 pid: 24350 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.516582:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065112.516585:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2cf400/0x14b4f8542d4f1046 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065112.516590:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2cf400/0x14b4f8542d4f1046 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065112.516594:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.516606:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881260685312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.516612:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4877 00000100:00100000:1.0:1746065112.517411:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260684416:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10000us (10124us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.517417:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4462 00002000:00100000:1.0:1746065112.517422:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009a4e9c00 x1830881260684416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.517437:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9c00 with x1830881260684416 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.517441:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e9c00 00000100:00100000:0.0:1746065112.522691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.522738:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.527585:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259587328:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065112.527609:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065112.527650:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260685696 00000100:00100000:0.0:1746065112.527655:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260685696 00010000:00010000:0.0:1746065112.527678:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2cf400/0x14b4f8542d4f1046 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b80 expref: 16 pid: 14643 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.527870:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4879 00000100:00100000:0.0:1746065112.527878:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1960:x1830881260685696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.527889:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.527894:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2cf400/0x14b4f8542d4f1046 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b80 expref: 16 pid: 14643 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.527907:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2cf400/0x14b4f8542d4f1046 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b80 expref: 16 pid: 14643 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.527924:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2cf400/0x14b4f8542d4f1046 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b80 expref: 16 pid: 14643 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.527938:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065112.527943:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065112.527950:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065112.527955:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065112.527970:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.528000:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1960:x1830881260685696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 123us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.528007:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4879 00010000:00010000:0.0:1746065112.528027:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065112.528032:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065112.528064:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00000004:00200000:0.0:1746065112.528068:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065112.528079:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065112.528106:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8dec00/0x14b4f8542d4f1054 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b87 expref: 15 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.528117:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b87 expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.528123:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065112.528125:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065112.528126:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8df600, rc 0) 00000100:00100000:0.0:1746065112.528923:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28509:x1830881260685440:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6118us (6236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.528929:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8848 00000100:00100000:1.0:1746065112.530384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.530436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.535534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.535631:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260686208 00000100:00100000:1.0:1746065112.535637:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260686208 00000100:00100000:1.0:1746065112.535671:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8849 00000100:00100000:1.0:1746065112.535678:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+36:28513:x1830881260686208:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065112.535694:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.535707:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35400/0x14b4f8542d4f1069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59b95 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.535771:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065112.535782:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b87 expref: 13 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.535788:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065112.535808:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b87 expref: 13 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.535831:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b87 expref: 13 pid: 14643 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.535840:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259587712:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.535887:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.535909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.536237:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260686336 00000100:00100000:0.0:1746065112.536241:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260686336 00000100:00100000:0.0:1746065112.536259:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260686464 00000100:00100000:0.0:1746065112.536260:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260686464 00000100:00100000:0.0:1746065112.536271:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9936 00000100:00100000:0.0:1746065112.536276:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260686336:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065112.536283:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.536291:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0155000/0x14b4f8542d4f1077 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59b9c expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.536303:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.536304:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.536311:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0155000/0x14b4f8542d4f1077 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b9c expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.536326:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0155000/0x14b4f8542d4f1077 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b9c expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.536334:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0155000, rc 0) 00000100:00100000:0.0:1746065112.536354:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260686336:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 78us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.536743:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9936 00000100:00100000:1.0:1746065112.538786:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259587712:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065112.538802:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065112.539120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.539155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.539195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.539333:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260686592 00000100:00100000:1.0:1746065112.539337:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260686592 00010000:00010000:1.0:1746065112.539353:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b87 expref: 14 pid: 14643 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.539370:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4880 00000100:00100000:1.0:1746065112.539375:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881260686592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.539383:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.539387:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b87 expref: 14 pid: 14643 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.539394:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b87 expref: 14 pid: 14643 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.539408:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f105b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b87 expref: 14 pid: 14643 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.539419:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065112.539422:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065112.539439:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065112.539445:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065112.539459:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.539474:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1959:x1830881260686592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 99us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.539480:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4880 00010000:00010000:1.0:1746065112.539495:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065112.539500:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065112.539514:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065112.539605:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35400/0x14b4f8542d4f1069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b95 expref: 39 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.539614:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b95 expref: 38 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.539619:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065112.539621:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065112.539622:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd34400, rc 0) 00000100:00100000:1.0:1746065112.539642:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+38:28513:x1830881260686208:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3964us (4269us total) trans 8589942867 rc 0/0 00000100:00100000:1.0:1746065112.539646:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8849 00000100:00100000:0.0:1746065112.540860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.540976:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260686976 00000100:00100000:1.0:1746065112.540980:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260686976 00010000:00010000:1.0:1746065112.541003:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffbd800/0x14b4f8542d4f0eef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a8b expref: 28 pid: 8851 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.541021:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4881 00000100:00100000:1.0:1746065112.541026:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260686976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.541035:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065112.541053:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065112 -> 1746065113 00010000:00010000:1.0:1746065112.541058:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffbd800/0x14b4f8542d4f0eef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a8b expref: 28 pid: 8851 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.541067:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffbd800/0x14b4f8542d4f0eef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a8b expref: 28 pid: 8851 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.541086:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffbd800/0x14b4f8542d4f0eef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a8b expref: 28 pid: 8851 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.541115:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.541144:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260686976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 117us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.541150:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4881 00000100:00100000:0.0:1746065112.542252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.553050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.553100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.556327:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.556503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.557473:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4466 00000100:00100000:1.0:1746065112.557481:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881260687872:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.557958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.557974:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260688384 00000100:00100000:0.0:1746065112.557977:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260688384 00002000:00100000:0.0:1746065112.557997:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009a4e8700 x1830881260688384/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.558004:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8700 with x1830881260688384 ext(2097152->3145727) 00002000:00010000:0.0:1746065112.558008:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8700 00000100:00100000:0.0:1746065112.558020:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4467 00000100:00100000:0.0:1746065112.558024:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881260688384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.560421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.560496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.560540:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260688768 00000100:00100000:0.0:1746065112.560548:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260688768 00010000:00010000:0.0:1746065112.560587:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b95 expref: 38 pid: 14643 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.560616:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4883 00000100:00100000:0.0:1746065112.560623:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+38:1961:x1830881260688768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.560636:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.560642:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b95 expref: 38 pid: 14643 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.560655:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd34400/0x14b4f8542d4f1070 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b95 expref: 38 pid: 14643 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.560679:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065112.560684:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b400/0x14b4f8542d4f10a1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065112.560694:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b400/0x14b4f8542d4f10a1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065112.560701:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b400/0x14b4f8542d4f10a1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065112.560719:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.560764:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+38:1961:x1830881260688768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 141us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.560770:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4883 00000100:00100000:0.0:1746065112.568225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.568331:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260689024 00000100:00100000:1.0:1746065112.568341:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260689024 00000100:00100000:1.0:1746065112.568402:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3572 00000100:00100000:1.0:1746065112.568410:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28509:x1830881260689024:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1746065112.568659:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:28509:x1830881260689024:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 249us (444us total) trans 8589942868 rc 0/0 00000100:00100000:1.0:1746065112.568666:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3572 00000100:00100000:0.0:1746065112.573111:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881260687616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19454us (19997us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065112.573125:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4464 00002000:00100000:0.0:1746065112.573138:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009a4e9880 x1830881260687616/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.573149:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9880 with x1830881260687616 ext(1048576->2097151) 00002000:00010000:0.0:1746065112.573155:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e9880 00000100:00100000:1.0:1746065112.575758:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+29:1959:x1830881260687872:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18262us (19239us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.575772:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4466 00002000:00100000:1.0:1746065112.575784:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ba1df80 x1830881260687872/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.575796:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1df80 with x1830881260687872 ext(2097152->3145727) 00002000:00010000:1.0:1746065112.575803:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1df80 00000100:00100000:0.0:1746065112.586992:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260689152 00000100:00100000:0.0:1746065112.587003:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260689152 00000100:00100000:0.0:1746065112.587047:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9939 00000100:00100000:0.0:1746065112.587055:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:28510:x1830881260689152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065112.587073:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.587091:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0154000/0x14b4f8542d4f10a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59bbf expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.587117:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.587119:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.587126:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0154000/0x14b4f8542d4f10a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bbf expref: 42 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.587140:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0154000/0x14b4f8542d4f10a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bbf expref: 42 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.587151:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0154000, rc 0) 00000100:00100000:0.0:1746065112.587198:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:28510:x1830881260689152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 143us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.587204:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9939 00000100:00100000:1.0:1746065112.587456:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260688384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29429us (29497us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.587464:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4467 00002000:00100000:1.0:1746065112.587474:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009a4e8700 x1830881260688384/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065112.589169:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+27:1959:x1830881260688000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31794us (32836us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065112.589179:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4465 00002000:00100000:0.0:1746065112.589188:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009ba1d180 x1830881260688000/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.589197:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d180 with x1830881260688000 ext(3145728->4194303) 00002000:00010000:0.0:1746065112.589203:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1d180 00002000:00100000:1.0:1746065112.589746:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8700 with x1830881260688384 ext(2097152->3145727) 00002000:00010000:1.0:1746065112.589749:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8700 00000100:00100000:0.0:1746065112.593027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.593171:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260689408 00000100:00100000:1.0:1746065112.593179:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260689408 00000100:00100000:0.0:1746065112.593184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:1.0:1746065112.593216:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012b45d500 x1830881260689408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.593224:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d500 with x1830881260689408 ext(2097152->3145727) 00002000:00010000:1.0:1746065112.593229:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45d500 00000100:00100000:1.0:1746065112.593386:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4469 00000100:00100000:1.0:1746065112.593394:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1960:x1830881260689408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065112.605702:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1960:x1830881260689408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12308us (12682us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.605708:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4469 00002000:00100000:1.0:1746065112.605714:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012b45d500 x1830881260689408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.605720:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d500 with x1830881260689408 ext(2097152->3145727) 00002000:00010000:1.0:1746065112.605723:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45d500 00000100:00100000:0.0:1746065112.626007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.629910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.637384:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.637421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.637469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.637549:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260690304 00000100:00100000:1.0:1746065112.637555:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260690304 00010000:00010000:1.0:1746065112.637583:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f13b800/0x14b4f8542d4f1085 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59baa expref: 43 pid: 8428 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.637605:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260690432 00000100:00100000:1.0:1746065112.637607:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260690432 00010000:00010000:1.0:1746065112.637616:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe13e00/0x14b4f8542d4f0fc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b2c expref: 27 pid: 8428 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746065112.637636:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260690176 00000100:00100000:1.0:1746065112.637638:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260690176 00010000:00010000:1.0:1746065112.637647:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0155000/0x14b4f8542d4f1077 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b9c expref: 10 pid: 4545 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.637660:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4884 00000100:00100000:1.0:1746065112.637666:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260690304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065112.637672:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4885 00010000:00010000:1.0:1746065112.637676:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065112.637680:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260690432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.637688:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.637693:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f13b800/0x14b4f8542d4f1085 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59baa expref: 43 pid: 8428 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.637699:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe13e00/0x14b4f8542d4f0fc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b2c expref: 27 pid: 8428 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.637702:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f13b800/0x14b4f8542d4f1085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59baa expref: 43 pid: 8428 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.637806:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe13e00/0x14b4f8542d4f0fc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b2c expref: 27 pid: 8428 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.637842:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f13b800/0x14b4f8542d4f1085 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59baa expref: 43 pid: 8428 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.637921:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe13e00/0x14b4f8542d4f0fc8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b2c expref: 27 pid: 8428 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746065112.637947:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065112.637967:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.637970:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065112.637977:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881260690304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 311us (598us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065112.637980:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffbd800/0x14b4f8542d4f10c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bcd expref: 42 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.637983:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4884 00010000:00010000:0.0:1746065112.637988:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffbd800/0x14b4f8542d4f10c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bcd expref: 42 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.638263:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffbd800/0x14b4f8542d4f10c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bcd expref: 41 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.638275:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259588480:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065112.638315:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.640403:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259588480:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065112.640420:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.640458:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881260690432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2780us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.640465:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4885 00000100:00100000:0.0:1746065112.640962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.641075:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260690688 00000100:00100000:1.0:1746065112.641080:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260690688 00002000:00100000:1.0:1746065112.641110:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (2019328->2023423) req@ffff88012b45c700 x1830881260690688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.641119:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c700 with x1830881260690688 ext(2019328->2023423) 00002000:00010000:1.0:1746065112.641123:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45c700 00000100:00100000:1.0:1746065112.641394:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4471 00000100:00100000:1.0:1746065112.641401:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1958:x1830881260690688:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065112.641538:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1958:x1830881260690688:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 137us (576us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065112.641543:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4471 00002000:00100000:1.0:1746065112.641547:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (2019328->2023423) req@ffff88012b45c700 x1830881260690688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.641554:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c700 with x1830881260690688 ext(2019328->2023423) 00002000:00010000:1.0:1746065112.641557:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45c700 00000100:00100000:0.0:1746065112.643256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.649767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.650467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.656777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.698120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.702163:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.704046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.707512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.708228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.709615:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259589248:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065112.709997:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259589376:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065112.710031:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f13ae00/0x14b4f8542d4f10ee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [528384->1048575] (req 528384->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59be2 expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.710046:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f13ae00, rc 0) 00000100:00100000:0.0:1746065112.710091:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:28513:x1830881260691840:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5396us (6049us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.710164:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9942 00000100:00100000:0.0:1746065112.710761:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260692224 00000100:00100000:0.0:1746065112.710767:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260692224 00010000:00010000:0.0:1746065112.710790:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ea2800/0x14b4f8542d4f0fb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b17 expref: 26 pid: 21235 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746065112.710837:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4891 00000100:00100000:0.0:1746065112.710843:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260692224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.710851:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.710865:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880093ea2800/0x14b4f8542d4f0fb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b17 expref: 26 pid: 21235 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.710872:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ea2800/0x14b4f8542d4f0fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b17 expref: 26 pid: 21235 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.710888:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ea2800/0x14b4f8542d4f0fb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b17 expref: 26 pid: 21235 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746065112.710914:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.710936:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881260692224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.710942:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4891 00000100:00100000:0.0:1746065112.711457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.711513:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260692352 00000100:00100000:1.0:1746065112.711517:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260692352 00010000:00010000:1.0:1746065112.711532:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ea3600/0x14b4f8542d4f1031 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b6b expref: 42 pid: 21998 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746065112.711562:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4892 00000100:00100000:1.0:1746065112.711567:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881260692352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.711575:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.711585:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880093ea3600/0x14b4f8542d4f1031 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b6b expref: 42 pid: 21998 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.711594:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ea3600/0x14b4f8542d4f1031 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b6b expref: 42 pid: 21998 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.711606:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ea3600/0x14b4f8542d4f1031 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b6b expref: 42 pid: 21998 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746065112.711671:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.711673:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.711680:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f13ae00/0x14b4f8542d4f10ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 528384->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59be2 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.711688:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f13ae00/0x14b4f8542d4f10ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 528384->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59be2 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.711712:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f13ae00/0x14b4f8542d4f10ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 528384->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59be2 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.711723:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259589504:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065112.711787:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.713224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.713342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.713456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.713504:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260692608 00000100:00100000:1.0:1746065112.713507:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260692608 00000100:00100000:1.0:1746065112.713525:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9944 00000100:00100000:1.0:1746065112.713530:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260692608:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065112.713538:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.713549:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd35000/0x14b4f8542d4f10f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59bf0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.713578:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259589632:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065112.713630:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.713656:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259589504:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065112.713666:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.713686:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881260692352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2115us (2226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.713693:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4892 00000100:00100000:0.0:1746065112.714098:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065112.716091:0:4545:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065112 -> 1746065113 00000100:00100000:1.0:1746065112.716108:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259589632:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065112.716129:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd35000/0x14b4f8542d4f10f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bf0 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.716139:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd35000/0x14b4f8542d4f10f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bf0 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.716159:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd35000, rc 0) 00000100:00100000:1.0:1746065112.716187:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260692608:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2657us (2731us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065112.716193:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9944 00000100:00100000:0.0:1746065112.720159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.722313:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.723759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.723773:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260693504 00000100:00100000:1.0:1746065112.723777:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260693504 00010000:00010000:1.0:1746065112.723793:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13aa00/0x14b4f8542d4f10e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bdb expref: 18 pid: 20754 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065112.723832:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4893 00000100:00100000:1.0:1746065112.723838:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1961:x1830881260693504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.723846:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.723852:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13aa00/0x14b4f8542d4f10e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bdb expref: 18 pid: 20754 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.723859:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13aa00/0x14b4f8542d4f10e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bdb expref: 18 pid: 20754 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.723873:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13aa00/0x14b4f8542d4f10e7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bdb expref: 18 pid: 20754 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.723884:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065112.723888:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a400/0x14b4f8542d4f1111 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.723895:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a400/0x14b4f8542d4f1111 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.723900:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a400/0x14b4f8542d4f1111 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.723911:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.723933:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1961:x1830881260693504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.723939:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4893 00000100:00100000:0.0:1746065112.728086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.729759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.729790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.730803:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4895 00000100:00100000:1.0:1746065112.730809:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881260694016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.730825:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.730834:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd34c00/0x14b4f8542d4f0ea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a45 expref: 29 pid: 8427 timeout: 812 lvb_type: 1 00010000:00010000:1.0:1746065112.730840:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd34c00/0x14b4f8542d4f0ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a45 expref: 29 pid: 8427 timeout: 812 lvb_type: 1 00010000:00010000:1.0:1746065112.730856:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd34c00/0x14b4f8542d4f0ea9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a45 expref: 29 pid: 8427 timeout: 812 lvb_type: 1 00010000:00010000:1.0:1746065112.730869:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.730888:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881260694016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.730893:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4895 00000100:00100000:0.0:1746065112.730950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.730995:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4896 00000100:00100000:0.0:1746065112.731001:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260694144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065112.731008:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065112.731016:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0154c00/0x14b4f8542d4f0ed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a6f expref: 27 pid: 21235 timeout: 812 lvb_type: 1 00010000:00010000:0.0:1746065112.731024:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0154c00/0x14b4f8542d4f0ed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a6f expref: 27 pid: 21235 timeout: 812 lvb_type: 1 00010000:00010000:0.0:1746065112.731035:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0154c00/0x14b4f8542d4f0ed3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a6f expref: 27 pid: 21235 timeout: 812 lvb_type: 1 00010000:00010000:0.0:1746065112.731046:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.731048:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065112.731053:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ea2c00/0x14b4f8542d4f1118 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c05 expref: 26 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.731061:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ea2c00/0x14b4f8542d4f1118 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c05 expref: 26 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.731083:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093ea2c00/0x14b4f8542d4f1118 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c05 expref: 26 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065112.731094:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259590400:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065112.731128:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.731452:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.731523:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260694400 00000100:00100000:1.0:1746065112.731526:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260694400 00000100:00100000:1.0:1746065112.731556:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3574 00000100:00100000:1.0:1746065112.731561:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:28521:x1830881260694400:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065112.731906:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:28521:x1830881260694400:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 344us (454us total) trans 8589942872 rc 0/0 00000100:00100000:1.0:1746065112.731912:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3574 00000100:00100000:1.0:1746065112.735252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.735331:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259590400:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065112.735349:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065112.735384:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881260694144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4383us (4432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.735393:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4896 00000100:00100000:1.0:1746065112.736290:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4474 00000100:00100000:1.0:1746065112.736298:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260694656:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065112.736979:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260694656:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 681us (1735us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065112.736985:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4474 00002000:00100000:1.0:1746065112.736990:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1511424->1515519) req@ffff88009ba1d880 x1830881260694656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/4536 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.736997:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d880 with x1830881260694656 ext(1511424->1515519) 00002000:00010000:1.0:1746065112.737001:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1d880 00000100:00100000:0.0:1746065112.740240:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.740303:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260694912 00000100:00100000:1.0:1746065112.740309:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260694912 00000100:00100000:1.0:1746065112.740356:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3575 00000100:00100000:1.0:1746065112.740364:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+37:28513:x1830881260694912:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065112.740543:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+38:28513:x1830881260694912:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 179us (309us total) trans 8589942873 rc 0/0 00000100:00100000:1.0:1746065112.740549:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3575 00000100:00100000:0.0:1746065112.826328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.828517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.828703:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260695168 00000100:00100000:1.0:1746065112.828709:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260695168 00000100:00100000:1.0:1746065112.828742:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9948 00000100:00100000:1.0:1746065112.828748:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260695168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065112.828756:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.828765:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd35e00/0x14b4f8542d4f113b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59c1a expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.828783:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd35e00/0x14b4f8542d4f113b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c1a expref: 28 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.828793:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd35e00/0x14b4f8542d4f113b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c1a expref: 28 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.828833:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd35e00, rc 0) 00000100:00100000:1.0:1746065112.828859:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260695168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 111us (343us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065112.828864:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9948 00000100:00100000:0.0:1746065112.836746:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259590528:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065112.836763:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ea3e00/0x14b4f8542d4f1134 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c13 expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.836771:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ea3e00/0x14b4f8542d4f1134 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c13 expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065112.836781:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ea3e00, rc 0) 00000100:00100000:0.0:1746065112.836801:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260695040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9274us (10482us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065112.836806:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9947 00000100:00100000:0.0:1746065112.846474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.846532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.846883:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260695808 00000100:00100000:1.0:1746065112.846892:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260695808 00002000:00100000:1.0:1746065112.846932:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->528383) req@ffff88009380d500 x1830881260695808/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.846941:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380d500 with x1830881260695808 ext(0->528383) 00002000:00010000:1.0:1746065112.846945:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009380d500 00000100:00100000:1.0:1746065112.846961:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260696064 00000100:00100000:1.0:1746065112.846964:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260696064 00002000:00100000:1.0:1746065112.846976:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1515520->2097151) req@ffff88009380ce00 x1830881260696064/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.846982:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380ce00 with x1830881260696064 ext(1515520->2097151) 00002000:00010000:1.0:1746065112.846985:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009380ce00 00000100:00100000:1.0:1746065112.846995:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4476 00000100:00100000:1.0:1746065112.847000:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881260696064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.848117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.853168:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260696320 00000100:00100000:0.0:1746065112.853175:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260696320 00000100:00100000:0.0:1746065112.853225:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8856 00000100:00100000:0.0:1746065112.853232:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:28530:x1830881260696320:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065112.853255:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.853269:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd25000/0x14b4f8542d4f115e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59c3d expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.853317:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853329:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853338:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853349:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853354:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853359:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853460:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853468:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853474:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065112.853502:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00000004:00200000:0.0:1746065112.853505:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065112.853517:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853524:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853529:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853534:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853539:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853543:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bd24e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065112.853547:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853551:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853559:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065112.853561:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065112.853563:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853567:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24e00/0x14b4f8542d4f1165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853579:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853583:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853587:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853590:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bd24c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065112.853592:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853596:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853600:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880135a7bc00) 00010000:00010000:0.0:1746065112.853601:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065112.853603:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853606:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f116c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.853625:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd25000/0x14b4f8542d4f115e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c3d expref: 19 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.853634:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c3d expref: 18 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.853638:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065112.853640:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065112.853642:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd24a00, rc 0) 00000100:00100000:0.0:1746065112.853679:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:28530:x1830881260696320:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 448us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065112.853685:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8856 00000100:00100000:1.0:1746065112.861475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.861504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.861517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.861531:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260696448 00000100:00100000:1.0:1746065112.861537:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260696448 00000100:00100000:1.0:1746065112.861568:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260696576 00000100:00100000:1.0:1746065112.861571:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260696576 00000100:00100000:1.0:1746065112.861593:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260696832 00000100:00100000:1.0:1746065112.861595:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260696832 00000100:00100000:1.0:1746065112.861608:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9953 00000100:00100000:1.0:1746065112.861614:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260696448:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065112.861628:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.861640:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd34c00/0x14b4f8542d4f117a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59c44 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.861683:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259591040:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065112.861744:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.861789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.861801:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260696960 00000100:00100000:1.0:1746065112.861803:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260696960 00000100:00100000:1.0:1746065112.861869:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9956 00000100:00100000:1.0:1746065112.861877:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260696960:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065112.861883:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.861889:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd34200/0x14b4f8542d4f118f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59c59 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.861908:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd34200/0x14b4f8542d4f118f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c59 expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.861918:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd34200/0x14b4f8542d4f118f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c59 expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.861939:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd34200, rc 0) 00000100:00100000:1.0:1746065112.861958:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260696960:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 83us (169us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065112.861964:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9956 00000100:00100000:1.0:1746065112.864474:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259591040:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065112.864488:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd34c00/0x14b4f8542d4f117a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c44 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.864500:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd34c00/0x14b4f8542d4f117a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c44 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.864506:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd34c00, rc 0) 00000100:00100000:1.0:1746065112.864524:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260696448:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2910us (3054us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065112.864529:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9953 00000100:00100000:0.0:1746065112.870984:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.874751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.874904:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260697472 00000100:00100000:1.0:1746065112.874910:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260697472 00010000:00010000:1.0:1746065112.874935:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c3d expref: 20 pid: 24350 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065112.875306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.875321:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260697600 00000100:00100000:0.0:1746065112.875324:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260697600 00002000:00100000:0.0:1746065112.875347:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (2019328->2097151) req@ffff88008f49d500 x1830881260697600/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.875356:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d500 with x1830881260697600 ext(2019328->2097151) 00010000:00010000:0.0:1746065112.875361:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ffbd800/0x14b4f8542d4f10c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bcd expref: 42 pid: 8427 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065112.875371:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ffbd800/0x14b4f8542d4f10c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59bcd expref: 42 pid: 8427 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065112.875377:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f49d500 00000100:00100000:0.0:1746065112.875395:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1405 00000100:00100000:0.0:1746065112.875401:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881260697600:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065112.875667:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4897 00000100:00100000:1.0:1746065112.875674:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+20:1961:x1830881260697472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.875682:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.875686:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c3d expref: 20 pid: 24350 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.875694:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c3d expref: 20 pid: 24350 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.875716:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24a00/0x14b4f8542d4f1173 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c3d expref: 20 pid: 24350 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.875728:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065112.875731:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a200/0x14b4f8542d4f119d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.875739:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a200/0x14b4f8542d4f119d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.875745:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a200/0x14b4f8542d4f119d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065112.875769:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065112.875787:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+19:1961:x1830881260697472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 115us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.875792:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4897 00000100:00100000:0.0:1746065112.879969:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.880625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.880751:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260697984 00000100:00100000:0.0:1746065112.880755:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260697984 00000100:00100000:0.0:1746065112.880907:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8859 00000100:00100000:0.0:1746065112.880915:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:28532:x1830881260697984:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065112.880925:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065112.880932:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24400/0x14b4f8542d4f11c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59c75 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065112.881309:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24200/0x14b4f8542d4f11c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.881316:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094187800/0x14b4f8542d4f11b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065112.881320:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24200/0x14b4f8542d4f11c7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065112.881328:0:24350:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094187800/0x14b4f8542d4f11b9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210400000020 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065112.881336:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24200/0x14b4f8542d4f11c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065112.882414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.882489:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260698112 00000100:00100000:1.0:1746065112.882495:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260698112 00010000:00010000:1.0:1746065112.882517:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f13ae00/0x14b4f8542d4f10ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 528384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59be2 expref: 28 pid: 8427 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065112.882615:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4898 00000100:00100000:1.0:1746065112.882622:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260698112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065112.882633:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065112.882649:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f13ae00/0x14b4f8542d4f10ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 528384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59be2 expref: 28 pid: 8427 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.882659:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f13ae00/0x14b4f8542d4f10ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 528384->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59be2 expref: 28 pid: 8427 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.882679:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f13ae00/0x14b4f8542d4f10ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 528384->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59be2 expref: 28 pid: 8427 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.882695:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.882697:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.882702:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f13a400/0x14b4f8542d4f1157 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c36 expref: 43 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.882708:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f13a400/0x14b4f8542d4f1157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c36 expref: 43 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.882729:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f13a400/0x14b4f8542d4f1157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c36 expref: 43 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065112.882740:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259591808:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065112.882802:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065112.883467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.885350:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.889394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.889439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.889499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065112.889683:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24200/0x14b4f8542d4f11c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.889689:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24200/0x14b4f8542d4f11c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065112.889704:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065112.889810:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24400/0x14b4f8542d4f11c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c75 expref: 281 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.889839:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24200/0x14b4f8542d4f11c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c75 expref: 280 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.889845:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065112.889848:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065112.889850:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd24200, rc 0) 00000100:00100000:1.0:1746065112.889873:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:28532:x1830881260697984:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8959us (9248us total) trans 8589942875 rc 0/0 00000100:00100000:1.0:1746065112.889879:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8859 00000100:00100000:0.0:1746065112.890627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.890654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.890672:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260699264 00000100:00100000:1.0:1746065112.890675:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260699264 00000100:00100000:0.0:1746065112.890683:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.890913:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260699136 00000100:00100000:1.0:1746065112.890916:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260699136 00000100:00100000:1.0:1746065112.890937:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9960 00000100:00100000:1.0:1746065112.890942:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260698752:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065112.890948:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.890955:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f11e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59c7c expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.890966:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.890968:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065112.890974:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f11e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c7c expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.890984:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f11e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c7c expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065112.890991:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd35400, rc 0) 00000100:00100000:1.0:1746065112.891007:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260698752:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 65us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065112.891013:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9960 00000100:00100000:0.0:1746065112.893304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.894104:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260699520 00000100:00100000:1.0:1746065112.894110:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260699520 00002000:00100000:1.0:1746065112.894136:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094ff4700 x1830881260699520/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.894144:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4700 with x1830881260699520 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.894148:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff4700 00000100:00100000:1.0:1746065112.894177:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4478 00000100:00100000:1.0:1746065112.894183:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881260699520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.902231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.903205:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260699904 00000100:00100000:1.0:1746065112.903210:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260699904 00000100:00100000:1.0:1746065112.903243:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8860 00000100:00100000:1.0:1746065112.903249:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:28530:x1830881260699904:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065112.903258:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.903267:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35a00/0x14b4f8542d4f11f8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59c9f expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.903333:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.903344:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24200/0x14b4f8542d4f11c7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c75 expref: 279 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.903350:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 4/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.903365:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24200/0x14b4f8542d4f11c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c75 expref: 279 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.903373:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd24200/0x14b4f8542d4f11c7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c75 expref: 279 pid: 24350 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065112.903380:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259592448:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065112.903534:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065112.907173:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881260699520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12974us (13853us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.907185:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4478 00002000:00100000:1.0:1746065112.907195:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094ff4700 x1830881260699520/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.907204:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4700 with x1830881260699520 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.907209:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff4700 00000100:00100000:1.0:1746065112.911877:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259592448:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065112.911897:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065112.911995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.912164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065112.912765:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.912771:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.912786:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.912791:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.912796:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.912804:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd35800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065112.912808:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.912832:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.912840:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065112.912842:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065112.912844:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.912848:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35800/0x14b4f8542d4f11ff lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.912880:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35a00/0x14b4f8542d4f11f8 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c9f expref: 19 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.912887:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd35a00/0x14b4f8542d4f11f8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c9f expref: 19 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.912895:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd35a00, rc 0) 00000100:00100000:1.0:1746065112.912912:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:28530:x1830881260699904:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 9664us (10721us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065112.912918:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8860 00000100:00100000:0.0:1746065112.913716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.914911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.915057:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260700544 00000100:00100000:1.0:1746065112.915061:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260700544 00000100:00100000:1.0:1746065112.915094:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3576 00000100:00100000:1.0:1746065112.915098:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:28530:x1830881260700544:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1746065112.915232:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+19:28530:x1830881260700544:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 132us (321us total) trans 8589942876 rc 0/0 00000100:00100000:1.0:1746065112.915237:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3576 00000100:00100000:0.0:1746065112.915431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.918416:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.918482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.922434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.923912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.923946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.923959:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260701568 00000100:00100000:0.0:1746065112.923963:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260701568 00002000:00100000:0.0:1746065112.923979:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3366912->3371007) req@ffff88012d7fc380 x1830881260701568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.923986:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fc380 with x1830881260701568 ext(3366912->3371007) 00002000:00010000:0.0:1746065112.923989:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fc380 00000100:00100000:0.0:1746065112.923997:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260701312 00000100:00100000:0.0:1746065112.923998:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260701312 00002000:00100000:0.0:1746065112.924006:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1515519) req@ffff88012d7fdf80 x1830881260701312/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065112.924011:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fdf80 with x1830881260701312 ext(1048576->1515519) 00010000:00010000:0.0:1746065112.924015:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093ea2c00/0x14b4f8542d4f1118 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c05 expref: 26 pid: 21235 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065112.924022:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093ea2c00/0x14b4f8542d4f1118 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c05 expref: 26 pid: 21235 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065112.924027:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d7fdf80 00000100:00100000:0.0:1746065112.924034:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1407 00000100:00100000:0.0:1746065112.924038:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881260701312:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065112.928070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.928251:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.930248:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260701312:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6205us (6297us total) trans 21474839908 rc 0/0 00000100:00100000:1.0:1746065112.930257:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1407 00002000:00100000:1.0:1746065112.930265:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1515519) req@ffff88012d7fdf80 x1830881260701312/t21474839908(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/448 e 0 to 0 dl 1746065123 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.930273:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fdf80 with x1830881260701312 ext(1048576->1515519) 00010000:00010000:1.0:1746065112.930280:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093ea2c00/0x14b4f8542d4f1118 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c05 expref: 28 pid: 21235 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.930293:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093ea2c00/0x14b4f8542d4f1118 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c05 expref: 28 pid: 21235 timeout: 812 lvb_type: 0 00002000:00010000:1.0:1746065112.930299:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d7fdf80 00000100:00100000:1.0:1746065112.936711:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.936730:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260702336 00000100:00100000:1.0:1746065112.936735:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260702336 00002000:00100000:1.0:1746065112.936764:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880135cdd180 x1830881260702336/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.936772:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd180 with x1830881260702336 ext(2097152->3145727) 00002000:00010000:1.0:1746065112.936776:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdd180 00000100:00100000:1.0:1746065112.936790:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4481 00000100:00100000:1.0:1746065112.936797:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881260702336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065112.947778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.948143:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881260702336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11345us (11434us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.948151:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4481 00002000:00100000:1.0:1746065112.948161:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880135cdd180 x1830881260702336/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.948169:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd180 with x1830881260702336 ext(2097152->3145727) 00002000:00010000:1.0:1746065112.948173:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdd180 00000100:00100000:1.0:1746065112.948187:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260702592 00000100:00100000:1.0:1746065112.948192:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260702592 00002000:00100000:1.0:1746065112.948216:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012d7ff480 x1830881260702592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.948222:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff480 with x1830881260702592 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.948225:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7ff480 00000100:00100000:1.0:1746065112.948248:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4482 00000100:00100000:1.0:1746065112.948254:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260702592:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065112.956335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.956847:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260702592:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8590us (9068us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.956855:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4482 00002000:00100000:1.0:1746065112.956863:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012d7ff480 x1830881260702592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.956871:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff480 with x1830881260702592 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.956874:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7ff480 00000100:00100000:0.0:1746065112.958285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.958374:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260702848 00000100:00100000:1.0:1746065112.958378:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260702848 00002000:00100000:1.0:1746065112.958404:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3211264->3371007) req@ffff88012d7fed80 x1830881260702848/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.958417:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fed80 with x1830881260702848 ext(3211264->3371007) 00010000:00010000:1.0:1746065112.958430:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f212600/0x14b4f8542d4f11f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3211264->18446744073709551615] (req 3211264->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c98 expref: 44 pid: 8428 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065112.958441:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f212600/0x14b4f8542d4f11f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3211264->18446744073709551615] (req 3211264->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c98 expref: 44 pid: 8428 timeout: 812 lvb_type: 0 00002000:00010000:1.0:1746065112.958447:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d7fed80 00000100:00100000:1.0:1746065112.958469:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1408 00000100:00100000:1.0:1746065112.958475:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881260702848:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065112.962505:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.962569:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260703104 00000100:00100000:1.0:1746065112.962577:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260703104 00000100:00100000:1.0:1746065112.962628:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8861 00000100:00100000:1.0:1746065112.962635:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+38:28536:x1830881260703104:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065112.962653:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065112.962668:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a000/0x14b4f8542d4f121b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59cbb expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.962745:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f1222 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.962757:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f1222 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065112.962767:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f1222 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065112.962777:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065112.962887:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a000/0x14b4f8542d4f121b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cbb expref: 41 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.962905:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f1222 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cbb expref: 40 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065112.962912:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065112.962915:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065112.962918:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f13b800, rc 0) 00000100:00100000:1.0:1746065112.962952:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+40:28536:x1830881260703104:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 318us (456us total) trans 8589942878 rc 0/0 00000100:00100000:1.0:1746065112.962958:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8861 00000100:00100000:0.0:1746065112.965059:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.970326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.970879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.970903:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260703616 00000100:00100000:1.0:1746065112.970906:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260703616 00002000:00100000:1.0:1746065112.970935:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880135cdf480 x1830881260703616/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.970944:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf480 with x1830881260703616 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.970948:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdf480 00000100:00100000:1.0:1746065112.970959:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4483 00000100:00100000:1.0:1746065112.970964:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1958:x1830881260703616:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065112.979104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.982508:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1958:x1830881260703616:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11536us (11626us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065112.982519:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4483 00002000:00100000:1.0:1746065112.982528:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880135cdf480 x1830881260703616/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.982537:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf480 with x1830881260703616 ext(1048576->2097151) 00002000:00010000:1.0:1746065112.982541:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdf480 00000100:00100000:0.0:1746065112.991901:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.998845:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065112.998892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065112.998921:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260704256 00000100:00100000:1.0:1746065112.998929:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260704256 00002000:00100000:1.0:1746065112.998964:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880095356680 x1830881260704256/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/0 e 0 to 0 dl 1746065123 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065112.998973:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356680 with x1830881260704256 ext(2097152->3145727) 00002000:00010000:1.0:1746065112.998978:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095356680 00000100:00100000:1.0:1746065112.999004:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4485 00000100:00100000:1.0:1746065112.999011:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1959:x1830881260704256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065113.008289:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1959:x1830881260704256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9269us (9467us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065113.008299:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4485 00002000:00100000:1.0:1746065113.008308:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880095356680 x1830881260704256/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:28/0 lens 488/440 e 0 to 0 dl 1746065123 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.008315:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356680 with x1830881260704256 ext(2097152->3145727) 00002000:00010000:1.0:1746065113.008320:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095356680 00000100:00100000:0.0:1746065113.025783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.029755:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.029884:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260705280 00000100:00100000:1.0:1746065113.029893:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260705280 00002000:00100000:1.0:1746065113.029935:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4771839) req@ffff880095354e00 x1830881260705280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.029943:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354e00 with x1830881260705280 ext(4194304->4771839) 00002000:00010000:1.0:1746065113.029949:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354e00 00000100:00100000:1.0:1746065113.029974:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4488 00000100:00100000:1.0:1746065113.029983:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881260705280:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065113.053775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.053853:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260705408 00000100:00100000:1.0:1746065113.053861:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260705408 00000100:00100000:0.0:1746065113.054101:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9970 00000100:00100000:0.0:1746065113.054108:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+29:28536:x1830881260705408:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065113.054124:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.054139:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd25a00/0x14b4f8542d4f124c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59cde expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.054165:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ea3400/0x14b4f8542d4f11a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c67 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.054173:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f213200/0x14b4f8542d4f1230 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cc2 expref: 46 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.054186:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ea2200/0x14b4f8542d4f11ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c8a expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.054192:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.054193:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.054196:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd25a00/0x14b4f8542d4f124c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1798144->2097151] (req 1798144->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cde expref: 30 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.054219:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ea2200/0x14b4f8542d4f11ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c8a expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.054229:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ea2200/0x14b4f8542d4f11ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c8a expref: 9 pid: 25185 timeout: 812 lvb_type: 1 00000100:00100000:0.0:1746065113.054238:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095356300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259593472:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065113.054326:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f213200/0x14b4f8542d4f1230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cc2 expref: 46 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.054334:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f213200/0x14b4f8542d4f1230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cc2 expref: 46 pid: 8427 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.054341:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259593600:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065113.054360:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ea3400/0x14b4f8542d4f11a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c67 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.054371:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ea3400/0x14b4f8542d4f11a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c67 expref: 30 pid: 8428 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.054377:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259593728:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065113.054388:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.056619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.056672:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260705664 00000100:00100000:1.0:1746065113.056677:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260705664 00000100:00100000:0.0:1746065113.056683:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095356300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259593472:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065113.056701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.056719:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259593600:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.056726:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8862 00000100:00100000:1.0:1746065113.056733:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:28538:x1830881260705664:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:0.0:1746065113.056744:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259593728:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.056749:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.056761:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb30400/0x14b4f8542d4f1253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59ce5 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.056766:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd25a00/0x14b4f8542d4f124c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1798144->2097151] (req 1798144->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cde expref: 30 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.056776:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd25a00, rc 0) 00000100:00100000:0.0:1746065113.056802:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+30:28536:x1830881260705408:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2694us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.056808:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9970 00010000:00010000:1.0:1746065113.057207:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb30200/0x14b4f8542d4f125a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.057219:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb30200/0x14b4f8542d4f125a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.057228:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb30200/0x14b4f8542d4f125a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065113.057235:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065113.057319:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb30400/0x14b4f8542d4f1253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ce5 expref: 283 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.057335:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb30200/0x14b4f8542d4f125a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ce5 expref: 282 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.057341:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065113.057344:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065113.057346:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb30200, rc 0) 00000100:00100000:1.0:1746065113.057365:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:28538:x1830881260705664:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 634us (753us total) trans 8589942879 rc 0/0 00000100:00100000:1.0:1746065113.057371:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8862 00000100:00100000:0.0:1746065113.059931:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.060065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.064528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.067508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.073983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.075336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.075395:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260706560 00000100:00100000:0.0:1746065113.075399:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260706560 00010000:00010000:0.0:1746065113.075414:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f212c00/0x14b4f8542d4f1206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ca6 expref: 29 pid: 8428 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746065113.075442:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4913 00000100:00100000:0.0:1746065113.075447:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881260706560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065113.075455:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065113.075465:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f212c00/0x14b4f8542d4f1206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ca6 expref: 29 pid: 8428 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.075472:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f212c00/0x14b4f8542d4f1206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ca6 expref: 29 pid: 8428 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.075484:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f212c00/0x14b4f8542d4f1206 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ca6 expref: 29 pid: 8428 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.075496:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065113.075515:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260706560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.075519:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4913 00000100:00100000:0.0:1746065113.083904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.148755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.152785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.154356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.159454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.171004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.171053:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.171143:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260707840 00000100:00100000:1.0:1746065113.171150:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260707840 00000100:00100000:1.0:1746065113.171238:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260707968 00000100:00100000:1.0:1746065113.171241:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260707968 00000100:00100000:1.0:1746065113.171306:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9974 00000100:00100000:1.0:1746065113.171311:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:28538:x1830881260707968:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065113.171319:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.171328:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb30400/0x14b4f8542d4f127d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d01 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.171344:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f0ebe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a4c expref: 30 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.171352:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f13a800/0x14b4f8542d4f100e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b4f expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.171358:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffbde00/0x14b4f8542d4f0eda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a76 expref: 28 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.171363:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.171365:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.171369:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb30400/0x14b4f8542d4f127d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->1224703] (req 1048576->1224703) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d01 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.171385:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffbde00/0x14b4f8542d4f0eda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a76 expref: 28 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.171401:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ffbde00/0x14b4f8542d4f0eda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a76 expref: 28 pid: 4544 timeout: 812 lvb_type: 1 00000100:00100000:1.0:1746065113.171410:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259595008:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.173306:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f13a800/0x14b4f8542d4f100e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b4f expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.173318:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f13a800/0x14b4f8542d4f100e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59b4f expref: 10 pid: 8428 timeout: 812 lvb_type: 1 00000100:00100000:1.0:1746065113.173328:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259595136:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.173359:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f0ebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a4c expref: 30 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.173366:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f0ebe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59a4c expref: 30 pid: 8427 timeout: 812 lvb_type: 1 00000100:00100000:1.0:1746065113.173372:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259595264:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.173386:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.176318:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259595008:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.176330:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259595136:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.176336:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259595264:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.176363:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb30400/0x14b4f8542d4f127d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->1224703] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d01 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.176377:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb30400, rc 0) 00000100:00100000:1.0:1746065113.176434:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28538:x1830881260707968:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5122us (5380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.176442:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9974 00000100:00100000:0.0:1746065113.176639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.176675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.178599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.181878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.187456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.200551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.206859:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.227587:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.233216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.238723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.242291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.242331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.243190:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.245513:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.245600:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260710272 00000100:00100000:1.0:1746065113.245606:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260710272 00002000:00100000:1.0:1746065113.245636:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (2723840->2727935) req@ffff88012b4b2300 x1830881260710272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.245645:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b2300 with x1830881260710272 ext(2723840->2727935) 00002000:00010000:1.0:1746065113.245649:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4b2300 00000100:00100000:1.0:1746065113.245675:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4495 00000100:00100000:1.0:1746065113.245681:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881260710272:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065113.245812:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881260710272:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 131us (299us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065113.245857:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4495 00002000:00100000:1.0:1746065113.245862:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (2723840->2727935) req@ffff88012b4b2300 x1830881260710272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/4536 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.245876:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b2300 with x1830881260710272 ext(2723840->2727935) 00002000:00010000:1.0:1746065113.245879:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4b2300 00000100:00100000:0.0:1746065113.250434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.257079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.261294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.267027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.267061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.267074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.267087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.267106:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260710912 00000100:00100000:1.0:1746065113.267113:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260710912 00000100:00100000:1.0:1746065113.267143:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260711040 00000100:00100000:1.0:1746065113.267145:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260711040 00000100:00100000:1.0:1746065113.267154:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260711168 00000100:00100000:1.0:1746065113.267156:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260711168 00000100:00100000:1.0:1746065113.267166:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260711296 00000100:00100000:1.0:1746065113.267167:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260711296 00000100:00100000:1.0:1746065113.267179:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9978 00000100:00100000:1.0:1746065113.267186:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881260710912:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065113.267203:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.267217:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b3da00/0x14b4f8542d4f1299 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d1d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065113.267235:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9979 00010000:00010000:1.0:1746065113.267236:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.267238:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065113.267242:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881260711040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065113.267245:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b3da00/0x14b4f8542d4f1299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d1d expref: 33 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.267248:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.267255:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd24c00/0x14b4f8542d4f12a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d24 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.267259:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b3da00/0x14b4f8542d4f1299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d1d expref: 33 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.267271:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b3da00, rc 0) 00000100:00100000:0.0:1746065113.267284:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259596416:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065113.267303:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881260710912:12345-192.168.202.46@tcp:101:cat.0 Request processed in 118us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.267309:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9978 00000100:00100000:1.0:1746065113.267322:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9980 00000100:00100000:1.0:1746065113.267326:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1959:x1830881260711168:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065113.267328:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065113.267332:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.267339:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129b3d200/0x14b4f8542d4f12a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d2b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065113.267356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.267359:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259596544:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065113.267371:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260711424 00000100:00100000:0.0:1746065113.267374:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260711424 00000100:00100000:1.0:1746065113.267376:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.267389:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9981 00000100:00100000:0.0:1746065113.267393:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881260711296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065113.267399:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.267405:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd24000/0x14b4f8542d4f12ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d32 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065113.267433:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259596672:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065113.267454:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.268023:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9982 00000100:00100000:1.0:1746065113.268029:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881260711424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065113.268035:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.268041:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b3d000/0x14b4f8542d4f12b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d39 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065113.268256:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259596800:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065113.268762:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746065113.274253:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065113 -> 1746065114 00002000:00010000:0.0:1746065113.274259:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065111 -> 1746065114 00002000:00010000:0.0:1746065113.274261:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065113 -> 1746065114 00000100:00100000:0.0:1746065113.274280:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259596672:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065113.274310:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd24000/0x14b4f8542d4f12ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d32 expref: 48 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.274321:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bd24000/0x14b4f8542d4f12ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d32 expref: 48 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.274335:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd24000, rc 0) 00000100:00100000:0.0:1746065113.274370:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881260711296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6975us (7281us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065113.274378:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9981 00002000:00010000:1.0:1746065113.274963:0:8427:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065113 -> 1746065114 00002000:00010000:1.0:1746065113.274966:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065113 -> 1746065114 00002000:00010000:1.0:1746065113.274968:0:8427:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065113 -> 1746065114 00000100:00100000:1.0:1746065113.274977:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259596544:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065113.274992:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129b3d200/0x14b4f8542d4f12a7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d2b expref: 46 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.275000:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129b3d200/0x14b4f8542d4f12a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d2b expref: 46 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.275010:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b3d200, rc 0) 00000100:00100000:1.0:1746065113.275029:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1959:x1830881260711168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7702us (7953us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065113.275034:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9980 00002000:00010000:1.0:1746065113.275060:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065113 -> 1746065114 00002000:00010000:1.0:1746065113.275062:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065111 -> 1746065114 00002000:00010000:1.0:1746065113.275064:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065113 -> 1746065114 00000100:00100000:1.0:1746065113.275071:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259596800:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065113.275082:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b3d000/0x14b4f8542d4f12b5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d39 expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.275089:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b3d000/0x14b4f8542d4f12b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d39 expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.275095:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b3d000, rc 0) 00000100:00100000:1.0:1746065113.275111:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881260711424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7083us (7754us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065113.275116:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9982 00000100:00100000:0.0:1746065113.275973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.285222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.285255:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.285276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.285288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.285306:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260711808 00000100:00100000:0.0:1746065113.285313:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260711808 00000100:00100000:0.0:1746065113.285857:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260711680 00000100:00100000:0.0:1746065113.285860:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260711680 00000100:00100000:0.0:1746065113.285875:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260711936 00000100:00100000:0.0:1746065113.285877:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260711936 00000100:00100000:0.0:1746065113.286016:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9984 00000100:00100000:0.0:1746065113.286022:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260711680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065113.286030:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.286038:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd25600/0x14b4f8542d4f12c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d40 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.286049:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.286051:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.286058:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd25600/0x14b4f8542d4f12c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d40 expref: 35 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.286070:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd25600/0x14b4f8542d4f12c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d40 expref: 35 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.286078:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd25600, rc 0) 00000100:00100000:0.0:1746065113.286097:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881260711680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 75us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.286102:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9984 00000100:00100000:0.0:1746065113.286119:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9986 00000100:00100000:0.0:1746065113.286123:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881260711936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065113.286128:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.286133:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd25000/0x14b4f8542d4f12d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d4e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065113.286156:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259597312:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065113.286171:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.292809:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259597312:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065113.292856:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd25000/0x14b4f8542d4f12d1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d4e expref: 48 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.292869:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bd25000/0x14b4f8542d4f12d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d4e expref: 48 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.292883:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd25000, rc 0) 00000100:00100000:1.0:1746065113.292917:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881260711936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6792us (7627us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065113.292924:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9986 00000100:00100000:0.0:1746065113.299298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.299344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.300017:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4498 00000100:00100000:1.0:1746065113.300024:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260712576:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065113.319241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.319605:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260712576:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 19580us (20258us total) trans 0 rc 749568/749568 00000100:00100000:1.0:1746065113.319615:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4498 00002000:00100000:1.0:1746065113.319626:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1798143) req@ffff88009c3faa00 x1830881260712576/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/440 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 749568/749568 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.319634:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830881260712576 ext(1048576->1798143) 00002000:00010000:1.0:1746065113.319639:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:0.0:1746065113.319896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.320131:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260712832 00000100:00100000:1.0:1746065113.320138:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260712832 00002000:00100000:1.0:1746065113.320165:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009c3fa300 x1830881260712832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.320172:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830881260712832 ext(1048576->2097151) 00002000:00010000:1.0:1746065113.320176:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa300 00000100:00100000:1.0:1746065113.320193:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260713088 00000100:00100000:1.0:1746065113.320195:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260713088 00002000:00100000:1.0:1746065113.320204:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009c3f9c00 x1830881260713088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.320210:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9c00 with x1830881260713088 ext(1048576->2097151) 00000100:00100000:0.0:1746065113.320210:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4499 00002000:00010000:1.0:1746065113.320213:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9c00 00000100:00100000:0.0:1746065113.320217:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260712832:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065113.320222:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4500 00000100:00100000:1.0:1746065113.320226:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260713088:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065113.345321:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.345355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.345617:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260713216 00000100:00100000:1.0:1746065113.345625:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260713216 00000100:00100000:1.0:1746065113.345680:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8863 00000100:00100000:1.0:1746065113.345687:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+19:28555:x1830881260713216:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065113.345707:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.345721:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90a00/0x14b4f8542d4f12d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d5c expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.345771:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.345781:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.345789:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.345801:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.345808:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.345812:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.345932:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.345940:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f1222 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cbb expref: 39 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.345946:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb30200/0x14b4f8542d4f125a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ce5 expref: 281 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.345951:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 5/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.345975:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb30200/0x14b4f8542d4f125a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ce5 expref: 281 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.345984:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb30200/0x14b4f8542d4f125a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ce5 expref: 281 pid: 24350 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065113.345993:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259597440:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.346045:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f1222 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cbb expref: 39 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.346053:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13b800/0x14b4f8542d4f1222 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cbb expref: 39 pid: 24350 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065113.346066:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259597568:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.347349:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.349168:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259597440:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065113.349305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.349355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.349369:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260713728 00000100:00100000:0.0:1746065113.349371:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260713728 00000100:00100000:0.0:1746065113.349407:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3578 00000100:00100000:0.0:1746065113.349412:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+40:7710:x1830881260713728:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065113.349592:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+41:7710:x1830881260713728:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 179us (236us total) trans 8589942880 rc 0/0 00000100:00100000:0.0:1746065113.349597:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3578 00000100:00100000:1.0:1746065113.350227:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259597568:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.350243:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065113.351396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.352482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065113.356104:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356114:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065113.356150:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00000004:00200000:1.0:1746065113.356153:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065113.356166:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356175:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356182:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356187:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356191:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356200:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6d90c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065113.356203:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356209:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356218:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065113.356221:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065113.356224:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356228:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90c00/0x14b4f8542d4f12df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356251:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356255:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356259:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356262:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6d90e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065113.356264:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356267:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356272:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6fd00) 00010000:00010000:1.0:1746065113.356274:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065113.356277:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356281:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90e00/0x14b4f8542d4f12e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.356308:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90a00/0x14b4f8542d4f12d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d5c expref: 21 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.356318:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d5c expref: 20 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.356323:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065113.356324:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065113.356327:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6d91000, rc 0) 00000100:00100000:1.0:1746065113.356357:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+20:28555:x1830881260713216:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 10671us (11044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.356363:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8863 00000100:00100000:0.0:1746065113.361644:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.361688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.365911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.365936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.365949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.365962:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.365981:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260714368 00000100:00100000:1.0:1746065113.365989:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260714368 00000100:00100000:1.0:1746065113.366025:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260714496 00000100:00100000:1.0:1746065113.366028:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260714496 00000100:00100000:0.0:1746065113.366029:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260714624 00000100:00100000:0.0:1746065113.366033:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260714624 00000100:00100000:1.0:1746065113.366036:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260714752 00000100:00100000:1.0:1746065113.366038:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260714752 00000100:00100000:1.0:1746065113.366048:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9990 00000100:00100000:0.0:1746065113.366053:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9991 00000100:00100000:1.0:1746065113.366055:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260714368:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:0.0:1746065113.366058:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260714496:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065113.366075:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065113.366076:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9992 00000100:00100000:1.0:1746065113.366079:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260714752:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065113.366084:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.366090:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d7f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.366092:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6d91400/0x14b4f8542d4f1310 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d8d expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.366107:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.366109:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.366115:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d7f expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.366126:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d7f expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065113.366129:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259597952:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065113.366134:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb30800, rc 0) 00000100:00100000:0.0:1746065113.366172:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260714496:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.366178:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9991 00000100:00100000:0.0:1746065113.366193:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9993 00000100:00100000:0.0:1746065113.366197:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260714624:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065113.366202:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.366209:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb30e00/0x14b4f8542d4f1317 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d86 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065113.366226:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259598080:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065113.367376:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.367388:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb31400/0x14b4f8542d4f131e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d78 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065113.367391:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746065113.367402:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.367403:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.367409:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb31400/0x14b4f8542d4f131e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d78 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.367431:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb31400/0x14b4f8542d4f131e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d78 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065113.367439:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb31400, rc 0) 00000100:00100000:0.0:1746065113.367456:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260714368:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1401us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.367461:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9990 00000100:00100000:0.0:1746065113.367479:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.368030:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260714880 00000100:00100000:0.0:1746065113.368036:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260714880 00000100:00100000:0.0:1746065113.368068:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9994 00000100:00100000:0.0:1746065113.368074:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260714880:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065113.368084:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065113.368091:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb30600/0x14b4f8542d4f1325 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d94 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065113.368118:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259598208:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065113.368164:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.374158:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259598208:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065113.374532:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb30600/0x14b4f8542d4f1325 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d94 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.374544:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb30600/0x14b4f8542d4f1325 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d94 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.374555:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb30600, rc 0) 00000100:00100000:1.0:1746065113.374570:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260714880:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 6497us (7035us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065113.374575:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9994 00000100:00100000:0.0:1746065113.374942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.375078:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259597952:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065113.375093:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6d91400/0x14b4f8542d4f1310 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d8d expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.375099:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6d91400/0x14b4f8542d4f1310 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d8d expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.375107:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6d91400, rc 0) 00000100:00100000:1.0:1746065113.375122:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260714752:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 9042us (9160us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065113.375126:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9992 00000100:00100000:0.0:1746065113.380538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.380595:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260715520 00000100:00100000:1.0:1746065113.380603:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260715520 00000100:00100000:0.0:1746065113.380803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.380844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.381097:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260715904 00000100:00100000:1.0:1746065113.381100:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260715904 00000100:00100000:1.0:1746065113.381122:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9995 00000100:00100000:0.0:1746065113.381122:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260715776 00000100:00100000:0.0:1746065113.381124:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260715776 00000100:00100000:1.0:1746065113.381128:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:28554:x1830881260715904:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065113.381141:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746065113.381149:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1871872->2097151) req@ffff88009c3fb100 x1830881260715776/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746065113.381155:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6d91200/0x14b4f8542d4f132c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59da2 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.381179:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135035600/0x14b4f8542d4f1268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2584575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cec expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.381186:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065113.381188:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065113.381191:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6d91200/0x14b4f8542d4f132c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->2228223] (req 2097152->2228223) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59da2 expref: 49 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.381214:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135035600/0x14b4f8542d4f1268 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2584575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cec expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.381223:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135035600/0x14b4f8542d4f1268 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2584575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cec expref: 29 pid: 21235 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065113.381234:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259598464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.381306:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.381324:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8864 00000100:00100000:1.0:1746065113.381329:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+20:28555:x1830881260715520:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065113.381337:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.381346:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90400/0x14b4f8542d4f1333 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59d9b expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065113.381488:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb100 with x1830881260715776 ext(1871872->2097151) 00010000:00010000:0.0:1746065113.381555:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093ea3800/0x14b4f8542d4f12f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d63 expref: 49 pid: 8428 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.381564:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093ea3800/0x14b4f8542d4f12f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d63 expref: 49 pid: 8428 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.381569:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3fb100 00000100:00100000:0.0:1746065113.381590:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1413 00000100:00100000:0.0:1746065113.381596:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1960:x1830881260715776:12345-192.168.202.46@tcp:4:multiop.0 00010000:00010000:1.0:1746065113.383009:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90200/0x14b4f8542d4f133a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.383020:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d5c expref: 21 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.383026:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90200/0x14b4f8542d4f133a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.383043:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d5c expref: 21 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.383050:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d5c expref: 21 pid: 24350 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065113.383059:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259598592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.383086:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.390541:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259598464:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.390567:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6d91200/0x14b4f8542d4f132c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->2228223] (req 2097152->2228223) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59da2 expref: 50 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.390582:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6d91200, rc 0) 00000100:00100000:1.0:1746065113.390617:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:28554:x1830881260715904:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9487us (9771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.390624:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9995 00010000:00010000:1.0:1746065113.391969:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d91000/0x14b4f8542d4f12ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d5c expref: 22 pid: 24350 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065113.391985:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259598592:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.391994:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90200/0x14b4f8542d4f133a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.392000:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90200/0x14b4f8542d4f133a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065113.392004:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90200/0x14b4f8542d4f133a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065113.392012:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065113.392079:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90400/0x14b4f8542d4f1333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d9b expref: 23 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.392089:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6d90200/0x14b4f8542d4f133a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d9b expref: 22 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.392094:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065113.392097:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065113.392099:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6d90200, rc 0) 00000100:00100000:1.0:1746065113.392340:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+21:28555:x1830881260715520:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 11009us (11808us total) trans 8589942882 rc 0/0 00000100:00100000:1.0:1746065113.392345:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8864 00000100:00100000:0.0:1746065113.398771:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:1960:x1830881260715776:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 17166us (17958us total) trans 17179872668 rc 0/0 00000100:00100000:0.0:1746065113.398783:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1413 00002000:00100000:0.0:1746065113.398795:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1871872->2097151) req@ffff88009c3fb100 x1830881260715776/t17179872668(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.398803:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb100 with x1830881260715776 ext(1871872->2097151) 00010000:00010000:0.0:1746065113.398837:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093ea3800/0x14b4f8542d4f12f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d63 expref: 50 pid: 8428 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.398856:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093ea3800/0x14b4f8542d4f12f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1871872->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d63 expref: 50 pid: 8428 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.398862:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3fb100 00000100:00100000:0.0:1746065113.398986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.401883:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.405985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.411430:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+32:1960:x1830881260716288:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 18965us (20611us total) trans 17179872669 rc 0/0 00000100:00100000:0.0:1746065113.411439:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1414 00002000:00100000:0.0:1746065113.411449:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3170303) req@ffff8800a5804380 x1830881260716288/t17179872669(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 504/448 e 0 to 0 dl 1746065124 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.411457:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5804380 with x1830881260716288 ext(2097152->3170303) 00010000:00010000:0.0:1746065113.411465:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135035600/0x14b4f8542d4f1268 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2584575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cec expref: 32 pid: 21235 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746065113.411477:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135035600/0x14b4f8542d4f1268 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2584575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cec expref: 32 pid: 21235 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746065113.411483:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5804380 00000100:00100000:0.0:1746065113.417789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.417909:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260717952 00000100:00100000:1.0:1746065113.417916:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260717952 00002000:00100000:1.0:1746065113.417949:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2600960->2605055) req@ffff880094a11f80 x1830881260717952/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.417956:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11f80 with x1830881260717952 ext(2600960->2605055) 00002000:00010000:1.0:1746065113.417961:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a11f80 00000100:00100000:1.0:1746065113.417975:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4503 00000100:00100000:1.0:1746065113.417982:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260717952:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065113.418114:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260717952:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 131us (330us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065113.418120:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4503 00002000:00100000:1.0:1746065113.418125:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2600960->2605055) req@ffff880094a11f80 x1830881260717952/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/4536 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.418131:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11f80 with x1830881260717952 ext(2600960->2605055) 00002000:00010000:1.0:1746065113.418134:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a11f80 00000100:00100000:0.0:1746065113.419115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.428732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.428776:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260718336 00000100:00100000:1.0:1746065113.428783:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260718336 00000100:00100000:1.0:1746065113.428838:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3580 00000100:00100000:1.0:1746065113.428844:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+41:28557:x1830881260718336:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065113.429012:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+42:28557:x1830881260718336:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 167us (285us total) trans 8589942884 rc 0/0 00000100:00100000:1.0:1746065113.429021:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3580 00000100:00100000:0.0:1746065113.429806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.433220:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.433867:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.433951:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260718720 00000100:00100000:1.0:1746065113.433959:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260718720 00000100:00100000:1.0:1746065113.433995:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9996 00000100:00100000:1.0:1746065113.434001:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+31:28545:x1830881260718720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065113.434016:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.434031:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6d90a00/0x14b4f8542d4f136b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59db7 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.434058:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6d91200/0x14b4f8542d4f132c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59da2 expref: 48 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.434064:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065113.434065:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065113.434068:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6d90a00/0x14b4f8542d4f136b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59db7 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.434092:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6d91200/0x14b4f8542d4f132c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59da2 expref: 48 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.434103:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6d91200/0x14b4f8542d4f132c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2228223) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59da2 expref: 48 pid: 9716 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065113.434113:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259599232:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.435049:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.435882:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259599232:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.435899:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6d90a00/0x14b4f8542d4f136b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59db7 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.435910:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6d90a00, rc 0) 00000100:00100000:1.0:1746065113.435940:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+32:28545:x1830881260718720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1938us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.435946:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9996 00000100:00100000:0.0:1746065113.436293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.436638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.448059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.448177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.448248:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260719488 00000100:00100000:1.0:1746065113.448256:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260719488 00000100:00100000:1.0:1746065113.448305:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9997 00000100:00100000:1.0:1746065113.448313:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28552:x1830881260719488:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065113.448331:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.448348:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f0d800/0x14b4f8542d4f1372 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59dbe expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.448373:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135034000/0x14b4f8542d4f128b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d0f expref: 27 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.448379:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065113.448380:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065113.448383:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f0d800/0x14b4f8542d4f1372 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dbe expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.448405:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135034000/0x14b4f8542d4f128b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d0f expref: 27 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.448413:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135034000/0x14b4f8542d4f128b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d0f expref: 27 pid: 21235 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065113.448434:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259599360:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.448504:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.449900:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259599360:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.449917:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f0d800/0x14b4f8542d4f1372 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dbe expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.449926:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0d800, rc 0) 00000100:00100000:1.0:1746065113.449946:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28552:x1830881260719488:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1634us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.449952:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9997 00000100:00100000:0.0:1746065113.451324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.453882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.454181:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260720000 00000100:00100000:1.0:1746065113.454188:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260720000 00002000:00100000:1.0:1746065113.454215:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880094a11880 x1830881260720000/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.454223:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11880 with x1830881260720000 ext(2097152->3145727) 00002000:00010000:1.0:1746065113.454228:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11880 00000100:00100000:1.0:1746065113.454243:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4505 00000100:00100000:1.0:1746065113.454250:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260720000:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065113.462031:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260720000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7739us (8111us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065113.462042:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4505 00002000:00100000:1.0:1746065113.462052:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880094a11880 x1830881260720000/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/440 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.462067:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11880 with x1830881260720000 ext(2097152->3145727) 00002000:00010000:1.0:1746065113.462072:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11880 00000100:00100000:0.0:1746065113.470356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.470456:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260720128 00000100:00100000:1.0:1746065113.470463:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260720128 00000100:00100000:1.0:1746065113.470497:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9998 00000100:00100000:1.0:1746065113.470504:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+30:28545:x1830881260720128:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065113.470518:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.470532:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135035200/0x14b4f8542d4f1379 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59dc5 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.470554:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065113.470559:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135035200/0x14b4f8542d4f1379 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dc5 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.470570:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135035200/0x14b4f8542d4f1379 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dc5 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.470578:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135035200, rc 0) 00000100:00100000:1.0:1746065113.470619:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+31:28545:x1830881260720128:12345-192.168.202.46@tcp:101:cat.0 Request processed in 115us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.470624:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9998 00000100:00100000:0.0:1746065113.471115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.483956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.486279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.487382:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260720896 00000100:00100000:1.0:1746065113.487390:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260720896 00002000:00100000:1.0:1746065113.487435:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800913fad80 x1830881260720896/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.487444:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fad80 with x1830881260720896 ext(3145728->4194303) 00002000:00010000:1.0:1746065113.487450:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913fad80 00000100:00100000:1.0:1746065113.487476:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4507 00000100:00100000:1.0:1746065113.487482:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260720896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065113.489234:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4509 00000100:00100000:0.0:1746065113.489242:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260721024:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065113.508357:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260721024:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19106us (20137us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065113.508367:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4509 00002000:00100000:1.0:1746065113.508376:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a5804e00 x1830881260721024/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/440 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.508384:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5804e00 with x1830881260721024 ext(2097152->3145727) 00002000:00010000:1.0:1746065113.508388:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5804e00 00000100:00100000:1.0:1746065113.515729:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260720896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28239us (29446us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065113.515739:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4507 00002000:00100000:1.0:1746065113.515748:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800913fad80 x1830881260720896/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/440 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.515756:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fad80 with x1830881260720896 ext(3145728->4194303) 00002000:00010000:1.0:1746065113.515761:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913fad80 00000100:00100000:0.0:1746065113.522648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.525571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.532334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.532587:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260721920 00000100:00100000:1.0:1746065113.532595:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260721920 00000100:00100000:0.0:1746065113.532801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:1.0:1746065113.533144:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800913f8000 x1830881260721920/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.533153:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f8000 with x1830881260721920 ext(3145728->4194303) 00002000:00010000:1.0:1746065113.533156:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f8000 00000100:00100000:1.0:1746065113.533672:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260722176 00000100:00100000:1.0:1746065113.533677:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260722176 00002000:00100000:1.0:1746065113.533700:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800913fb100 x1830881260722176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.533707:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fb100 with x1830881260722176 ext(3145728->4194303) 00002000:00010000:1.0:1746065113.533710:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913fb100 00000100:00100000:1.0:1746065113.533731:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4512 00000100:00100000:1.0:1746065113.533736:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260722176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065113.556034:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.667592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.675703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.690601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.690690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.696590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.701005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.703956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.703976:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260723584 00000100:00100000:1.0:1746065113.703981:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260723584 00010000:00010000:1.0:1746065113.704003:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135035200/0x14b4f8542d4f1379 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dc5 expref: 30 pid: 9716 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746065113.704036:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4935 00000100:00100000:1.0:1746065113.704042:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260723584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065113.704051:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065113.704067:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135035200/0x14b4f8542d4f1379 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dc5 expref: 30 pid: 9716 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065113.704077:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135035200/0x14b4f8542d4f1379 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dc5 expref: 30 pid: 9716 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065113.704093:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135035200/0x14b4f8542d4f1379 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dc5 expref: 30 pid: 9716 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746065113.704106:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065113.704144:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+29:1959:x1830881260723584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.704149:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4935 00000100:00100000:0.0:1746065113.707463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.707527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.714433:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260724352 00000100:00100000:0.0:1746065113.714440:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260724352 00002000:00100000:0.0:1746065113.714477:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x37f:0x0] (1814528->1818623) req@ffff8800a5807480 x1830881260724352/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.714487:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5807480 with x1830881260724352 ext(1814528->1818623) 00002000:00010000:0.0:1746065113.714492:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5807480 00000100:00100000:0.0:1746065113.714521:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4515 00000100:00100000:0.0:1746065113.714529:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260724352:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065113.714658:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260724352:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 129us (783us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065113.714664:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4515 00002000:00100000:0.0:1746065113.714669:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x37f:0x0] (1814528->1818623) req@ffff8800a5807480 x1830881260724352/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:29/0 lens 488/4536 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.714676:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5807480 with x1830881260724352 ext(1814528->1818623) 00002000:00010000:0.0:1746065113.714678:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5807480 00000100:00100000:1.0:1746065113.716497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.730289:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.730345:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260724736 00000100:00100000:0.0:1746065113.730356:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260724736 00002000:00100000:0.0:1746065113.730401:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (3051520->3055615) req@ffff88009a4e8000 x1830881260724736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.730409:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8000 with x1830881260724736 ext(3051520->3055615) 00002000:00010000:0.0:1746065113.730425:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8000 00000100:00100000:0.0:1746065113.730458:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4517 00000100:00100000:0.0:1746065113.730465:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260724736:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065113.730648:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260724736:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 179us (362us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065113.730658:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4517 00002000:00100000:0.0:1746065113.730665:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (3051520->3055615) req@ffff88009a4e8000 x1830881260724736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/4536 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.730671:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8000 with x1830881260724736 ext(3051520->3055615) 00002000:00010000:0.0:1746065113.730674:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8000 00000100:00100000:0.0:1746065113.744565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.768553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.803292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.808935:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.823063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.823250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.823305:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260725632 00000100:00100000:1.0:1746065113.823310:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260725632 00000100:00100000:1.0:1746065113.823360:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10004 00000100:00100000:1.0:1746065113.823367:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:28575:x1830881260725632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065113.823382:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.823394:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135035600/0x14b4f8542d4f13cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e04 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.823426:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b268000/0x14b4f8542d4f13b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1818623) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59de8 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.823434:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065113.823435:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065113.823438:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135035600/0x14b4f8542d4f13cd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e04 expref: 51 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.823462:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b268000/0x14b4f8542d4f13b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1818623) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59de8 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.823471:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b268000/0x14b4f8542d4f13b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1818623) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59de8 expref: 31 pid: 21998 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065113.823481:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259601024:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.823655:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.833772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.833843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.833890:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260725760 00000100:00100000:0.0:1746065113.833898:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260725760 00002000:00100000:0.0:1746065113.833936:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (2801664->3055615) req@ffff880094ad4000 x1830881260725760/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.833950:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad4000 with x1830881260725760 ext(2801664->3055615) 00010000:00010000:0.0:1746065113.833958:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b269600/0x14b4f8542d4f13b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59de1 expref: 33 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065113.833967:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b269600/0x14b4f8542d4f13b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59de1 expref: 33 pid: 21235 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746065113.833973:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ad4000 00000100:00100000:1.0:1746065113.834005:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259601024:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.834023:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135035600/0x14b4f8542d4f13cd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e04 expref: 51 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.834032:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135035600, rc 0) 00000100:00100000:1.0:1746065113.834049:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:28575:x1830881260725632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10683us (10798us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.834054:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10004 00000100:00100000:0.0:1746065113.835711:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1418 00000100:00100000:0.0:1746065113.835724:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881260725760:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065113.844963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.854072:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.857384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.858899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.860247:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5807b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259601280:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065113.860266:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065113.860298:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+33:1960:x1830881260726144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5750us (6237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.860306:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4938 00000100:00100000:0.0:1746065113.874738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.882013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.882942:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260727040 00000100:00100000:1.0:1746065113.882951:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260727040 00000100:00100000:1.0:1746065113.882999:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10006 00000100:00100000:1.0:1746065113.883005:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+33:28577:x1830881260727040:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065113.883022:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.883037:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e0b expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.883062:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f13a400/0x14b4f8542d4f1157 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c36 expref: 52 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.883068:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f213a00/0x14b4f8542d4f123e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cd0 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.883076:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f11e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c7c expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.883081:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.883082:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.883085:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [487424->917503] (req 487424->917503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.883109:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f11e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c7c expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.883119:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f11e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c7c expref: 8 pid: 4545 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746065113.883128:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259601408:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.883210:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f213a00/0x14b4f8542d4f123e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cd0 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.883217:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f213a00/0x14b4f8542d4f123e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cd0 expref: 34 pid: 25185 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746065113.883225:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259601536:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.883247:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f13a400/0x14b4f8542d4f1157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c36 expref: 52 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.883258:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f13a400/0x14b4f8542d4f1157 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c36 expref: 52 pid: 21998 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065113.883265:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259601664:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.883279:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065113.884661:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259601536:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.884670:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259601408:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.884701:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:1961:x1830881260726912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9510us (11182us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065113.884710:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4521 00002000:00100000:1.0:1746065113.884719:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094ad7b80 x1830881260726912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/440 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.884728:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad7b80 with x1830881260726912 ext(1048576->2097151) 00002000:00010000:1.0:1746065113.884732:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad7b80 00000100:00100000:1.0:1746065113.887158:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259601664:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.887188:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [487424->917503] (req 487424->917503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.887203:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135034400, rc 0) 00000100:00100000:1.0:1746065113.887255:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+34:28577:x1830881260727040:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4249us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.887263:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10006 00000100:00100000:0.0:1746065113.888384:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.888435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.888437:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260727296 00000100:00100000:1.0:1746065113.888443:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260727296 00010000:00010000:1.0:1746065113.888467:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f213a00/0x14b4f8542d4f123e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cd0 expref: 34 pid: 25185 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746065113.888470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.888682:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4939 00000100:00100000:0.0:1746065113.888689:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+34:1961:x1830881260727296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065113.888699:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065113.888704:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4941 00000100:00100000:1.0:1746065113.888710:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260727168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065113.888716:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065113.888718:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f213a00/0x14b4f8542d4f123e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cd0 expref: 34 pid: 25185 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746065113.888722:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f11e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c7c expref: 9 pid: 4545 timeout: 813 lvb_type: 1 00010000:00010000:0.0:1746065113.888728:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f213a00/0x14b4f8542d4f123e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cd0 expref: 34 pid: 25185 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746065113.889141:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f11e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c7c expref: 9 pid: 4545 timeout: 813 lvb_type: 1 00010000:00010000:0.0:1746065113.889157:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f213a00/0x14b4f8542d4f123e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59cd0 expref: 34 pid: 25185 timeout: 813 lvb_type: 1 00010000:00010000:0.0:1746065113.889210:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065113.889212:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.889214:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f11e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59c7c expref: 9 pid: 4545 timeout: 813 lvb_type: 1 00010000:00010000:0.0:1746065113.889218:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065113.889230:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.889238:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065113.889255:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065113.889263:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260727168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 553us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065113.889266:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259601792:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065113.889269:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4941 00000100:00100000:1.0:1746065113.889738:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.890368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.890447:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260727552 00000100:00100000:1.0:1746065113.890451:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260727552 00000100:00100000:1.0:1746065113.890759:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10007 00000100:00100000:1.0:1746065113.890770:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:28579:x1830881260727552:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065113.890782:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065113.890797:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e12 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.890837:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135035800/0x14b4f8542d4f1292 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d16 expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.890845:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d7f expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.890852:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd25600/0x14b4f8542d4f12c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d40 expref: 35 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.890857:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.890859:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.890861:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1814528->2072575] (req 1814528->2072575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 35 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.890881:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd25600/0x14b4f8542d4f12c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d40 expref: 35 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.890891:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bd25600/0x14b4f8542d4f12c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d40 expref: 35 pid: 8429 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746065113.890900:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259601920:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.890967:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d7f expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065113.890974:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d7f expref: 10 pid: 8429 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746065113.890982:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259602048:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065113.891005:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135035800/0x14b4f8542d4f1292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d16 expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.891013:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135035800/0x14b4f8542d4f1292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d16 expref: 29 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065113.891020:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259602176:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065113.891034:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.892174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.892323:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259601792:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065113.892339:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065113.892363:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+34:1961:x1830881260727296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3674us (3981us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.892372:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4939 00000100:00100000:0.0:1746065113.894651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.894674:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260727936 00000100:00100000:1.0:1746065113.894680:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260727936 00010000:00010000:1.0:1746065113.894703:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d7f expref: 11 pid: 8429 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746065113.895444:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4942 00000100:00100000:1.0:1746065113.895452:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881260727936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065113.895462:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065113.895480:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d7f expref: 11 pid: 8429 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746065113.895490:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d7f expref: 11 pid: 8429 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746065113.895508:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb30800/0x14b4f8542d4f1309 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d7f expref: 11 pid: 8429 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746065113.895518:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065113.895548:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260727936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 97us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.895553:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4942 00000100:00100000:0.0:1746065113.896241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.897458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.897488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.897508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.898179:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4943 00000100:00100000:1.0:1746065113.898186:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260728576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065113.898195:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065113.898211:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135035800/0x14b4f8542d4f1292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d16 expref: 30 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065113.898220:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135035800/0x14b4f8542d4f1292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d16 expref: 30 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065113.898235:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135035800/0x14b4f8542d4f1292 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d16 expref: 30 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065113.898245:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065113.898274:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881260728576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 89us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.898282:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4943 00000100:00100000:1.0:1746065113.898296:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4944 00000100:00100000:1.0:1746065113.898638:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881260728192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065113.898646:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065113.898656:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bd25600/0x14b4f8542d4f12c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d40 expref: 35 pid: 8429 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746065113.898664:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bd25600/0x14b4f8542d4f12c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d40 expref: 35 pid: 8429 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746065113.898675:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd25600/0x14b4f8542d4f12c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d40 expref: 35 pid: 8429 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746065113.898684:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.898685:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065113.898689:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.898695:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065113.898724:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065113.898734:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259602304:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065113.898772:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065113.899746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.902943:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259602304:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065113.902959:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065113.902983:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881260728192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4681us (5473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065113.902989:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4944 00000100:00100000:0.0:1746065113.906268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.911087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.917206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.917319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.926655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065113.926698:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.926778:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260729984 00000100:00100000:0.0:1746065113.926784:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260729984 00002000:00100000:0.0:1746065113.927647:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009a4e8380 x1830881260729984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/0 e 0 to 0 dl 1746065124 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065113.927656:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8380 with x1830881260729984 ext(2097152->3145727) 00002000:00010000:0.0:1746065113.927659:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8380 00000100:00100000:0.0:1746065113.927684:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4528 00000100:00100000:0.0:1746065113.927690:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881260729984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065113.944538:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881260729984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16841us (17877us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065113.944548:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4528 00002000:00100000:1.0:1746065113.944555:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009a4e8380 x1830881260729984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:29/0 lens 488/440 e 0 to 0 dl 1746065124 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065113.944563:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8380 with x1830881260729984 ext(2097152->3145727) 00002000:00010000:1.0:1746065113.944567:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8380 00000100:00100000:0.0:1746065113.948862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.954222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065113.958297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.060942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.064321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.069212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.074395:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5807800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259603328:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065114.074431:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260731264 00010000:00010000:0.0:1746065114.074433:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.074437:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260731264 00002000:00100000:1.0:1746065114.074470:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1527808->1531903) req@ffff8800a5806680 x1830881260731264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.074479:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5806680 with x1830881260731264 ext(1527808->1531903) 00002000:00010000:1.0:1746065114.074483:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5806680 00000100:00100000:1.0:1746065114.074535:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:1961:x1830881260731008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5160us (5329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.074543:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4946 00000100:00100000:0.0:1746065114.078596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.082923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.086720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.086844:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260731776 00000100:00100000:1.0:1746065114.086852:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260731776 00002000:00100000:1.0:1746065114.087098:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1814528->2072575) req@ffff88009c7ac380 x1830881260731776/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.087109:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac380 with x1830881260731776 ext(1814528->2072575) 00010000:00010000:1.0:1746065114.087118:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 35 pid: 21998 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.087131:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 35 pid: 21998 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746065114.087137:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7ac380 00000100:00100000:1.0:1746065114.087310:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1420 00000100:00100000:1.0:1746065114.087318:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881260731776:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065114.096460:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881260731776:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 9133us (9736us total) trans 21474839913 rc 0/0 00000100:00100000:1.0:1746065114.096471:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1420 00002000:00100000:1.0:1746065114.096482:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1814528->2072575) req@ffff88009c7ac380 x1830881260731776/t21474839913(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 488/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.096490:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac380 with x1830881260731776 ext(1814528->2072575) 00010000:00010000:1.0:1746065114.096500:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.096515:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746065114.096522:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7ac380 00000100:00100000:0.0:1746065114.098783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.098943:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260731904 00000100:00100000:1.0:1746065114.098954:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260731904 00010000:00010000:1.0:1746065114.099063:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.099097:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4947 00000100:00100000:1.0:1746065114.099104:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881260731904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.099115:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065114.099129:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065114 -> 1746065115 00010000:00010000:1.0:1746065114.099135:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.099145:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.099900:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135035e00/0x14b4f8542d4f13e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2072575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e12 expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.099928:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.099930:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.099935:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.099943:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.099973:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.099987:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259603584:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065114.100068:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.101590:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259603584:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065114.101603:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.101630:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881260731904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2526us (2853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.102001:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4947 00000100:00100000:0.0:1746065114.102132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.102351:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260732160 00000100:00100000:1.0:1746065114.102356:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260732160 00002000:00100000:1.0:1746065114.102383:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1130496->1134591) req@ffff88009c7af480 x1830881260732160/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.102391:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af480 with x1830881260732160 ext(1130496->1134591) 00002000:00010000:1.0:1746065114.102395:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7af480 00000100:00100000:1.0:1746065114.102571:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4531 00000100:00100000:1.0:1746065114.102578:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260732160:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065114.102702:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260732160:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 124us (571us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065114.102708:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4531 00002000:00100000:1.0:1746065114.102713:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1130496->1134591) req@ffff88009c7af480 x1830881260732160/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/4536 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.102720:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af480 with x1830881260732160 ext(1130496->1134591) 00002000:00010000:1.0:1746065114.102722:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7af480 00000100:00100000:0.0:1746065114.107728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.107929:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260732416 00000100:00100000:1.0:1746065114.107937:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260732416 00002000:00100000:1.0:1746065114.107973:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1667072->1671167) req@ffff88009c7adc00 x1830881260732416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.107983:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7adc00 with x1830881260732416 ext(1667072->1671167) 00002000:00010000:1.0:1746065114.107987:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7adc00 00000100:00100000:1.0:1746065114.108020:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4532 00000100:00100000:1.0:1746065114.108027:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260732416:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065114.108180:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260732416:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 153us (459us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065114.108186:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4532 00002000:00100000:1.0:1746065114.108191:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1667072->1671167) req@ffff88009c7adc00 x1830881260732416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/4536 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.108197:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7adc00 with x1830881260732416 ext(1667072->1671167) 00002000:00010000:1.0:1746065114.108200:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7adc00 00000100:00100000:0.0:1746065114.132685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.133420:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260732544 00000100:00100000:1.0:1746065114.133428:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260732544 00000100:00100000:1.0:1746065114.133465:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8869 00000100:00100000:1.0:1746065114.133633:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+21:28590:x1830881260732544:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065114.133651:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.133668:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f1428 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e58 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.133713:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.133726:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.133734:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.133742:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.133747:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.133879:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.134001:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.134010:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff8dc00/0x14b4f8542d4f138e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dd3 expref: 283 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.134017:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b269400/0x14b4f8542d4f13a3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dda expref: 43 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.134021:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 5/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.134043:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b269400/0x14b4f8542d4f13a3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dda expref: 43 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.134051:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b269400/0x14b4f8542d4f13a3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dda expref: 43 pid: 24350 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.134066:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259603712:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.135334:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff8dc00/0x14b4f8542d4f138e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dd3 expref: 283 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.135345:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff8dc00/0x14b4f8542d4f138e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dd3 expref: 283 pid: 20754 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.135353:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259603840:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065114.135380:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.141003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.142055:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259603712:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065114.142090:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259603840:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.142109:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:1.0:1746065114.146402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.146444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.146464:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260733184 00000100:00100000:1.0:1746065114.146470:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260733184 00010000:00010000:1.0:1746065114.146497:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b269400/0x14b4f8542d4f13a3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dda expref: 45 pid: 24350 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.146520:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4948 00000100:00100000:1.0:1746065114.146527:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+45:1958:x1830881260733184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.146536:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065114.146541:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b269400/0x14b4f8542d4f13a3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dda expref: 45 pid: 24350 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.146552:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b269400/0x14b4f8542d4f13a3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dda expref: 45 pid: 24350 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.146568:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b269400/0x14b4f8542d4f13a3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dda expref: 45 pid: 24350 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.146583:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065114.146587:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.146594:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.146598:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.146603:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.146635:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+44:1958:x1830881260733184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 108us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.146640:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4948 00000100:00100000:1.0:1746065114.156359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.158467:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260733440 00000100:00100000:1.0:1746065114.158473:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260733440 00010000:00010000:1.0:1746065114.158495:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff8dc00/0x14b4f8542d4f138e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dd3 expref: 285 pid: 20754 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.158516:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4949 00000100:00100000:1.0:1746065114.158523:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+285:1961:x1830881260733440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.158535:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065114.158539:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff8dc00/0x14b4f8542d4f138e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dd3 expref: 285 pid: 20754 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.158550:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff8dc00/0x14b4f8542d4f138e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dd3 expref: 285 pid: 20754 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.158568:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff8dc00/0x14b4f8542d4f138e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dd3 expref: 285 pid: 20754 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.158581:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065114.158586:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.158594:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.158599:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.158617:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.158647:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5806a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:1961:x1830881260733440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 124us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.158652:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4949 00010000:00010000:1.0:1746065114.159169:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159177:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065114.159768:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00000004:00200000:1.0:1746065114.159772:0:20754:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065114.159787:0:20754:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159796:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159804:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159809:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159828:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159834:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8e6800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065114.159837:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159842:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159850:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065114.159853:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065114.159856:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159860:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f142f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159868:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159872:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159876:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159880:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8e6a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065114.159882:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159886:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159891:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f400) 00010000:00010000:1.0:1746065114.159892:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065114.159894:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159898:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f1436 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.159921:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f1428 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e58 expref: 23 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.159931:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e58 expref: 22 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.159936:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065114.159938:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065114.159939:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6c00, rc 0) 00000100:00100000:1.0:1746065114.159961:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+22:28590:x1830881260732544:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 26490us (27284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.159967:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8869 00000100:00100000:0.0:1746065114.170523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.170542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.170554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.170565:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.170577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.170600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.170620:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260733952 00000100:00100000:0.0:1746065114.170627:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260733952 00000100:00100000:0.0:1746065114.170665:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260734208 00000100:00100000:0.0:1746065114.170667:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260734208 00000100:00100000:0.0:1746065114.170677:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260733824 00000100:00100000:0.0:1746065114.170679:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260733824 00000100:00100000:0.0:1746065114.170686:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260734080 00000100:00100000:0.0:1746065114.170688:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260734080 00000100:00100000:0.0:1746065114.170696:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260734336 00000100:00100000:0.0:1746065114.170698:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260734336 00000100:00100000:0.0:1746065114.170710:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10018 00000100:00100000:0.0:1746065114.170717:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260733952:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065114.170732:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.170747:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe14200/0x14b4f8542d4f144b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e6d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.170790:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259604096:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065114.170864:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.170881:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10019 00000100:00100000:0.0:1746065114.170887:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260734208:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065114.170895:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.170902:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe14a00/0x14b4f8542d4f1452 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e7b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.170914:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.170916:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.170922:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe14a00/0x14b4f8542d4f1452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e7b expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.170934:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe14a00/0x14b4f8542d4f1452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e7b expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.170946:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe14a00, rc 0) 00000100:00100000:0.0:1746065114.170965:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260734208:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 78us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.170971:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10019 00000100:00100000:0.0:1746065114.170988:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10020 00000100:00100000:0.0:1746065114.170993:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260733824:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065114.170998:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065114.173793:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10022 00000100:00100000:1.0:1746065114.173804:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881260734336:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065114.174539:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe14c00/0x14b4f8542d4f1459 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e66 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.174640:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c125180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259604352:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065114.174723:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00080000:0.0:1746065114.174741:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065114.174800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065114.179249:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.179270:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e82 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.179295:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.179297:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.179307:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e82 expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.179320:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e82 expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.179331:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6e00, rc 0) 00000100:00100000:1.0:1746065114.179361:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1959:x1830881260734336:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5558us (8758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.179368:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10022 00000100:00100000:0.0:1746065114.181292:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+33:1961:x1830881260733696:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9797us (10770us total) trans 0 rc 618496/618496 00000100:00100000:0.0:1746065114.181300:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4533 00002000:00100000:0.0:1746065114.181309:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009c124e00 x1830881260733696/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 504/440 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 618496/618496 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.181317:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124e00 with x1830881260733696 ext(0->1048575) 00002000:00010000:0.0:1746065114.181322:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c124e00 00002000:00010000:0.0:1746065114.181500:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime: 1746065114 -> 1746065115 00002000:00010000:0.0:1746065114.181504:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime: 1746065114 -> 1746065115 00000100:00100000:0.0:1746065114.181521:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259604096:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065114.181547:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe14200/0x14b4f8542d4f144b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e6d expref: 12 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.181560:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe14200/0x14b4f8542d4f144b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e6d expref: 12 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.181571:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe14200, rc 0) 00000100:00100000:0.0:1746065114.181591:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260733952:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 10874us (11047us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065114.181597:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10018 00002000:00010000:0.0:1746065114.181627:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime: 1746065114 -> 1746065115 00002000:00010000:0.0:1746065114.181630:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime: 1746065114 -> 1746065115 00002000:00010000:0.0:1746065114.181633:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime: 1746065114 -> 1746065115 00000100:00100000:0.0:1746065114.181642:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c125180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259604352:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065114.181656:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe14c00/0x14b4f8542d4f1459 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e66 expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.181665:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe14c00/0x14b4f8542d4f1459 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e66 expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.181673:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe14c00, rc 0) 00000100:00100000:0.0:1746065114.181689:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260733824:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 10696us (11122us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065114.181694:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10020 00000100:00100000:0.0:1746065114.183541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.184252:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260734848 00000100:00100000:1.0:1746065114.184259:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260734848 00000100:00100000:1.0:1746065114.184290:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8870 00000100:00100000:1.0:1746065114.184297:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+22:28590:x1830881260734848:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065114.184310:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.184322:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7c00/0x14b4f8542d4f146e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e89 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.184394:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.184407:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e58 expref: 23 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.184426:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.184450:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e58 expref: 23 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.184459:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e58 expref: 23 pid: 20754 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.184469:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259604480:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065114.184519:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.191850:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.191876:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260734976 00000100:00100000:0.0:1746065114.191883:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260734976 00010000:00010000:0.0:1746065114.191913:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e58 expref: 24 pid: 20754 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.191937:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4950 00000100:00100000:0.0:1746065114.191945:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+24:1958:x1830881260734976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.191957:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.192168:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e58 expref: 24 pid: 20754 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.192180:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e58 expref: 24 pid: 20754 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.192200:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065114.192204:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065114.192213:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065114.192219:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065114.192235:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.192270:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+24:1958:x1830881260734976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 326us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.193475:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4950 00010000:00010000:1.0:1746065114.196654:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f143d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e58 expref: 23 pid: 20754 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.196680:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881259604480:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.196697:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.196704:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065114.196709:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065114.196725:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065114.196863:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7c00/0x14b4f8542d4f146e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e89 expref: 24 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.196877:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e89 expref: 23 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.196884:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065114.196887:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065114.196890:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e7e00, rc 0) 00000100:00100000:1.0:1746065114.196938:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+23:28590:x1830881260734848:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 12640us (13399us total) trans 8589942890 rc 0/0 00000100:00100000:1.0:1746065114.196945:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8870 00000100:00100000:0.0:1746065114.197791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.200635:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260735232 00000100:00100000:0.0:1746065114.200641:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260735232 00000100:00100000:0.0:1746065114.201433:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260735360 00000100:00100000:0.0:1746065114.201438:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260735360 00000100:00100000:0.0:1746065114.201451:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10024 00000100:00100000:0.0:1746065114.201456:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881260735232:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.201464:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.201473:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe15200/0x14b4f8542d4f148a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e97 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.201499:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259604736:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065114.201526:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.201540:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10025 00000100:00100000:0.0:1746065114.201544:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+33:28593:x1830881260735360:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.201550:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.201558:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59e9e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.201571:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf1200/0x14b4f8542d4f141a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e4a expref: 51 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.201577:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.201579:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.201582:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.201672:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bbf1200/0x14b4f8542d4f141a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e4a expref: 51 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.201689:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf1200/0x14b4f8542d4f141a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e4a expref: 51 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.201697:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c125880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259604864:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065114.201716:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.201753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.201828:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260735616 00000100:00100000:0.0:1746065114.201831:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260735616 00000100:00100000:0.0:1746065114.201851:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260735744 00000100:00100000:0.0:1746065114.201852:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260735744 00000100:00100000:0.0:1746065114.201865:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8871 00000100:00100000:0.0:1746065114.201869:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:28598:x1830881260735616:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065114.201882:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.201891:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15c00/0x14b4f8542d4f1498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59ea5 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.201965:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065114.201977:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065114.201987:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065114.201995:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:0.0:1746065114.202076:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15c00/0x14b4f8542d4f1498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ea5 expref: 287 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.202092:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ea5 expref: 286 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.202099:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065114.202102:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065114.202105:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe15e00, rc 0) 00000100:00100000:0.0:1746065114.202127:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+286:28598:x1830881260735616:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 257us (1568us total) trans 8589942891 rc 0/0 00000100:00100000:0.0:1746065114.202133:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8871 00000100:00100000:0.0:1746065114.202149:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8872 00000100:00100000:0.0:1746065114.202154:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+23:28590:x1830881260735744:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065114.202163:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.202168:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15a00/0x14b4f8542d4f14ad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59eac expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.202198:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065114.202205:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e89 expref: 24 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.202211:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ea5 expref: 285 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.202216:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065114.202234:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ea5 expref: 285 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.202241:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ea5 expref: 285 pid: 24350 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.202249:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259604992:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065114.202272:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e89 expref: 24 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.202279:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e89 expref: 24 pid: 20754 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.202286:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259605120:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065114.202299:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.204552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.204597:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259604736:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.204616:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe15200/0x14b4f8542d4f148a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e97 expref: 37 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.204625:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe15200/0x14b4f8542d4f148a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e97 expref: 37 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.204632:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe15200, rc 0) 00000100:00100000:1.0:1746065114.204654:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881260735232:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3197us (4151us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.204661:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10024 00000100:00100000:0.0:1746065114.204686:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259604992:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065114.204695:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259605120:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065114.204710:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065114.204735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.204789:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260735872 00000100:00100000:1.0:1746065114.204795:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260735872 00000100:00100000:0.0:1746065114.204801:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260736000 00000100:00100000:0.0:1746065114.204804:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260736000 00010000:00010000:0.0:1746065114.204830:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ea5 expref: 286 pid: 24350 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.204831:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e89 expref: 25 pid: 20754 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.204849:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4951 00000100:00100000:1.0:1746065114.204854:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4952 00000100:00100000:0.0:1746065114.204856:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+286:1961:x1830881260736000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065114.204859:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+25:1958:x1830881260735872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.204867:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065114.204872:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e89 expref: 25 pid: 20754 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.204873:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.204876:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ea5 expref: 286 pid: 24350 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.204880:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e89 expref: 25 pid: 20754 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.204893:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ea5 expref: 286 pid: 24350 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.204905:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe15e00/0x14b4f8542d4f149f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ea5 expref: 286 pid: 24350 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.204913:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065114.204917:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065114.204923:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065114.204927:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065114.204931:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.204947:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+285:1961:x1830881260736000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.204952:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4951 00000100:00100000:0.0:1746065114.205016:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c125880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259604864:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065114.205029:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.205043:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe14800, rc 0) 00000100:00100000:0.0:1746065114.205057:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+34:28593:x1830881260735360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3513us (4477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.205061:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10025 00010000:00010000:1.0:1746065114.206503:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7e00/0x14b4f8542d4f1475 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e89 expref: 25 pid: 20754 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.206519:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065114.206523:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065114.206531:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065114.206537:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065114.206555:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.206583:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+24:1958:x1830881260735872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1723us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.206589:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4952 00000100:00100000:1.0:1746065114.209042:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260736256 00000100:00100000:1.0:1746065114.209045:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260736256 00000100:00100000:1.0:1746065114.209064:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10026 00000100:00100000:1.0:1746065114.209068:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:28596:x1830881260736256:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065114.209076:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.209087:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f14bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59eb3 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.209104:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.209111:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065114.209112:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065114.209115:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f14bb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eb3 expref: 52 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.209594:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.209605:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 33 pid: 21998 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.209615:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259605248:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065114.209675:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.214745:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.214762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.214806:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259605248:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.214837:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f14bb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eb3 expref: 54 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.214850:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6a00, rc 0) 00000100:00100000:1.0:1746065114.214870:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+54:28596:x1830881260736256:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5801us (6498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.214876:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10026 00000100:00100000:1.0:1746065114.214889:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260736640 00000100:00100000:1.0:1746065114.214893:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260736640 00000100:00100000:1.0:1746065114.214905:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260736768 00000100:00100000:1.0:1746065114.214907:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260736768 00000100:00100000:1.0:1746065114.214916:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10029 00000100:00100000:1.0:1746065114.214921:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260736640:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065114.214928:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.214936:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f14d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59ec8 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.214958:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259605632:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065114.214983:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.214995:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10030 00000100:00100000:1.0:1746065114.214999:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260736768:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065114.215005:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.215011:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8e7800/0x14b4f8542d4f14d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59ecf expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.215028:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259605760:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065114.215042:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.216593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.220785:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259605632:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.220827:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f14d0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ec8 expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.220841:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f14d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ec8 expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.220851:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e7200, rc 0) 00000100:00100000:1.0:1746065114.220881:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260736640:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5959us (6137us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.220887:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10029 00002000:00010000:1.0:1746065114.221280:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065114 -> 1746065115 00000100:00100000:1.0:1746065114.221291:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259605760:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.221305:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e7800/0x14b4f8542d4f14d7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ecf expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.221313:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e7800/0x14b4f8542d4f14d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ecf expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.221321:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e7800, rc 0) 00000100:00100000:1.0:1746065114.221338:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260736768:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6339us (6576us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.221344:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10030 00000100:00100000:0.0:1746065114.223150:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.223705:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260737024 00000100:00100000:1.0:1746065114.223719:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260737024 00010000:00010000:1.0:1746065114.223749:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bbf1200/0x14b4f8542d4f141a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e4a expref: 54 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.223781:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4953 00000100:00100000:1.0:1746065114.223788:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+54:1959:x1830881260737024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.223801:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065114.223839:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf1200/0x14b4f8542d4f141a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e4a expref: 54 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.223849:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bbf1200/0x14b4f8542d4f141a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e4a expref: 54 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.223867:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf1200/0x14b4f8542d4f141a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1527808->1863679) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e4a expref: 54 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.223879:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.223880:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.223886:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.223894:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.223925:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.223935:0:10991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 35 pid: 25185 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.223945:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259605888:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065114.224010:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.226081:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259605888:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065114.226094:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.226132:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+53:1959:x1830881260737024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2343us (2986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.226140:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4953 00000100:00100000:0.0:1746065114.229960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.229990:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.230009:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260737536 00000100:00100000:1.0:1746065114.230173:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260737536 00002000:00100000:1.0:1746065114.230193:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009c124380 x1830881260737536/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.230201:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124380 with x1830881260737536 ext(1048576->2097151) 00010000:00010000:1.0:1746065114.230207:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 36 pid: 25185 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.230217:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 36 pid: 25185 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746065114.230222:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c124380 00000100:00100000:1.0:1746065114.230233:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1423 00000100:00100000:1.0:1746065114.230237:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+36:1960:x1830881260737536:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065114.230696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.230737:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260737664 00000100:00100000:1.0:1746065114.230741:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260737664 00010000:00010000:1.0:1746065114.230753:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.230768:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4954 00000100:00100000:1.0:1746065114.230772:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+37:1959:x1830881260737664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.230779:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065114.232689:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.232702:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.232718:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135034400/0x14b4f8542d4f13db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->917503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e0b expref: 37 pid: 21998 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.232728:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.232730:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.232736:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f14bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eb3 expref: 52 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.232743:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f14bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eb3 expref: 52 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.232768:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f14bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eb3 expref: 52 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.232778:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259606016:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065114.232843:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.235047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.237179:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259606016:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065114.237196:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.237231:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+37:1959:x1830881260737664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6457us (6535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.237238:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4954 00000100:00100000:1.0:1746065114.256453:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260738304 00000100:00100000:1.0:1746065114.256462:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260738304 00010000:00010000:1.0:1746065114.256497:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 35 pid: 25185 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.256539:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4955 00000100:00100000:1.0:1746065114.256547:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+35:1959:x1830881260738304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.256559:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065114.256579:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 35 pid: 25185 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.256591:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 35 pid: 25185 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.256612:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe14800/0x14b4f8542d4f1491 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e9e expref: 35 pid: 25185 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.256629:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.256631:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.256637:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d537600/0x14b4f8542d4f14c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1241087) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eba expref: 52 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.256649:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d537600/0x14b4f8542d4f14c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1241087) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eba expref: 52 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.256678:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d537600/0x14b4f8542d4f14c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1241087) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eba expref: 52 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.256688:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259606144:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065114.256761:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.259695:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259606144:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065114.259712:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.259749:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+34:1959:x1830881260738304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3203us (3427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.259759:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4955 00000100:00100000:1.0:1746065114.259789:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260738432 00000100:00100000:1.0:1746065114.259794:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260738432 00000100:00100000:1.0:1746065114.259836:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260738560 00000100:00100000:1.0:1746065114.259838:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260738560 00000100:00100000:1.0:1746065114.259850:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10031 00000100:00100000:1.0:1746065114.259857:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+35:1960:x1830881260738432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065114.259871:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.259884:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6600/0x14b4f8542d4f14ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59edd expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.259902:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.259904:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.259911:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6600/0x14b4f8542d4f14ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59edd expref: 36 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.259923:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6600/0x14b4f8542d4f14ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59edd expref: 36 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.259932:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6600, rc 0) 00000100:00100000:1.0:1746065114.260198:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+37:1960:x1830881260738432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 340us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.260202:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10031 00000100:00100000:0.0:1746065114.262899:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260738688 00000100:00100000:0.0:1746065114.262907:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260738688 00000100:00100000:0.0:1746065114.262945:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10033 00000100:00100000:0.0:1746065114.262953:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:28596:x1830881260738688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.262968:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.262984:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8000/0x14b4f8542d4f14fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59eeb expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.263009:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.263016:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.263018:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.263021:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8000/0x14b4f8542d4f14fa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eeb expref: 37 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.263043:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.263054:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 29 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.263064:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259606400:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065114.263132:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.266656:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259606400:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.266676:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8000/0x14b4f8542d4f14fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eeb expref: 37 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.266688:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b48f8000, rc 0) 00000100:00100000:1.0:1746065114.266724:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:28596:x1830881260738688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3772us (4244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.266730:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10033 00000100:00100000:0.0:1746065114.268711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.268743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.268928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.268978:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260739200 00000100:00100000:1.0:1746065114.268983:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260739200 00000100:00100000:1.0:1746065114.269003:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260739328 00000100:00100000:1.0:1746065114.269004:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260739328 00000100:00100000:1.0:1746065114.269015:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10034 00000100:00100000:1.0:1746065114.269020:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260739200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065114.269030:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.269044:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f1501 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59ef2 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.269092:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259606528:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065114.269161:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10035 00000100:00100000:0.0:1746065114.269168:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+35:1961:x1830881260739328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.269176:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.269185:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f1508 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59ef9 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.269207:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c124700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259606656:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065114.269650:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a590b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.269692:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.274196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.274283:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259606528:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.274315:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f1501 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ef2 expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.274327:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f1501 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ef2 expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.274337:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6200, rc 0) 00000100:00100000:1.0:1746065114.274392:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260739200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5371us (5683us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.274400:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10034 00000100:00100000:1.0:1746065114.275879:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c124700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259606656:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.275898:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f1508 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ef9 expref: 36 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.276648:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f1508 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ef9 expref: 36 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.276657:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b48f8400, rc 0) 00000100:00100000:1.0:1746065114.276809:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+35:1961:x1830881260739328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7640us (7879us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.276840:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10035 00000100:00100000:1.0:1746065114.283710:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260740224 00000100:00100000:1.0:1746065114.283718:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260740224 00010000:00010000:1.0:1746065114.283754:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 10 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.283781:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4956 00000100:00100000:1.0:1746065114.283789:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+10:1959:x1830881260740224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.283803:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065114.283843:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 10 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.283844:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260739968 00000100:00100000:0.0:1746065114.283848:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260739968 00000100:00100000:0.0:1746065114.283872:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260740096 00000100:00100000:0.0:1746065114.283874:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260740096 00000100:00100000:0.0:1746065114.283886:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10036 00000100:00100000:0.0:1746065114.283891:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881260739968:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.283902:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.283914:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8600/0x14b4f8542d4f150f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59f00 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.284061:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 12 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.284746:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.284749:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065114.284749:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259606912:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.284757:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8000/0x14b4f8542d4f14fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eeb expref: 14 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.284765:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8000/0x14b4f8542d4f14fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eeb expref: 14 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.284773:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c29c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065114.284785:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8000/0x14b4f8542d4f14fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eeb expref: 14 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.284793:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259607040:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065114.284849:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a590b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.291038:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259607040:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065114.291057:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.291091:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881260740224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7301us (7418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.291100:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4956 00010000:00010000:0.0:1746065114.291140:0:21235:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88009c127800 x1830881259606912) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 11 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746065114.291164:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bbf0c00/0x14b4f8542d4f1421 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1671167) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e51 expref: 11 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.291177:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c127800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259606912:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065114.291199:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8600/0x14b4f8542d4f150f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f00 expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.291210:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8600/0x14b4f8542d4f150f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f00 expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.291217:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b48f8600, rc 0) 00000100:00100000:0.0:1746065114.291235:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881260739968:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7344us (7634us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065114.291242:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10036 00000100:00100000:1.0:1746065114.321029:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+53:1961:x1830881260740736:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 24342us (27140us total) trans 0 rc 921600/921600 00000100:00100000:1.0:1746065114.321045:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4538 00002000:00100000:1.0:1746065114.321057:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880095355c00 x1830881260740736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 504/440 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 921600/921600 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.321066:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355c00 with x1830881260740736 ext(1048576->2097151) 00002000:00010000:1.0:1746065114.321071:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095355c00 00000100:00100000:0.0:1746065114.344264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.351928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.352003:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260741120 00000100:00100000:1.0:1746065114.352011:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260741120 00010000:00010000:1.0:1746065114.352040:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eac expref: 24 pid: 24350 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746065114.352062:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4957 00000100:00100000:1.0:1746065114.352068:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+24:1960:x1830881260741120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.352078:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065114.352084:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eac expref: 24 pid: 24350 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.352093:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe14000/0x14b4f8542d4f14b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eac expref: 24 pid: 24350 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.352110:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065114.352114:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f54e200/0x14b4f8542d4f1524 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065114.352122:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f54e200/0x14b4f8542d4f1524 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065114.352131:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f54e200/0x14b4f8542d4f1524 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065114.352145:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.352178:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+24:1960:x1830881260741120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 109us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.352184:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4957 00000100:00100000:0.0:1746065114.407575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.476094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065114.486846:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb31400/0x14b4f8542d4f131e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d78 expref: 8 pid: 21998 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746065114.486860:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095356300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259607424:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065114.486868:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135034600/0x14b4f8542d4f1284 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59d08 expref: 10 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.486875:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259607552:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065114.486898:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4f1547 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f1c expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.486907:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d75c200, rc 0) 00000100:00100000:0.0:1746065114.486940:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+9:28603:x1830881260741504:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5891us (10853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.486946:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10038 00000100:00100000:0.0:1746065114.489759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.490832:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260742144 00000100:00100000:1.0:1746065114.490839:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260742144 00002000:00100000:1.0:1746065114.490871:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1318912->1323007) req@ffff88009c125c00 x1830881260742144/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.490880:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125c00 with x1830881260742144 ext(1318912->1323007) 00002000:00010000:1.0:1746065114.490884:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c125c00 00000100:00100000:1.0:1746065114.490899:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4540 00000100:00100000:1.0:1746065114.490905:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+9:1961:x1830881260742144:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065114.491056:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+9:1961:x1830881260742144:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 151us (1303us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065114.491061:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4540 00002000:00100000:1.0:1746065114.491066:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1318912->1323007) req@ffff88009c125c00 x1830881260742144/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/4536 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.491073:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125c00 with x1830881260742144 ext(1318912->1323007) 00002000:00010000:1.0:1746065114.491075:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c125c00 00000100:00100000:0.0:1746065114.512285:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260742272 00000100:00100000:0.0:1746065114.512293:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260742272 00000100:00100000:0.0:1746065114.512356:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10039 00000100:00100000:0.0:1746065114.512364:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+9:28603:x1830881260742272:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065114.512380:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.512395:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2800/0x14b4f8542d4f154e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59f23 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.512428:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8000/0x14b4f8542d4f14fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eeb expref: 13 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.512435:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.512436:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.512439:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2800/0x14b4f8542d4f154e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f23 expref: 10 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.512465:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8000/0x14b4f8542d4f14fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eeb expref: 13 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.512476:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b48f8000/0x14b4f8542d4f14fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eeb expref: 13 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.512486:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259607808:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065114.512974:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.517938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.521030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.525571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.525788:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10041 00000100:00100000:1.0:1746065114.525796:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+7:1958:x1830881260742656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065114.525807:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.525837:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6000/0x14b4f8542d4f155c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59f31 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.525862:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259608192:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065114.526241:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.528395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065114.528468:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:1.0:1746065114.528473:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259608192:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.528490:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6000/0x14b4f8542d4f155c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f31 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.528500:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6000/0x14b4f8542d4f155c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f31 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.528512:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6000, rc 0) 00000100:00100000:1.0:1746065114.528530:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+7:1958:x1830881260742656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2735us (2965us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.528537:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10041 00000100:00100000:1.0:1746065114.528632:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260742912 00000100:00100000:1.0:1746065114.528637:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260742912 00002000:00100000:1.0:1746065114.528661:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37a:0x0] (1052672->1056767) req@ffff88009c126a00 x1830881260742912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.528669:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c126a00 with x1830881260742912 ext(1052672->1056767) 00002000:00010000:1.0:1746065114.528672:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c126a00 00000100:00100000:1.0:1746065114.528684:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4541 00000100:00100000:1.0:1746065114.528690:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881260742912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065114.528792:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881260742912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 102us (403us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065114.528797:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4541 00002000:00100000:1.0:1746065114.528801:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37a:0x0] (1052672->1056767) req@ffff88009c126a00 x1830881260742912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/4536 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.528808:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c126a00 with x1830881260742912 ext(1052672->1056767) 00002000:00010000:1.0:1746065114.528811:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c126a00 00000100:00100000:0.0:1746065114.543365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.543396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.543474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.570322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.571999:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.582380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.582469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.583242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.584772:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.584805:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.586497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.587232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.587793:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259608576:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.587811:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f156a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1257472->2097151] (req 1257472->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f3f expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.587831:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f13ba00, rc 0) 00000100:00100000:1.0:1746065114.587858:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:28607:x1830881260744192:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4187us (5389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.587864:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10043 00000100:00100000:1.0:1746065114.587883:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260744704 00000100:00100000:1.0:1746065114.587886:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260744704 00002000:00100000:1.0:1746065114.587908:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1056767) req@ffff880130446300 x1830881260744704/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 8680/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.587916:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446300 with x1830881260744704 ext(1048576->1056767) 00010000:00010000:1.0:1746065114.587922:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2800/0x14b4f8542d4f154e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f23 expref: 10 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.587931:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2800/0x14b4f8542d4f154e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f23 expref: 10 pid: 21235 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746065114.587938:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130446300 00000100:00100000:1.0:1746065114.587947:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260744960 00000100:00100000:1.0:1746065114.587949:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260744960 00002000:00100000:1.0:1746065114.587958:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880130445f80 x1830881260744960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.587964:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445f80 with x1830881260744960 ext(1048576->2097151) 00002000:00010000:1.0:1746065114.587967:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130445f80 00000100:00100000:1.0:1746065114.587975:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1426 00000100:00100000:1.0:1746065114.587980:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881260744704:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065114.588260:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260744704:12345-192.168.202.46@tcp:4:cat.0 Request processed in 278us (1762us total) trans 21474839915 rc 0/0 00000100:00100000:1.0:1746065114.588265:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1426 00002000:00100000:1.0:1746065114.588270:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1056767) req@ffff880130446300 x1830881260744704/t21474839915(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 8680/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.588276:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446300 with x1830881260744704 ext(1048576->1056767) 00010000:00010000:1.0:1746065114.588280:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2800/0x14b4f8542d4f154e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f23 expref: 12 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.588287:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2800/0x14b4f8542d4f154e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f23 expref: 12 pid: 21235 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746065114.588292:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130446300 00000100:00100000:1.0:1746065114.588302:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4545 00000100:00100000:1.0:1746065114.588307:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260744960:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:0.0:1746065114.590911:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065114 -> 1746065115 00002000:00010000:0.0:1746065114.590916:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime: 1746065113 -> 1746065115 00002000:00010000:0.0:1746065114.590918:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065114 -> 1746065115 00000100:00100000:0.0:1746065114.590934:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259608704:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065114.590957:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f13ae00/0x14b4f8542d4f1571 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f46 expref: 15 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.590968:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f13ae00/0x14b4f8542d4f1571 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f46 expref: 15 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.590988:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f13ae00, rc 0) 00000100:00100000:0.0:1746065114.591037:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881260744320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7226us (7795us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065114.591044:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10044 00000100:00100000:0.0:1746065114.595167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.601108:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260745216 00000100:00100000:0.0:1746065114.601115:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260745216 00000100:00100000:0.0:1746065114.601153:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10047 00000100:00100000:0.0:1746065114.601160:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:28614:x1830881260745216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.601176:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.601191:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0156e00/0x14b4f8542d4f1586 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59f5b expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.601215:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4f1547 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f1c expref: 11 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.601222:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.601223:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065114.601226:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0156e00/0x14b4f8542d4f1586 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f5b expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.601251:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4f1547 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f1c expref: 11 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.601262:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4f1547 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f1c expref: 11 pid: 21235 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746065114.601273:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259609088:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065114.601325:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.601470:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260744960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13160us (14237us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065114.601479:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4545 00002000:00100000:1.0:1746065114.601487:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880130445f80 x1830881260744960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/440 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.601496:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445f80 with x1830881260744960 ext(1048576->2097151) 00002000:00010000:1.0:1746065114.601500:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130445f80 00000100:00100000:0.0:1746065114.602539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.602609:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260745472 00000100:00100000:1.0:1746065114.602613:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260745472 00002000:00100000:1.0:1746065114.602637:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1257472->1261567) req@ffff880130447800 x1830881260745472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.602644:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447800 with x1830881260745472 ext(1257472->1261567) 00002000:00010000:1.0:1746065114.602648:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130447800 00000100:00100000:1.0:1746065114.602660:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4546 00000100:00100000:1.0:1746065114.602665:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881260745472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065114.604521:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881260745472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1848us (1977us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065114.604529:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4546 00002000:00100000:1.0:1746065114.604537:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1257472->1261567) req@ffff880130447800 x1830881260745472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 488/4536 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.604544:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447800 with x1830881260745472 ext(1257472->1261567) 00002000:00010000:1.0:1746065114.604548:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130447800 00000100:00100000:1.0:1746065114.604596:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259609088:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.604618:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0156e00/0x14b4f8542d4f1586 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f5b expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.604631:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0156e00, rc 0) 00000100:00100000:1.0:1746065114.604660:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:28614:x1830881260745216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3500us (3726us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.604665:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10047 00000100:00100000:1.0:1746065114.604722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.604752:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260745600 00000100:00100000:1.0:1746065114.604756:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260745600 00002000:00100000:1.0:1746065114.604777:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1318912->2097151) req@ffff880094ad4380 x1830881260745600/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.604784:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad4380 with x1830881260745600 ext(1318912->2097151) 00010000:00010000:1.0:1746065114.604789:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4f1547 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f1c expref: 11 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.604800:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4f1547 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f1c expref: 11 pid: 21235 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746065114.604805:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ad4380 00000100:00100000:1.0:1746065114.604848:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1427 00000100:00100000:1.0:1746065114.604854:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260745600:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065114.609322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.609379:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.609462:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260745728 00000100:00100000:1.0:1746065114.609470:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260745728 00000100:00100000:1.0:1746065114.609507:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260745856 00000100:00100000:1.0:1746065114.609509:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260745856 00000100:00100000:1.0:1746065114.609522:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10048 00000100:00100000:1.0:1746065114.609528:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260745728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065114.609544:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.609558:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7c00/0x14b4f8542d4f158d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59f62 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.609603:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259609216:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065114.609909:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.613695:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259609216:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.613723:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7c00/0x14b4f8542d4f158d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f62 expref: 16 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.613734:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7c00/0x14b4f8542d4f158d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f62 expref: 16 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.613759:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e7c00, rc 0) 00000100:00100000:1.0:1746065114.613794:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260745728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4265us (4480us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.613801:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10048 00000100:00100000:0.0:1746065114.615304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.616031:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881260745600:12345-192.168.202.46@tcp:4:cat.0 Request processed in 11176us (11309us total) trans 21474839916 rc 0/0 00000100:00100000:1.0:1746065114.616039:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1427 00002000:00100000:1.0:1746065114.616045:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1318912->2097151) req@ffff880094ad4380 x1830881260745600/t21474839916(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/448 e 0 to 0 dl 1746065125 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.616059:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad4380 with x1830881260745600 ext(1318912->2097151) 00010000:00010000:1.0:1746065114.616065:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4f1547 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f1c expref: 13 pid: 21235 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746065114.616073:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4f1547 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f1c expref: 13 pid: 21235 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746065114.616078:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ad4380 00000100:00100000:0.0:1746065114.617999:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260746240 00000100:00100000:0.0:1746065114.618005:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260746240 00000100:00100000:0.0:1746065114.618648:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260746112 00000100:00100000:0.0:1746065114.618651:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260746112 00000100:00100000:0.0:1746065114.618668:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10051 00000100:00100000:0.0:1746065114.618672:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260746240:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.618693:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.618704:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f15a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59f7e expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.618735:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259609728:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065114.618766:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.619028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.620254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.620942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.621219:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259609728:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.621239:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f15a2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f7e expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.621248:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f15a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f7e expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.621664:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0156800, rc 0) 00000100:00100000:1.0:1746065114.621689:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260746240:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3015us (3971us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.621694:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10051 00000100:00100000:0.0:1746065114.623808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.624043:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260746880 00000100:00100000:1.0:1746065114.624049:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260746880 00002000:00100000:1.0:1746065114.624079:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1130496->1134591) req@ffff880095352d80 x1830881260746880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.624088:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352d80 with x1830881260746880 ext(1130496->1134591) 00002000:00010000:1.0:1746065114.624094:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352d80 00000100:00100000:1.0:1746065114.624125:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4547 00000100:00100000:1.0:1746065114.624133:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260746880:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065114.624248:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260746880:12345-192.168.202.46@tcp:3:cat.0 Request processed in 115us (444us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065114.624254:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4547 00002000:00100000:1.0:1746065114.624259:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1130496->1134591) req@ffff880095352d80 x1830881260746880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 488/4536 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.624266:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352d80 with x1830881260746880 ext(1130496->1134591) 00002000:00010000:1.0:1746065114.624268:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352d80 00000100:00100000:0.0:1746065114.624372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.624383:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260747136 00000100:00100000:0.0:1746065114.624386:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260747136 00002000:00100000:0.0:1746065114.624400:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880095350700 x1830881260747136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.624416:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350700 with x1830881260747136 ext(1048576->2097151) 00002000:00010000:0.0:1746065114.624420:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350700 00000100:00100000:0.0:1746065114.624430:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4548 00000100:00100000:0.0:1746065114.624435:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881260747136:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065114.626187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.626211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.626230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.626244:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260747520 00000100:00100000:1.0:1746065114.626248:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260747520 00000100:00100000:1.0:1746065114.626267:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260747776 00000100:00100000:1.0:1746065114.626269:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260747776 00000100:00100000:1.0:1746065114.626282:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10053 00000100:00100000:1.0:1746065114.626287:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260747520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065114.626297:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.626310:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801355ec600/0x14b4f8542d4f15b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59f85 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.626326:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.626333:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.626339:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801355ec600/0x14b4f8542d4f15b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f85 expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.626356:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801355ec600/0x14b4f8542d4f15b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f85 expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.626364:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355ec600, rc 0) 00000100:00100000:1.0:1746065114.626389:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260747520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.626393:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10053 00000100:00100000:1.0:1746065114.626443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.636628:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881260747136:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12191us (12254us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065114.636634:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4548 00002000:00100000:0.0:1746065114.636640:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880095350700 x1830881260747136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:30/0 lens 488/440 e 0 to 0 dl 1746065125 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065114.636647:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350700 with x1830881260747136 ext(1048576->2097151) 00002000:00010000:0.0:1746065114.636650:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350700 00000100:00100000:0.0:1746065114.643808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065114.808388:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065114.858666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.860947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.872806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.872857:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.872870:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.872893:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.872926:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260748672 00000100:00100000:0.0:1746065114.872936:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260748672 00010000:00010000:0.0:1746065114.872964:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f54e200/0x14b4f8542d4f1524 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f0e expref: 46 pid: 24350 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065114.872982:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260748544 00000100:00100000:0.0:1746065114.872984:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260748544 00010000:00010000:0.0:1746065114.872991:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d200/0x14b4f8542d4f1539 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f15 expref: 288 pid: 24350 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065114.873000:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260748416 00000100:00100000:0.0:1746065114.873001:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260748416 00010000:00010000:0.0:1746065114.873009:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801355ec600/0x14b4f8542d4f15b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f85 expref: 15 pid: 25185 timeout: 814 lvb_type: 1 00000100:00100000:0.0:1746065114.873020:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4967 00000100:00100000:0.0:1746065114.873026:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+46:1958:x1830881260748672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.873038:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.873043:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f54e200/0x14b4f8542d4f1524 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f0e expref: 46 pid: 24350 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.873051:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f54e200/0x14b4f8542d4f1524 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f0e expref: 46 pid: 24350 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.873074:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065114.873079:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a800/0x14b4f8542d4f15da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065114.873084:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a800/0x14b4f8542d4f15da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065114.873088:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a800/0x14b4f8542d4f15da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065114.873092:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.873122:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+46:1958:x1830881260748672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.873127:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4967 00000100:00100000:0.0:1746065114.873142:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4968 00000100:00100000:0.0:1746065114.873145:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:1958:x1830881260748544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.873151:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.873154:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d200/0x14b4f8542d4f1539 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f15 expref: 288 pid: 24350 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.873160:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d200/0x14b4f8542d4f1539 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f15 expref: 288 pid: 24350 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.873169:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d200/0x14b4f8542d4f1539 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f15 expref: 288 pid: 24350 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.873182:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065114.873184:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a800/0x14b4f8542d4f15da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065114.873190:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a800/0x14b4f8542d4f15da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065114.873194:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13a800/0x14b4f8542d4f15da lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065114.873205:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.873214:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+287:1958:x1830881260748544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.873219:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4968 00000100:00100000:0.0:1746065114.873249:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4969 00000100:00100000:0.0:1746065114.873253:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260748416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.873259:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.873275:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801355ec600/0x14b4f8542d4f15b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f85 expref: 15 pid: 25185 timeout: 814 lvb_type: 1 00010000:00010000:0.0:1746065114.873282:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801355ec600/0x14b4f8542d4f15b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f85 expref: 15 pid: 25185 timeout: 814 lvb_type: 1 00010000:00010000:0.0:1746065114.873292:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801355ec600/0x14b4f8542d4f15b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f85 expref: 15 pid: 25185 timeout: 814 lvb_type: 1 00010000:00010000:0.0:1746065114.873301:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.873311:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260748416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.873315:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4969 00000100:00100000:1.0:1746065114.873471:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260748800 00000100:00100000:1.0:1746065114.873474:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260748800 00000100:00100000:1.0:1746065114.873492:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10057 00000100:00100000:1.0:1746065114.873497:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:28623:x1830881260748800:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065114.873508:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.873518:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942dda00/0x14b4f8542d4f15e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59fa8 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.873534:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff8d800/0x14b4f8542d4f13d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dfd expref: 13 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.873541:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e82 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.873546:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f54fa00/0x14b4f8542d4f13f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e27 expref: 16 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.873555:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.873556:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.873559:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942dda00/0x14b4f8542d4f15e8 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3448832->3653631] (req 3448832->3653631) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fa8 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.873578:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f54fa00/0x14b4f8542d4f13f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e27 expref: 16 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.873595:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f54fa00/0x14b4f8542d4f13f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e27 expref: 16 pid: 21235 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065114.873605:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259611008:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.873655:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e82 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.873663:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e82 expref: 6 pid: 8851 timeout: 814 lvb_type: 1 00000100:00100000:1.0:1746065114.873670:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259611136:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.873696:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff8d800/0x14b4f8542d4f13d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dfd expref: 13 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.873703:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff8d800/0x14b4f8542d4f13d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dfd expref: 13 pid: 21235 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065114.873716:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259611264:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065114.873733:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.875019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.875046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.875057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.875099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.875112:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260749312 00000100:00100000:0.0:1746065114.875115:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260749312 00010000:00010000:0.0:1746065114.875128:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0156e00/0x14b4f8542d4f1586 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f5b expref: 17 pid: 8851 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065114.875143:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4970 00000100:00100000:0.0:1746065114.875148:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881260749312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.875154:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.875166:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0156e00/0x14b4f8542d4f1586 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f5b expref: 17 pid: 8851 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.875173:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0156e00/0x14b4f8542d4f1586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f5b expref: 17 pid: 8851 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.875185:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0156e00/0x14b4f8542d4f1586 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f5b expref: 17 pid: 8851 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.875196:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.875197:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.875201:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.875206:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.875224:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.875233:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259611392:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065114.875271:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.875308:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260748928 00000100:00100000:0.0:1746065114.875311:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260748928 00000100:00100000:0.0:1746065114.875324:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260749056 00000100:00100000:0.0:1746065114.875326:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260749056 00000100:00100000:0.0:1746065114.875333:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260749184 00000100:00100000:0.0:1746065114.875335:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260749184 00000100:00100000:0.0:1746065114.875345:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10058 00000100:00100000:0.0:1746065114.875350:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260748928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.875357:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.875363:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0157a00/0x14b4f8542d4f15ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59faf expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.875388:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259611520:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065114.875418:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.875431:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10059 00000100:00100000:0.0:1746065114.875436:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260749056:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.875441:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.875447:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0157200/0x14b4f8542d4f15f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59fb6 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.875465:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259611648:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065114.875481:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.875512:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10060 00000100:00100000:0.0:1746065114.875517:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+7:1958:x1830881260749184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065114.875524:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.875532:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6000/0x14b4f8542d4f15fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59fbd expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.875550:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259611776:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065114.875568:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.883221:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259611008:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065114.883229:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259611136:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065114.883237:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259611264:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.883257:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942dda00/0x14b4f8542d4f15e8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3448832->3653631] (req 3448832->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fa8 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.883265:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942dda00, rc 0) 00000100:00100000:1.0:1746065114.883280:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:28623:x1830881260748800:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9783us (10387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.883285:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10057 00000100:00100000:1.0:1746065114.883298:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10063 00000100:00100000:1.0:1746065114.883303:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260750080:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065114.883308:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.883313:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f1612 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59fe0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.883322:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065114.883328:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f1612 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fe0 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.883335:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800953d3000/0x14b4f8542d4f1612 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fe0 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.883348:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953d3000, rc 0) 00000100:00100000:1.0:1746065114.883358:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260750080:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 56us (664us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.883363:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10063 00000100:00100000:1.0:1746065114.883370:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10064 00000100:00100000:1.0:1746065114.883375:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260749696:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065114.883379:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.883389:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f1619 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59fcb expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.883416:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259612032:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065114.883433:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.883489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.883498:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260749952 00000100:00100000:0.0:1746065114.883503:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260749952 00000100:00100000:1.0:1746065114.883504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.883515:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260749440 00000100:00100000:1.0:1746065114.883518:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260749440 00000100:00100000:0.0:1746065114.883520:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10065 00000100:00100000:0.0:1746065114.883524:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260749952:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065114.883529:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e82 expref: 11 pid: 8851 timeout: 814 lvb_type: 1 00010000:00010000:0.0:1746065114.883531:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065114.883538:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d59800/0x14b4f8542d4f1620 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59fd9 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.883544:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4971 00000100:00100000:1.0:1746065114.883548:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881260749440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.883555:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065114.883560:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259612160:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.883571:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e82 expref: 11 pid: 8851 timeout: 814 lvb_type: 1 00000100:00100000:0.0:1746065114.883580:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fc00 going to sleep for 11 seconds 00010000:00010000:1.0:1746065114.883583:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e82 expref: 11 pid: 8851 timeout: 814 lvb_type: 1 00010000:00010000:1.0:1746065114.883594:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6e00/0x14b4f8542d4f1467 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e82 expref: 11 pid: 8851 timeout: 814 lvb_type: 1 00010000:00010000:1.0:1746065114.883601:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065114.883614:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260749440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.883619:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4971 00000100:00100000:0.0:1746065114.883622:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259611392:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065114.883631:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065114.883649:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881260749312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8501us (8550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065114.883655:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4970 00000100:00100000:1.0:1746065114.883674:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259611520:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.883688:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0157a00/0x14b4f8542d4f15ef lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59faf expref: 16 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.883696:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0157a00/0x14b4f8542d4f15ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59faf expref: 16 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.883702:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0157a00, rc 0) 00000100:00100000:1.0:1746065114.883718:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260748928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8369us (8700us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.883723:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10058 00000100:00100000:1.0:1746065114.889582:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259611648:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.889599:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0157200/0x14b4f8542d4f15f6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fb6 expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.889614:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0157200/0x14b4f8542d4f15f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fb6 expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.889622:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0157200, rc 0) 00000100:00100000:1.0:1746065114.889640:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881260749056:12345-192.168.202.46@tcp:101:cat.0 Request processed in 14204us (14593us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.889645:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10059 00000100:00100000:1.0:1746065114.889667:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260750464 00000100:00100000:1.0:1746065114.889672:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260750464 00010000:00010000:1.0:1746065114.889690:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff8d800/0x14b4f8542d4f13d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dfd expref: 13 pid: 21235 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065114.889704:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260750592 00000100:00100000:1.0:1746065114.889706:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260750592 00010000:00010000:1.0:1746065114.889714:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f54fa00/0x14b4f8542d4f13f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e27 expref: 15 pid: 21235 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065114.889731:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4972 00000100:00100000:1.0:1746065114.889737:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1959:x1830881260750464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065114.889746:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065114.889755:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff8d800/0x14b4f8542d4f13d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dfd expref: 13 pid: 21235 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065114.889763:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff8d800/0x14b4f8542d4f13d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dfd expref: 13 pid: 21235 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065114.889781:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff8d800/0x14b4f8542d4f13d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59dfd expref: 13 pid: 21235 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065114.890933:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259611776:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.890939:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065114.890948:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6000/0x14b4f8542d4f15fd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fbd expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065114.890956:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881260750464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1218us (1491us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065114.890960:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6000/0x14b4f8542d4f15fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fbd expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065114.890962:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4972 00010000:00010000:0.0:1746065114.890967:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6000, rc 0) 00000100:00100000:0.0:1746065114.890979:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+7:1958:x1830881260749184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 15462us (15921us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065114.890995:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10060 00000100:00100000:0.0:1746065114.894920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.897038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.897075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.897078:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260750720 00000100:00100000:1.0:1746065114.897084:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260750720 00000100:00100000:1.0:1746065114.897111:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10066 00000100:00100000:1.0:1746065114.897117:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881260750720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065114.897130:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.897141:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953d2e00/0x14b4f8542d4f1635 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59fe7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.897174:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259612544:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065114.897210:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.904047:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259612544:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065114.904073:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800953d2e00/0x14b4f8542d4f1635 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fe7 expref: 15 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.904085:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800953d2e00/0x14b4f8542d4f1635 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fe7 expref: 15 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065114.904098:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953d2e00, rc 0) 00000100:00100000:1.0:1746065114.904135:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881260750720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7017us (7101us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065114.904142:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10066 00000100:00100000:0.0:1746065114.904769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.905712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.913978:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.917620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.917677:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260751872 00000100:00100000:1.0:1746065114.917686:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260751872 00000100:00100000:1.0:1746065114.917733:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10067 00000100:00100000:1.0:1746065114.917740:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:28629:x1830881260751872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065114.917754:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.917773:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e59ffc expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.917797:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 13 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.917804:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065114.917806:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065114.917809:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ffc expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.917861:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 13 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.917871:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 13 pid: 25185 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065114.917881:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259612800:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065114.919677:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.925605:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259612800:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065114.925631:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ffc expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.925644:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942dce00, rc 0) 00000100:00100000:1.0:1746065114.928759:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:28629:x1830881260751872:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11013us (11141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.928768:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10067 00000100:00100000:0.0:1746065114.928987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.929025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.936575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.936647:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.937946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.937970:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260752768 00000100:00100000:1.0:1746065114.937978:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260752768 00000100:00100000:1.0:1746065114.938026:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260752896 00000100:00100000:1.0:1746065114.938029:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260752896 00000100:00100000:1.0:1746065114.938044:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10068 00000100:00100000:1.0:1746065114.938052:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:28620:x1830881260752768:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065114.938067:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.938081:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942dd400/0x14b4f8542d4f1658 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a003 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.938105:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f156a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f3f expref: 14 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.938112:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065114.938113:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065114.938116:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942dd400/0x14b4f8542d4f1658 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->1540095] (req 1048576->1540095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a003 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.938142:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f156a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f3f expref: 14 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.938154:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f13ba00/0x14b4f8542d4f156a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f3f expref: 14 pid: 4545 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065114.938164:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259612928:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065114.938223:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065114.938242:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10069 00000100:00100000:1.0:1746065114.938246:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260752896:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065114.938252:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.938258:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e47400/0x14b4f8542d4f165f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a00a expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065114.938280:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259613056:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065114.938295:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.938512:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.938925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.938954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065114.941810:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260753152 00000100:00100000:1.0:1746065114.942006:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260753152 00002000:00100000:1.0:1746065114.942056:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1994752->2097151) req@ffff88012d50aa00 x1830881260753152/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:30/0 lens 488/0 e 0 to 0 dl 1746065125 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065114.942065:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50aa00 with x1830881260753152 ext(1994752->2097151) 00010000:00010000:1.0:1746065114.942074:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 14 pid: 25185 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065114.942086:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 14 pid: 25185 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746065114.942097:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d50aa00 00000100:00100000:1.0:1746065114.942124:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1428 00000100:00100000:1.0:1746065114.942132:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260753152:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065114.943207:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259613056:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065114.943237:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e47400/0x14b4f8542d4f165f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a00a expref: 7 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.943248:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e47400/0x14b4f8542d4f165f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a00a expref: 7 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065114.943268:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e47400, rc 0) 00000100:00100000:0.0:1746065114.943294:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260752896:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5047us (6646us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065114.943301:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10069 00000100:00100000:1.0:1746065114.949619:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260753664 00000100:00100000:1.0:1746065114.949625:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260753664 00000100:00100000:1.0:1746065114.949661:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10073 00000100:00100000:1.0:1746065114.949668:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:28626:x1830881260753664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065114.949680:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065114.949694:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0200/0x14b4f8542d4f167b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a026 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.949714:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065114.949718:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942dd400/0x14b4f8542d4f1658 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->1540095] (req 1048576->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a003 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.949724:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065114.949726:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0200/0x14b4f8542d4f167b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a026 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.949755:0:4544:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942dd400/0x14b4f8542d4f1658 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->1540095] (req 1048576->1540095) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a003 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.949766:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0200/0x14b4f8542d4f167b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a026 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065114.949779:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e8b0200, rc 0) 00000100:00100000:1.0:1746065114.949830:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:28626:x1830881260753664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 145us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065114.949835:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10073 00000100:00100000:0.0:1746065114.957164:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260753792 00000100:00100000:0.0:1746065114.957173:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260753792 00010000:00010000:0.0:1746065114.957205:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 16 pid: 25185 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746065114.957244:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4976 00000100:00100000:0.0:1746065114.957252:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881260753792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065114.957263:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065114.957282:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 16 pid: 25185 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.957293:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 16 pid: 25185 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.957313:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c76dc00/0x14b4f8542d4f15e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59f9a expref: 16 pid: 25185 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065114.957338:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.957340:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065114.957345:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ffc expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.957353:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ffc expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065114.957381:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ffc expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065114.957391:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259613696:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065114.957473:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065114.964804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.964858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.977459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.977588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.988424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.994281:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.994984:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065114.997672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.012986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065115.014227:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065115.022801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.027908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.050992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065115.051469:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065115.056361:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.062317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.067921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.067988:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260756864 00000100:00100000:0.0:1746065115.067994:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260756864 00002000:00100000:0.0:1746065115.068021:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88008fd04a80 x1830881260756864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 504/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.068029:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04a80 with x1830881260756864 ext(3145728->4194303) 00002000:00010000:0.0:1746065115.068032:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd04a80 00000100:00100000:0.0:1746065115.068046:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4559 00000100:00100000:0.0:1746065115.068052:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260756864:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065115.072037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.072087:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260757248 00000100:00100000:1.0:1746065115.072095:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260757248 00000100:00100000:1.0:1746065115.072151:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8880 00000100:00100000:1.0:1746065115.072159:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:28634:x1830881260757248:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065115.072175:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.072190:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f169e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a042 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.072263:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9200/0x14b4f8542d4f16a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.072275:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13bc00/0x14b4f8542d4f164a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ff5 expref: 25 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.072281:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9200/0x14b4f8542d4f16a5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.072305:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13bc00/0x14b4f8542d4f164a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ff5 expref: 25 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.072314:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f13bc00/0x14b4f8542d4f164a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ff5 expref: 25 pid: 20754 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065115.072328:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259614336:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.072393:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00080000:1.0:1746065115.072475:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065115.074872:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.078736:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259614336:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.078756:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9200/0x14b4f8542d4f16a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065115.082365:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065115.083466:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065115.085699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065115.086367:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9200/0x14b4f8542d4f16a5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.086376:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9200/0x14b4f8542d4f16a5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065115.086392:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065115.086507:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f169e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a042 expref: 291 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.086534:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9200/0x14b4f8542d4f16a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a042 expref: 290 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.086541:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065115.086543:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065115.086546:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e9200, rc 0) 00000100:00100000:1.0:1746065115.086569:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+290:28634:x1830881260757248:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 14412us (14539us total) trans 8589942900 rc 0/0 00000100:00100000:1.0:1746065115.086575:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8880 00000100:00100000:1.0:1746065115.086710:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881260756864:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18658us (18790us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065115.086716:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4559 00002000:00100000:1.0:1746065115.086721:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88008fd04a80 x1830881260756864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 504/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.086728:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04a80 with x1830881260756864 ext(3145728->4194303) 00002000:00010000:1.0:1746065115.086731:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd04a80 00000100:00100000:0.0:1746065115.120603:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260757888 00000100:00100000:0.0:1746065115.120609:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260757888 00000100:00100000:0.0:1746065115.120639:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10076 00000100:00100000:0.0:1746065115.120645:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260757888:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065115.120657:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.120671:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbcca00/0x14b4f8542d4f16b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a049 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.120690:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.120692:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.120699:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbcca00/0x14b4f8542d4f16b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a049 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065115.120712:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbcca00/0x14b4f8542d4f16b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a049 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065115.120721:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbcca00, rc 0) 00000100:00100000:0.0:1746065115.120736:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881260757888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 92us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.120741:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10076 00000100:00100000:0.0:1746065115.131767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.131842:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260758144 00000100:00100000:1.0:1746065115.131849:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260758144 00000100:00100000:1.0:1746065115.131889:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8881 00000100:00100000:1.0:1746065115.131894:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+46:28636:x1830881260758144:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065115.131912:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.131923:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f200/0x14b4f8542d4f16ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a050 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.131989:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8ea00/0x14b4f8542d4f16c1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.131998:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8ea00/0x14b4f8542d4f16c1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.132041:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8ea00/0x14b4f8542d4f16c1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065115.132048:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00010000:00010000:1.0:1746065115.132121:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f200/0x14b4f8542d4f16ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a050 expref: 49 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.132145:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8ea00/0x14b4f8542d4f16c1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a050 expref: 48 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.132150:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065115.132152:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065115.132154:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8ea00, rc 0) 00000100:00100000:1.0:1746065115.132191:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+48:28636:x1830881260758144:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 296us (431us total) trans 8589942901 rc 0/0 00000100:00100000:1.0:1746065115.132195:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8881 00000100:00100000:0.0:1746065115.138395:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.156300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.173911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.177182:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.188988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.189429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.196484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.200631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.200670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.203577:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4564 00000100:00100000:0.0:1746065115.203588:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260759680:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065115.227639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.228260:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.228428:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260760192 00000100:00100000:1.0:1746065115.228432:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260760192 00000100:00100000:1.0:1746065115.228461:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10080 00000100:00100000:1.0:1746065115.228467:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:28634:x1830881260760192:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065115.228474:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.228485:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f16e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a06c expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.228502:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0200/0x14b4f8542d4f167b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a026 expref: 18 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.228510:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090499200/0x14b4f8542d4f1690 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a034 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.228515:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.228517:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.228519:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f16e4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1953792->2097151] (req 1953792->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a06c expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.228544:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090499200/0x14b4f8542d4f1690 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a034 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.228554:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090499200/0x14b4f8542d4f1690 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a034 expref: 19 pid: 25185 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065115.228564:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259615232:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.228618:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0200/0x14b4f8542d4f167b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a026 expref: 17 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.228626:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0200/0x14b4f8542d4f167b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a026 expref: 17 pid: 4544 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065115.228633:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259615360:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.228648:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065115.230347:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259615232:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.230357:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259615360:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.230377:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f16e4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1953792->2097151] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a06c expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.230387:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8e600, rc 0) 00000100:00100000:1.0:1746065115.230426:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:28634:x1830881260760192:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1958us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.230435:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10080 00000100:00100000:0.0:1746065115.231539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.232366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.232506:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260760576 00000100:00100000:1.0:1746065115.232510:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260760576 00000100:00100000:1.0:1746065115.232543:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10081 00000100:00100000:1.0:1746065115.232552:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260760576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.232563:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.232572:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4f16eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a073 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.232588:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.232595:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4f16eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a073 expref: 19 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.232602:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4f16eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a073 expref: 19 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.232623:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8e400, rc 0) 00000100:00100000:1.0:1746065115.232645:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260760576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 96us (279us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065115.232650:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10081 00000100:00100000:0.0:1746065115.234370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.235307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.241172:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.246835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.259780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.259884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.259940:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10085 00000100:00100000:1.0:1746065115.259948:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260761216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.259955:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.259963:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f1707 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a08f expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.259977:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.259979:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.259984:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f1707 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a08f expref: 19 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.259997:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f1707 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a08f expref: 19 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.260005:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8fe00, rc 0) 00000100:00100000:1.0:1746065115.260019:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881260761216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 74us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.260024:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10085 00000100:00100000:0.0:1746065115.263437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.274096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.274146:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.274200:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260761600 00000100:00100000:1.0:1746065115.274209:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260761600 00002000:00100000:1.0:1746065115.274243:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1953791) req@ffff88012bd3e680 x1830881260761600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.274252:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e680 with x1830881260761600 ext(1048576->1953791) 00002000:00010000:1.0:1746065115.274256:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3e680 00000100:00100000:1.0:1746065115.274279:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260761856 00000100:00100000:1.0:1746065115.274281:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260761856 00002000:00100000:1.0:1746065115.274290:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1814528->1818623) req@ffff88012f3d0000 x1830881260761856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.274296:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0000 with x1830881260761856 ext(1814528->1818623) 00002000:00010000:1.0:1746065115.274298:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d0000 00000100:00100000:1.0:1746065115.274307:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4565 00000100:00100000:1.0:1746065115.274313:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881260761600:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065115.274558:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4566 00000100:00100000:0.0:1746065115.274564:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260761856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065115.274675:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260761856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 111us (528us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065115.275225:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4566 00002000:00100000:0.0:1746065115.275231:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1814528->1818623) req@ffff88012f3d0000 x1830881260761856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/4536 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.275237:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0000 with x1830881260761856 ext(1814528->1818623) 00002000:00010000:0.0:1746065115.275241:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d0000 00000100:00100000:1.0:1746065115.285941:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881260761600:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11618us (11844us total) trans 0 rc 905216/905216 00000100:00100000:1.0:1746065115.285952:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4565 00002000:00100000:1.0:1746065115.285962:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1953791) req@ffff88012bd3e680 x1830881260761600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 905216/905216 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.285972:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e680 with x1830881260761600 ext(1048576->1953791) 00002000:00010000:1.0:1746065115.285976:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3e680 00000100:00100000:0.0:1746065115.293128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.293225:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260762112 00000100:00100000:1.0:1746065115.293235:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260762112 00002000:00100000:1.0:1746065115.293274:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1818624->2097151) req@ffff88009ba3f100 x1830881260762112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.293284:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f100 with x1830881260762112 ext(1818624->2097151) 00002000:00010000:1.0:1746065115.293288:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3f100 00000100:00100000:1.0:1746065115.293319:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4567 00000100:00100000:1.0:1746065115.293326:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260762112:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065115.298049:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260762112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 4714us (4919us total) trans 0 rc 278528/278528 00000100:00100000:1.0:1746065115.298060:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4567 00002000:00100000:1.0:1746065115.298070:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1818624->2097151) req@ffff88009ba3f100 x1830881260762112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 278528/278528 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.298079:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f100 with x1830881260762112 ext(1818624->2097151) 00002000:00010000:1.0:1746065115.298083:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3f100 00000100:00100000:0.0:1746065115.315430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.315482:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.317827:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4569 00000100:00100000:0.0:1746065115.317836:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881260762624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065115.332653:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881260762624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14809us (17162us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065115.332664:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4569 00002000:00100000:1.0:1746065115.332674:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009ba3ce00 x1830881260762624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.332684:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3ce00 with x1830881260762624 ext(3145728->4194303) 00002000:00010000:1.0:1746065115.332689:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3ce00 00000100:00100000:0.0:1746065115.423498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.432412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.432461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.432506:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260763008 00000100:00100000:1.0:1746065115.432516:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260763008 00010000:00010000:1.0:1746065115.432632:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e4200/0x14b4f8542d4f16cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a057 expref: 18 pid: 21235 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065115.432653:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4987 00000100:00100000:1.0:1746065115.432658:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260763008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.432665:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.432674:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938e4200/0x14b4f8542d4f16cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a057 expref: 18 pid: 21235 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.432686:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938e4200/0x14b4f8542d4f16cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a057 expref: 18 pid: 21235 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.432796:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e4200/0x14b4f8542d4f16cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a057 expref: 18 pid: 21235 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.433471:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.433554:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260763008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 894us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.433560:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4987 00000100:00100000:0.0:1746065115.437598:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260763264 00000100:00100000:0.0:1746065115.437605:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260763264 00002000:00100000:0.0:1746065115.437638:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3776512->3780607) req@ffff88009f046a00 x1830881260763264/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.437646:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046a00 with x1830881260763264 ext(3776512->3780607) 00002000:00010000:0.0:1746065115.437650:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f046a00 00000100:00100000:0.0:1746065115.437685:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4570 00000100:00100000:0.0:1746065115.437691:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260763264:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065115.437860:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260763264:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 168us (1322us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065115.437866:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4570 00002000:00100000:0.0:1746065115.437871:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3776512->3780607) req@ffff88009f046a00 x1830881260763264/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:31/0 lens 488/4536 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.437878:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046a00 with x1830881260763264 ext(3776512->3780607) 00002000:00010000:0.0:1746065115.437881:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f046a00 00000100:00100000:0.0:1746065115.441191:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.463983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.464029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.464093:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260763648 00000100:00100000:1.0:1746065115.464100:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260763648 00000100:00100000:1.0:1746065115.464151:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10087 00000100:00100000:1.0:1746065115.464158:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260763648:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.464174:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.464190:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f1715 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a09d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.464233:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259616512:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065115.464306:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065115.469707:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259616512:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065115.469734:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f1715 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a09d expref: 18 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.469746:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f1715 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a09d expref: 18 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.469757:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8fe00, rc 0) 00000100:00100000:1.0:1746065115.469789:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260763648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5631us (5814us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065115.469796:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10087 00000100:00100000:0.0:1746065115.471588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.476420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.498862:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.500421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.507769:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260764800 00000100:00100000:1.0:1746065115.507776:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260764800 00002000:00100000:1.0:1746065115.507809:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1953792->2097151) req@ffff88008fd06a00 x1830881260764800/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.507832:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06a00 with x1830881260764800 ext(1953792->2097151) 00010000:00010000:1.0:1746065115.507840:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f16e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a06c expref: 18 pid: 25185 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.507852:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f16e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a06c expref: 18 pid: 25185 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746065115.507859:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd06a00 00000100:00100000:1.0:1746065115.507875:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1435 00000100:00100000:1.0:1746065115.507881:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260764800:12345-192.168.202.46@tcp:4:multiop.0 00000100:00080000:1.0:1746065115.508834:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065115.509609:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259617024:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065115.509623:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe14a00/0x14b4f8542d4f1452 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59e7b expref: 6 pid: 9716 timeout: 814 lvb_type: 1 00000100:00100000:0.0:1746065115.509653:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259617152:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065115.509666:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259617280:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065115.509690:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bbf0e00/0x14b4f8542d4f1731 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->2236415] (req 2097152->2236415) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b9 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.509699:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bbf0e00, rc 0) 00000100:00100000:0.0:1746065115.509725:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28647:x1830881260764672:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9201us (9306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.509731:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10091 00000100:00100000:0.0:1746065115.509769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.510220:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260765184 00000100:00100000:1.0:1746065115.510224:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260765184 00010000:00010000:1.0:1746065115.510251:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6d90a00/0x14b4f8542d4f136b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59db7 expref: 9 pid: 9716 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065115.510278:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4989 00000100:00100000:1.0:1746065115.510284:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:1958:x1830881260765184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.510291:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.510306:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6d90a00/0x14b4f8542d4f136b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59db7 expref: 9 pid: 9716 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.510315:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6d90a00/0x14b4f8542d4f136b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59db7 expref: 9 pid: 9716 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.510339:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6d90a00/0x14b4f8542d4f136b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59db7 expref: 9 pid: 9716 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.510351:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.510370:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:1958:x1830881260765184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.510375:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4989 00000100:00100000:1.0:1746065115.515834:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881260764800:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 7935us (8124us total) trans 21474839921 rc 0/0 00000100:00100000:1.0:1746065115.515844:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1435 00002000:00100000:1.0:1746065115.515854:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1953792->2097151) req@ffff88008fd06a00 x1830881260764800/t21474839921(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/448 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.515862:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06a00 with x1830881260764800 ext(1953792->2097151) 00010000:00010000:1.0:1746065115.515871:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f16e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a06c expref: 20 pid: 25185 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.515882:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f16e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a06c expref: 20 pid: 25185 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746065115.515888:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd06a00 00000100:00100000:0.0:1746065115.516966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.519584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.519958:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260765568 00000100:00100000:1.0:1746065115.519963:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260765568 00002000:00100000:1.0:1746065115.519986:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2232320->2236415) req@ffff8800a5882300 x1830881260765568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.519999:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882300 with x1830881260765568 ext(2232320->2236415) 00010000:00010000:1.0:1746065115.520005:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf0e00/0x14b4f8542d4f1731 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b9 expref: 30 pid: 21998 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.520015:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf0e00/0x14b4f8542d4f1731 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b9 expref: 30 pid: 21998 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746065115.520020:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5882300 00000100:00100000:1.0:1746065115.520044:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1436 00000100:00100000:1.0:1746065115.520050:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260765568:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065115.520315:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260765568:12345-192.168.202.46@tcp:3:cat.0 Request processed in 264us (3349us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065115.520322:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1436 00002000:00100000:1.0:1746065115.520327:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2232320->2236415) req@ffff8800a5882300 x1830881260765568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/4536 e 0 to 0 dl 1746065126 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.520333:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882300 with x1830881260765568 ext(2232320->2236415) 00010000:00010000:1.0:1746065115.520338:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf0e00/0x14b4f8542d4f1731 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b9 expref: 30 pid: 21998 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746065115.520346:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf0e00/0x14b4f8542d4f1731 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b9 expref: 30 pid: 21998 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746065115.520351:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5882300 00000100:00100000:0.0:1746065115.524422:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260765952 00000100:00100000:0.0:1746065115.524428:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260765952 00002000:00100000:0.0:1746065115.524463:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2236415) req@ffff88008fd07480 x1830881260765952/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.524472:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07480 with x1830881260765952 ext(2097152->2236415) 00010000:00010000:0.0:1746065115.524479:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bbf0e00/0x14b4f8542d4f1731 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b9 expref: 30 pid: 21998 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746065115.524490:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bbf0e00/0x14b4f8542d4f1731 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b9 expref: 30 pid: 21998 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746065115.524497:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd07480 00000100:00100000:0.0:1746065115.524520:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1437 00000100:00100000:0.0:1746065115.524526:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260765952:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065115.524950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.525098:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260766208 00000100:00100000:1.0:1746065115.525102:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260766208 00002000:00100000:1.0:1746065115.525118:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a5880380 x1830881260766208/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.525125:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880380 with x1830881260766208 ext(1048576->2097151) 00002000:00010000:1.0:1746065115.525128:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880380 00000100:00100000:1.0:1746065115.525181:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4574 00000100:00100000:1.0:1746065115.525187:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+18:1958:x1830881260766208:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065115.530643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.532301:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+18:1958:x1830881260766208:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7111us (7348us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065115.532309:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4574 00002000:00100000:1.0:1746065115.532318:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a5880380 x1830881260766208/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.532326:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880380 with x1830881260766208 ext(1048576->2097151) 00002000:00010000:1.0:1746065115.532330:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880380 00000100:00100000:0.0:1746065115.536491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.537214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.537331:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260766720 00000100:00100000:1.0:1746065115.537336:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260766720 00002000:00100000:1.0:1746065115.537360:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f046d80 x1830881260766720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.537369:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046d80 with x1830881260766720 ext(2097152->3145727) 00002000:00010000:1.0:1746065115.537373:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f046d80 00000100:00100000:1.0:1746065115.537390:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4575 00000100:00100000:1.0:1746065115.537395:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260766720:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065115.542849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.552453:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260766720:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15046us (15228us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065115.552465:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4575 00002000:00100000:0.0:1746065115.552479:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f046d80 x1830881260766720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.552489:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046d80 with x1830881260766720 ext(2097152->3145727) 00002000:00010000:0.0:1746065115.552496:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f046d80 00000100:00100000:0.0:1746065115.554244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.563408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.568325:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.572170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.573863:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.576124:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.585371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.585418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.585444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.585695:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260768128 00000100:00100000:1.0:1746065115.585703:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260768128 00000100:00100000:1.0:1746065115.585716:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260768384 00000100:00100000:1.0:1746065115.585718:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260768384 00002000:00100000:1.0:1746065115.585750:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009b9ff100 x1830881260768384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.585764:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff100 with x1830881260768384 ext(3145728->4194303) 00002000:00010000:1.0:1746065115.585768:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9ff100 00000100:00100000:1.0:1746065115.585783:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260768640 00000100:00100000:1.0:1746065115.585785:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260768640 00002000:00100000:1.0:1746065115.585797:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009b9fc380 x1830881260768640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.585803:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fc380 with x1830881260768640 ext(3145728->4194303) 00002000:00010000:1.0:1746065115.585806:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fc380 00002000:00100000:1.0:1746065115.586114:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009b9fdc00 x1830881260768128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.586121:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdc00 with x1830881260768128 ext(2097152->3145727) 00002000:00010000:1.0:1746065115.586123:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fdc00 00000100:00100000:1.0:1746065115.586133:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4580 00000100:00100000:1.0:1746065115.586137:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881260768128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065115.595763:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260768128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9615us (10389us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065115.595775:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4580 00002000:00100000:1.0:1746065115.595786:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009b9fdc00 x1830881260768128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.595794:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdc00 with x1830881260768128 ext(2097152->3145727) 00002000:00010000:1.0:1746065115.595799:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fdc00 00000100:00100000:0.0:1746065115.596154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.603197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.608303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.609980:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.610000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.610032:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.610045:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260769920 00000100:00100000:1.0:1746065115.610048:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260769920 00000100:00100000:1.0:1746065115.610067:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10097 00000100:00100000:1.0:1746065115.610073:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260769920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.610080:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.610094:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a0e3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.610108:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.610110:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.610116:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0e3 expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.610127:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0e3 expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.610135:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130dd3800, rc 0) 00000100:00100000:1.0:1746065115.610165:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881260769920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 92us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.610170:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10097 00000100:00100000:1.0:1746065115.610203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.610214:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260770048 00000100:00100000:1.0:1746065115.610216:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260770048 00000100:00100000:1.0:1746065115.610229:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10098 00000100:00100000:1.0:1746065115.610233:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881260770048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.610240:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.610248:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130dd3400/0x14b4f8542d4f1762 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a0ea expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.610258:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.610259:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.610263:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130dd3400/0x14b4f8542d4f1762 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ea expref: 33 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.610271:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130dd3400/0x14b4f8542d4f1762 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ea expref: 33 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.610278:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130dd3400, rc 0) 00000100:00100000:1.0:1746065115.610292:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260770048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 58us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.610297:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10098 00000100:00100000:0.0:1746065115.610979:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4583 00000100:00100000:0.0:1746065115.610986:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260769536:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065115.624650:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260769536:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13658us (14676us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065115.624659:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4583 00002000:00100000:1.0:1746065115.624667:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880135cdd880 x1830881260769536/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.624675:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd880 with x1830881260769536 ext(3145728->4194303) 00002000:00010000:1.0:1746065115.624679:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdd880 00000100:00100000:0.0:1746065115.636208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.696728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.696863:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260770432 00000100:00100000:1.0:1746065115.696873:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260770432 00000100:00100000:1.0:1746065115.697299:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8882 00000100:00100000:1.0:1746065115.697307:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28663:x1830881260770432:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065115.697328:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.697342:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4f1769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a0f1 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.697446:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.697457:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.697464:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.697475:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.697480:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.697484:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.697572:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.697580:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9200/0x14b4f8542d4f16a5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a042 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.697586:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8ea00/0x14b4f8542d4f16c1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a050 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.697591:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 5/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.697615:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8ea00/0x14b4f8542d4f16c1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a050 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.697626:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8ea00/0x14b4f8542d4f16c1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a050 expref: 10 pid: 24350 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065115.697635:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259618432:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.698289:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9200/0x14b4f8542d4f16a5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a042 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.698297:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9200/0x14b4f8542d4f16a5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a042 expref: 250 pid: 24350 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746065115.698305:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259618560:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.698326:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.700530:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.700650:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259618432:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.700660:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259618560:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.700682:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065115.700752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.705603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065115.707242:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707249:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065115.707282:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 8965632 00000004:00200000:1.0:1746065115.707286:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065115.707299:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707307:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707314:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707319:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707325:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707329:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093966400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065115.707332:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707337:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707345:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065115.707347:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065115.707350:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707354:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093966400/0x14b4f8542d4f1770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707366:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707370:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707375:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707379:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093967400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065115.707381:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707384:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707389:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5eed500) 00010000:00010000:1.0:1746065115.707391:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065115.707393:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707408:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4f1777 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.707437:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4f1769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0f1 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.707446:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0f1 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.707452:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065115.707454:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065115.707455:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012edc1400, rc 0) 00000100:00100000:1.0:1746065115.707479:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28663:x1830881260770432:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 10173us (10763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.707484:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8882 00000100:00100000:0.0:1746065115.714279:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260771072 00000100:00100000:0.0:1746065115.714287:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260771072 00000100:00100000:1.0:1746065115.714296:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260771328 00000100:00100000:1.0:1746065115.714301:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260771328 00000100:00100000:0.0:1746065115.714319:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260771584 00000100:00100000:0.0:1746065115.714321:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260771584 00000100:00100000:1.0:1746065115.714338:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260771200 00000100:00100000:1.0:1746065115.714340:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260771200 00000100:00100000:0.0:1746065115.714349:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260771456 00000100:00100000:0.0:1746065115.714353:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260771456 00000100:00100000:1.0:1746065115.714356:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10099 00000100:00100000:1.0:1746065115.714362:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260771072:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:0.0:1746065115.714376:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10100 00010000:00010000:1.0:1746065115.714377:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065115.714384:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881260771328:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065115.714392:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf800/0x14b4f8542d4f1785 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a0f8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.714394:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.714420:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.714420:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130dd2600/0x14b4f8542d4f178c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a106 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.714422:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.714430:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf800/0x14b4f8542d4f1785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0f8 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065115.714435:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.714436:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.714443:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130dd2600/0x14b4f8542d4f178c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a106 expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.714445:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf800/0x14b4f8542d4f1785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0f8 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.714454:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3bf800, rc 0) 00010000:00010000:0.0:1746065115.714456:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130dd2600/0x14b4f8542d4f178c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a106 expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065115.714464:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130dd2600, rc 0) 00000100:00100000:1.0:1746065115.714489:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260771072:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 127us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.714491:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260771328:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 107us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.714494:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10099 00000100:00100000:0.0:1746065115.714498:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10100 00000100:00100000:1.0:1746065115.714510:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10101 00000100:00100000:1.0:1746065115.714514:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260771584:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:0.0:1746065115.714516:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10102 00010000:00010000:1.0:1746065115.714519:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065115.714523:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260771200:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065115.714524:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3bfe00/0x14b4f8542d4f1793 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a114 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.714531:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.714535:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.714536:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.714539:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a0ff expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.714540:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3bfe00/0x14b4f8542d4f1793 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a114 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.714551:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f3bfe00/0x14b4f8542d4f1793 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a114 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065115.714551:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.714552:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.714557:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3bfe00, rc 0) 00010000:00010000:0.0:1746065115.714557:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ff expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065115.714566:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ff expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065115.714570:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260771584:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 56us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.714574:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10101 00010000:00010000:0.0:1746065115.714574:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130dd3c00, rc 0) 00000100:00100000:0.0:1746065115.714595:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260771200:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 72us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.714808:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10103 00000100:00100000:1.0:1746065115.714830:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881260771456:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065115.714835:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.714842:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a10d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.714850:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.714851:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.714854:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a10d expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.714862:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a10d expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.714872:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3bf600, rc 0) 00000100:00100000:1.0:1746065115.714884:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260771456:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 72us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.714949:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10102 00000100:00100000:1.0:1746065115.715429:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10103 00000100:00100000:1.0:1746065115.720438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.720654:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260771840 00000100:00100000:0.0:1746065115.720662:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260771840 00000100:00100000:0.0:1746065115.720764:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8883 00000100:00100000:0.0:1746065115.720772:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28663:x1830881260771840:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065115.720790:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.720806:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd2800/0x14b4f8542d4f17a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a11b expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.720912:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3200/0x14b4f8542d4f17af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065115.720925:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0f1 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.720931:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3200/0x14b4f8542d4f17af lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065115.720957:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0f1 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.720967:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4f177e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0f1 expref: 9 pid: 24350 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065115.720977:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259618688:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065115.721576:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.724342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.727275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.732229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.759197:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.790775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.790876:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260772864 00000100:00100000:1.0:1746065115.790884:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260772864 00000100:00100000:1.0:1746065115.790934:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10104 00000100:00100000:1.0:1746065115.790940:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:28666:x1830881260772864:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065115.790962:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.790977:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f17e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a130 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.791002:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c774200/0x14b4f8542d4f1746 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ce expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.791009:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bfe00/0x14b4f8542d4f1793 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a114 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.791015:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c775a00/0x14b4f8542d4f1754 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0dc expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.791021:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.791022:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.791025:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f17e0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2142208->2588671] (req 2142208->2588671) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a130 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.791053:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c775a00/0x14b4f8542d4f1754 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0dc expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.791065:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c775a00/0x14b4f8542d4f1754 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0dc expref: 19 pid: 8428 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.791075:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259618816:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.792155:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3bfe00/0x14b4f8542d4f1793 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a114 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.792170:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f3bfe00/0x14b4f8542d4f1793 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a114 expref: 8 pid: 8428 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.792178:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259618944:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.792658:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c774200/0x14b4f8542d4f1746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ce expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.792668:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c774200/0x14b4f8542d4f1746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ce expref: 22 pid: 8428 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.792675:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259619072:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.793150:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.801388:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.801423:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259618816:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065115.801432:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.801434:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259618944:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.801602:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259619072:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.801631:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f17e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2142208->2588671] (req 2142208->2588671) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a130 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.801644:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3be800, rc 0) 00000100:00100000:1.0:1746065115.801677:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:28666:x1830881260772864:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10737us (10909us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.801683:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10104 00000100:00100000:0.0:1746065115.804422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.806570:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259619200:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065115.806588:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065115.806624:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260773248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2073us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.806632:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5000 00000100:00100000:0.0:1746065115.808689:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.817599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.834269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.834331:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260773888 00000100:00100000:1.0:1746065115.834339:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260773888 00000100:00100000:1.0:1746065115.834387:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10105 00000100:00100000:1.0:1746065115.834403:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:28662:x1830881260773888:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065115.834418:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.834434:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a137 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.834460:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f14bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eb3 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.834468:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f1604 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fc4 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.834474:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6600/0x14b4f8542d4f14ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59edd expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.834484:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.834486:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.834489:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [552960->1048575] (req 552960->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.834515:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6600/0x14b4f8542d4f14ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59edd expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.834525:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6600/0x14b4f8542d4f14ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59edd expref: 11 pid: 8851 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.834536:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259619328:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.834627:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f1604 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fc4 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.834634:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f1604 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fc4 expref: 7 pid: 8428 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.834641:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259619456:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.834661:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f14bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eb3 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.834667:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f14bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59eb3 expref: 30 pid: 25185 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.834678:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259619584:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.834691:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.838779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.839131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065115.841488:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6600/0x14b4f8542d4f14ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59edd expref: 11 pid: 8851 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.841563:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259619328:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.841578:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f1604 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59fc4 expref: 7 pid: 8428 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.841586:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259619456:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.841594:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259619584:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.841625:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [552960->1048575] (req 552960->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.841634:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093967000, rc 0) 00000100:00100000:1.0:1746065115.841669:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:28662:x1830881260773888:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7275us (7407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.841674:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10105 00000100:00100000:0.0:1746065115.842070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.848630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.850183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.851059:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260774656 00000100:00100000:1.0:1746065115.851066:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260774656 00000100:00100000:1.0:1746065115.851117:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10106 00000100:00100000:1.0:1746065115.851124:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260774656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.851138:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.851153:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f17ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a13e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.851198:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259619840:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065115.851269:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.852696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.856529:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.859337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065115.859490:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime: 1746065115 -> 1746065116 00002000:00010000:1.0:1746065115.859494:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime: 1746065115 -> 1746065116 00002000:00010000:1.0:1746065115.859496:0:8428:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime: 1746065115 -> 1746065116 00000100:00100000:1.0:1746065115.859512:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259619840:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065115.859534:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f17ee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a13e expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.859675:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f17ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a13e expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.859689:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3be000, rc 0) 00000100:00100000:1.0:1746065115.859702:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260774656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8580us (9522us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065115.859706:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10106 00000100:00100000:1.0:1746065115.863727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.863764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.863802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.863858:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260775552 00000100:00100000:1.0:1746065115.863866:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260775552 00000100:00100000:0.0:1746065115.864040:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5005 00000100:00100000:0.0:1746065115.864047:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881260775424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065115.864055:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.864163:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ffc expref: 21 pid: 8429 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.864183:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5006 00000100:00100000:1.0:1746065115.864188:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881260775552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.864197:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065115.864349:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c774400/0x14b4f8542d4f16dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a065 expref: 20 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.864352:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ffc expref: 21 pid: 8429 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.864358:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c774400/0x14b4f8542d4f16dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a065 expref: 20 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065115.865655:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c774400/0x14b4f8542d4f16dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a065 expref: 20 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.866018:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ffc expref: 21 pid: 8429 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.866027:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065115.866033:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942dce00/0x14b4f8542d4f1651 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e59ffc expref: 21 pid: 8429 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.866047:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065115.866048:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260775424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2001us (2245us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065115.866049:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.866054:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f1811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a14c expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065115.866055:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5005 00010000:00010000:1.0:1746065115.866062:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f1811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a14c expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.866087:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f1811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a14c expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.866097:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259620480:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065115.866143:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.866795:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.867201:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260775808 00000100:00100000:1.0:1746065115.867206:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260775808 00000100:00100000:1.0:1746065115.867230:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10108 00000100:00100000:1.0:1746065115.867235:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28675:x1830881260775808:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.867248:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.867260:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f1818 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a153 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.867277:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.867283:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065115.867284:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065115.867287:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f1818 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a153 expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.867303:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.867313:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 9 pid: 8428 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.867321:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259620608:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.867375:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.872341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.872363:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260775936 00000100:00100000:0.0:1746065115.872370:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260775936 00002000:00100000:0.0:1746065115.872420:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37d:0x0] (552960->1048575) req@ffff88012b4b1180 x1830881260775936/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.872431:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b1180 with x1830881260775936 ext(552960->1048575) 00010000:00010000:0.0:1746065115.872438:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 10 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.872451:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 10 pid: 8428 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065115.872457:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b1180 00000100:00100000:0.0:1746065115.872486:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1439 00000100:00100000:0.0:1746065115.872493:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260775936:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065115.872548:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259620480:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065115.872566:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.872601:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881260775552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8412us (8884us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.872610:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5006 00000100:00100000:0.0:1746065115.876635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.882283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.884207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.885021:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260777216 00000100:00100000:1.0:1746065115.885026:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260777216 00010000:00010000:1.0:1746065115.885048:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f180a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a145 expref: 12 pid: 24350 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.885064:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5008 00000100:00100000:1.0:1746065115.885069:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260777216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.885077:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.885082:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f180a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a145 expref: 12 pid: 24350 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.885090:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f180a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a145 expref: 12 pid: 24350 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.885107:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f180a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a145 expref: 12 pid: 24350 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.885131:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065115.885136:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f183b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.885143:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f183b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.885149:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f183b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.885164:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.885353:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260777216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 283us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.885360:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5008 00000100:00100000:0.0:1746065115.886000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.886062:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260777344 00000100:00100000:1.0:1746065115.886066:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260777344 00010000:00010000:1.0:1746065115.886080:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 552960->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 12 pid: 8428 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.886107:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5009 00000100:00100000:1.0:1746065115.886112:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260777344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.886119:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.886134:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 552960->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 12 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.886143:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 552960->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 12 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.886156:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093967000/0x14b4f8542d4f17e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 552960->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a137 expref: 12 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.886167:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.886169:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.886174:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f1818 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a153 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.886180:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f1818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a153 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.886212:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f1818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a153 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.886222:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259621248:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065115.886276:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.887481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.888451:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259621248:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065115.888466:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.888496:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881260777344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2383us (2497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.888503:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5009 00000100:00100000:0.0:1746065115.890562:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.890609:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260777728 00000100:00100000:1.0:1746065115.890615:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260777728 00000100:00100000:0.0:1746065115.890627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065115.890636:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f183b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a16f expref: 13 pid: 24350 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.890783:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5010 00000100:00100000:1.0:1746065115.890790:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260777728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.890799:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.890803:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f183b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a16f expref: 13 pid: 24350 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.890812:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f183b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a16f expref: 13 pid: 24350 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.890855:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f183b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a16f expref: 13 pid: 24350 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.890868:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065115.890871:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89800/0x14b4f8542d4f1850 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.890879:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89800/0x14b4f8542d4f1850 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.890884:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89800/0x14b4f8542d4f1850 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.891127:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.891162:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260777728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 372us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.891168:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5010 00000100:00100000:0.0:1746065115.894978:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.895238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.896147:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260778240 00000100:00100000:0.0:1746065115.896150:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260778240 00000100:00100000:0.0:1746065115.896168:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10114 00000100:00100000:0.0:1746065115.896173:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260778240:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065115.896179:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.896185:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b64a800/0x14b4f8542d4f1865 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a18b expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065115.896206:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259621632:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065115.897078:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065115.897331:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259621632:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065115.897346:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b64a800/0x14b4f8542d4f1865 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a18b expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.897354:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b64a800/0x14b4f8542d4f1865 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a18b expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.897360:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b64a800, rc 0) 00000100:00100000:1.0:1746065115.897380:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260778240:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1207us (1339us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065115.897385:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10114 00000100:00100000:0.0:1746065115.897752:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260777856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6800us (7123us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065115.897759:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4590 00002000:00100000:0.0:1746065115.897766:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012b4b3100 x1830881260777856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065115.897774:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b3100 with x1830881260777856 ext(0->1048575) 00002000:00010000:0.0:1746065115.897778:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4b3100 00000100:00100000:0.0:1746065115.899604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.902146:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.902205:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260778624 00000100:00100000:1.0:1746065115.902212:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260778624 00000100:00100000:1.0:1746065115.902260:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10115 00000100:00100000:1.0:1746065115.902267:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260778624:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065115.902298:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.902313:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f1818 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a153 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.902319:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350aea00/0x14b4f8542d4f185e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a17d expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.902324:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.902326:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.902328:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.902352:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350aea00/0x14b4f8542d4f185e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a17d expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.902363:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350aea00/0x14b4f8542d4f185e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a17d expref: 8 pid: 8427 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.902374:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259621760:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.902463:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f1818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a153 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.902471:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f1818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a153 expref: 30 pid: 8428 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.902478:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259621888:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.902497:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.902702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.902749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.902793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.902858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.902917:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260778752 00000100:00100000:1.0:1746065115.902921:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260778752 00000100:00100000:1.0:1746065115.902938:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260778880 00000100:00100000:1.0:1746065115.902939:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260778880 00000100:00100000:1.0:1746065115.902949:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260779136 00000100:00100000:1.0:1746065115.902950:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260779136 00000100:00100000:1.0:1746065115.903413:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10117 00000100:00100000:1.0:1746065115.903420:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260778880:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065115.903436:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903445:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f172a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b2 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903451:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ff expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.903457:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0e3 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.903462:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.903463:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.903465:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903481:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0e3 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.903488:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0e3 expref: 19 pid: 8428 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.903495:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259622272:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.903524:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10119 00000100:00100000:1.0:1746065115.903529:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260779136:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065115.903542:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903549:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4e00/0x14b4f8542d4f1738 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0c0 expref: 30 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903556:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a10d expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.903562:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c774c00/0x14b4f8542d4f174d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0d5 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903567:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.903568:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.903570:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903587:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c774c00/0x14b4f8542d4f174d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0d5 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903594:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c774c00/0x14b4f8542d4f174d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0d5 expref: 10 pid: 8428 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.903600:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259622656:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.903621:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a10d expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.903628:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a10d expref: 10 pid: 8428 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.903635:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259622784:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.903656:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4e00/0x14b4f8542d4f1738 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0c0 expref: 30 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903663:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4e00/0x14b4f8542d4f1738 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0c0 expref: 30 pid: 21235 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.903670:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259622912:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.903683:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a90846c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065115.903698:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ff expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.903710:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ff expref: 8 pid: 21235 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.903717:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259623040:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.903752:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f172a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b2 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.903759:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f172a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b2 expref: 18 pid: 21235 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.903766:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259623168:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.903781:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.904122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.904156:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.904169:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260779264 00000100:00100000:0.0:1746065115.904173:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260779264 00000100:00100000:0.0:1746065115.904202:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260779392 00000100:00100000:0.0:1746065115.904205:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260779392 00000100:00100000:0.0:1746065115.904216:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10120 00000100:00100000:0.0:1746065115.904221:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260779264:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065115.904236:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b64ac00/0x14b4f8542d4f18a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.904246:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f17e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2588671) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a130 expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.904251:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.904252:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065115.904254:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b64ac00/0x14b4f8542d4f18a4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.904271:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f17e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2588671) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a130 expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.904279:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f17e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2588671) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a130 expref: 20 pid: 8428 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065115.904285:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259623296:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065115.904317:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065115.905564:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259621760:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.905574:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259621888:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.905593:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065115.906186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.906341:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260779520 00000100:00100000:1.0:1746065115.906345:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260779520 00010000:00010000:1.0:1746065115.906365:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350aea00/0x14b4f8542d4f185e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a17d expref: 11 pid: 8427 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.906404:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5011 00000100:00100000:1.0:1746065115.906410:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260779520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.906419:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.906436:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350aea00/0x14b4f8542d4f185e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a17d expref: 11 pid: 8427 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.906445:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350aea00/0x14b4f8542d4f185e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a17d expref: 11 pid: 8427 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.906462:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350aea00/0x14b4f8542d4f185e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a17d expref: 11 pid: 8427 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.906471:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.906493:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260779520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.906499:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5011 00000100:00100000:1.0:1746065115.907438:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259622656:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.907448:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259622784:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.907456:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259622912:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.907479:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.908184:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259622272:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.908192:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259623040:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065115.908198:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259623168:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065115.908215:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065115.912743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.913611:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.913640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.913659:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.913672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.913706:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260779648 00000100:00100000:0.0:1746065115.913710:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260779648 00000100:00100000:1.0:1746065115.913713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.913724:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260779904 00010000:00010000:0.0:1746065115.913725:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130dd3400/0x14b4f8542d4f1762 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ea expref: 31 pid: 21235 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.913726:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260779904 00010000:00010000:1.0:1746065115.913737:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c775400/0x14b4f8542d4f173f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0c7 expref: 11 pid: 8428 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065115.913740:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260780160 00000100:00100000:0.0:1746065115.913742:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260780160 00000100:00100000:1.0:1746065115.913745:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260780416 00000100:00100000:1.0:1746065115.913747:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260780416 00010000:00010000:0.0:1746065115.913749:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3be000/0x14b4f8542d4f1818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a153 expref: 32 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.913754:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0e3 expref: 22 pid: 8428 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065115.913756:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260780800 00000100:00100000:0.0:1746065115.913757:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260780800 00000100:00100000:1.0:1746065115.913762:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5012 00010000:00010000:0.0:1746065115.913764:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f172a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b2 expref: 19 pid: 21235 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.913766:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881260779648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065115.913773:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5013 00010000:00010000:1.0:1746065115.913774:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065115.913777:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881260779904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065115.913781:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.913788:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130dd3400/0x14b4f8542d4f1762 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ea expref: 32 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065115.913788:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c775400/0x14b4f8542d4f173f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0c7 expref: 11 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.913797:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130dd3400/0x14b4f8542d4f1762 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ea expref: 32 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065115.914285:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c775400/0x14b4f8542d4f173f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0c7 expref: 11 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.914298:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130dd3400/0x14b4f8542d4f1762 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ea expref: 31 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.914420:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065115.914421:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c775400/0x14b4f8542d4f173f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0c7 expref: 11 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.914433:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.914437:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260779648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 670us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.914442:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5012 00000100:00100000:0.0:1746065115.914444:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260779904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 667us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.914449:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5013 00000100:00100000:1.0:1746065115.914457:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5015 00000100:00100000:1.0:1746065115.914461:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260780416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.914469:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.914478:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0e3 expref: 22 pid: 8428 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.914486:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0e3 expref: 22 pid: 8428 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.914497:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130dd3800/0x14b4f8542d4f175b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0e3 expref: 23 pid: 8428 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.914505:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.914519:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260780416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 57us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.914677:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5016 00000100:00100000:0.0:1746065115.914683:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260780800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065115.914688:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065115.914695:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f172a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b2 expref: 19 pid: 21235 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.914702:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f172a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b2 expref: 19 pid: 21235 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.914713:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f172a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0b2 expref: 19 pid: 21235 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065115.914720:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065115.914731:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260780800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.914735:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5016 00000100:00100000:0.0:1746065115.914763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.914775:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260779776 00000100:00100000:0.0:1746065115.914778:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260779776 00010000:00010000:0.0:1746065115.914786:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130dd2600/0x14b4f8542d4f178c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a106 expref: 10 pid: 21235 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065115.914802:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5017 00000100:00100000:0.0:1746065115.914805:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260779776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065115.914810:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065115.914828:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130dd2600/0x14b4f8542d4f178c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a106 expref: 10 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065115.914835:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130dd2600/0x14b4f8542d4f178c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a106 expref: 10 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065115.914844:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130dd2600/0x14b4f8542d4f178c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a106 expref: 10 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065115.914850:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.914852:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065115.914854:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f1896 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.914860:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f1896 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.914877:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065115.914888:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260779776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.914892:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5017 00000100:00100000:0.0:1746065115.914932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.914941:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260780032 00000100:00100000:0.0:1746065115.914944:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260780032 00010000:00010000:0.0:1746065115.914953:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a10d expref: 9 pid: 8428 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065115.914967:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5018 00000100:00100000:0.0:1746065115.914971:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260780032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065115.914976:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065115.914983:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a10d expref: 9 pid: 8428 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065115.914989:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a10d expref: 9 pid: 8428 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065115.914998:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f17a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a10d expref: 9 pid: 8428 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065115.915006:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065115.915019:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260780032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.915023:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5018 00000100:00100000:0.0:1746065115.915057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.915092:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5015 00010000:00010000:1.0:1746065115.915128:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915135:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915151:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915157:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915163:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915167:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c774400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065115.915170:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915175:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915183:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915187:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c774400/0x14b4f8542d4f1881 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.915213:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881260778624:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 12947us (13072us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.915219:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10115 00000100:00100000:0.0:1746065115.915432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.915457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.915482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.915529:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260780544 00000100:00100000:1.0:1746065115.915532:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260780544 00010000:00010000:1.0:1746065115.915544:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ff expref: 10 pid: 21235 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065115.915556:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260780928 00000100:00100000:1.0:1746065115.915557:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260780928 00010000:00010000:1.0:1746065115.915564:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4e00/0x14b4f8542d4f1738 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0c0 expref: 29 pid: 21235 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065115.915576:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5019 00000100:00100000:1.0:1746065115.915580:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260780544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.915585:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.915592:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ff expref: 10 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.915597:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ff expref: 10 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.915608:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4f179a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0ff expref: 10 pid: 21235 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746065115.915614:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.915615:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.915618:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915623:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915640:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.915656:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260780544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 75us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.915661:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5019 00000100:00100000:1.0:1746065115.915671:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5021 00000100:00100000:1.0:1746065115.915675:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:1959:x1830881260781056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065115.915681:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065115.915688:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c774c00/0x14b4f8542d4f174d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0d5 expref: 10 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.915699:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c774c00/0x14b4f8542d4f174d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0d5 expref: 10 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.915710:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c774c00/0x14b4f8542d4f174d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a0d5 expref: 10 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065115.915716:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.915717:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.915719:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915724:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915735:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065115.915748:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:1959:x1830881260781056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.915754:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5021 00010000:00010000:1.0:1746065115.915769:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915775:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915787:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915792:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915798:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915803:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f3bf400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065115.915805:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915811:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915838:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915843:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf400/0x14b4f8542d4f189d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.915870:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1961:x1830881260779136:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 12341us (13012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.915875:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10119 00010000:00010000:1.0:1746065115.915890:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915896:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915907:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915912:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915918:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915922:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094977400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065115.915924:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915929:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915943:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.915948:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f188f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.915972:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260778880:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 12554us (13223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.915977:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10117 00000100:00100000:0.0:1746065115.926079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.926183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.926226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.926286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.926299:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260781184 00000100:00100000:1.0:1746065115.926305:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260781184 00000100:00100000:1.0:1746065115.926334:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260781440 00000100:00100000:1.0:1746065115.926336:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260781440 00000100:00100000:1.0:1746065115.926347:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260781696 00000100:00100000:1.0:1746065115.926349:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260781696 00000100:00100000:1.0:1746065115.926360:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10122 00000100:00100000:1.0:1746065115.926367:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260781184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.926380:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.926403:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a1a0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065115.926420:0:4544:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6dc, atime: 0x6812d6db, ctime: 0x6812d6dc, blocks: 0x7ed 00010000:00010000:1.0:1746065115.926434:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.926436:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.926442:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a0 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.926454:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a0 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.926468:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d75e400, rc 0) 00000100:00100000:1.0:1746065115.926775:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260781184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 405us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.926780:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10122 00000100:00100000:1.0:1746065115.926789:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10125 00000100:00100000:1.0:1746065115.926793:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260781312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.926799:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.926804:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d75f000/0x14b4f8542d4f18c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a1a7 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.926872:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259623424:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065115.926926:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065115.927079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.927150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.927291:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260781568 00000100:00100000:1.0:1746065115.927297:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260781568 00000100:00100000:1.0:1746065115.927319:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260781824 00000100:00100000:1.0:1746065115.927323:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260781824 00000100:00100000:1.0:1746065115.927338:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10126 00000100:00100000:1.0:1746065115.927343:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260781568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.927352:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.927361:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f18ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a1b5 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065115.927374:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6dc, atime: 0x6812d6dc, ctime: 0x6812d6dc, blocks: 0x821 00010000:00010000:1.0:1746065115.927384:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.927386:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065115.927392:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f18ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1b5 expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.927418:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f18ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1b5 expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.927425:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3bf600, rc 0) 00000100:00100000:1.0:1746065115.927454:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260781568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.927459:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10126 00000100:00100000:1.0:1746065115.927470:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10127 00000100:00100000:1.0:1746065115.927475:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260781824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065115.927480:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.927485:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf800/0x14b4f8542d4f18d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a1c3 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065115.927511:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259623552:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065115.927541:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a90840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065115.929812:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259623552:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065115.929851:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf800/0x14b4f8542d4f18d5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1c3 expref: 24 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.929862:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf800/0x14b4f8542d4f18d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1c3 expref: 24 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.930206:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3bf800, rc 0) 00000100:00100000:1.0:1746065115.930248:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260781824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2771us (3098us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065115.930255:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10127 00000100:00100000:1.0:1746065115.930293:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259623424:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065115.930308:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d75f000/0x14b4f8542d4f18c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a7 expref: 22 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.930317:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d75f000/0x14b4f8542d4f18c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a7 expref: 22 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065115.930324:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d75f000, rc 0) 00000100:00100000:1.0:1746065115.930430:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260781312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3635us (4141us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065115.930435:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10125 00000100:00100000:0.0:1746065115.930461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.932453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.934750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.936535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.936632:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260782592 00000100:00100000:1.0:1746065115.936637:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260782592 00002000:00100000:1.0:1746065115.936660:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b45d880 x1830881260782592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.936667:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881260782592 ext(1048576->2097151) 00002000:00010000:1.0:1746065115.936671:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45d880 00000100:00100000:1.0:1746065115.937264:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4592 00000100:00100000:1.0:1746065115.937272:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881260782592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065115.945294:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.949697:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881260782592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12424us (13163us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065115.949704:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4592 00002000:00100000:1.0:1746065115.949709:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b45d880 x1830881260782592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.949717:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881260782592 ext(1048576->2097151) 00002000:00010000:1.0:1746065115.949721:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45d880 00000100:00100000:0.0:1746065115.949792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.956737:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260783872 00000100:00100000:0.0:1746065115.956759:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260783872 00000100:00100000:0.0:1746065115.956836:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8891 00000100:00100000:0.0:1746065115.956843:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28681:x1830881260783872:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065115.956860:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065115.956870:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009488fe00/0x14b4f8542d4f18ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a1ca expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.957043:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009488f800/0x14b4f8542d4f18f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065115.957054:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009488f800/0x14b4f8542d4f18f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065115.957062:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009488f800/0x14b4f8542d4f18f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065115.957073:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2f200/0x14b4f8542d4f18f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065115.957078:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2f200/0x14b4f8542d4f18f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065115.957087:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2f200/0x14b4f8542d4f18f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065115.957273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.958011:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.958875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.958889:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260784256 00000100:00100000:0.0:1746065115.958893:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260784256 00000100:00100000:0.0:1746065115.958909:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260784384 00000100:00100000:0.0:1746065115.958910:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260784384 00000100:00100000:0.0:1746065115.959487:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8892 00000100:00100000:0.0:1746065115.959494:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:28675:x1830881260784256:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065115.959504:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065115.959506:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8893 00000100:00100000:1.0:1746065115.959511:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+8:28679:x1830881260784384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065115.959513:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e8fe00/0x14b4f8542d4f1906 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a1df expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.959519:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065115.959523:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3bee00/0x14b4f8542d4f190d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a1e6 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.959540:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4114400/0x14b4f8542d4f18dc lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065115.959551:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e8fe00/0x14b4f8542d4f1906 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1df expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.959840:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3bee00/0x14b4f8542d4f190d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1e6 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.959849:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3bee00/0x14b4f8542d4f190d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1e6 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.959849:0:14643:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4114400/0x14b4f8542d4f18dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065115.959859:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065115.959861:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065115.959864:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e8fe00/0x14b4f8542d4f1906 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1df expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065115.959869:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3bee00, rc 0) 00010000:00010000:0.0:1746065115.959870:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e8fe00/0x14b4f8542d4f1906 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1df expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.959876:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065115.959879:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065115.959881:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e8fe00/0x14b4f8542d4f1906 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1df expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065115.959885:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e8fe00, rc 0) 00000100:00100000:1.0:1746065115.959895:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:28679:x1830881260784384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 384us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065115.959901:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8893 00000100:00100000:0.0:1746065115.960079:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28675:x1830881260784256:12345-192.168.202.46@tcp:101:cat.0 Request processed in 585us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065115.960084:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8892 00000100:00100000:1.0:1746065115.983923:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259624704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065115.983959:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065115.983979:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259625216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065115.983993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065115.984007:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065115.984012:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259624832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065115.984027:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065115.984037:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259625344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065115.984050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065115.984070:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259624704 00000100:00100000:1.0:1746065115.984076:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259624704 00000100:00100000:1.0:1746065115.984110:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259625216 00000100:00100000:1.0:1746065115.984112:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259625216 00000100:00100000:1.0:1746065115.984122:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259624832 00000100:00100000:1.0:1746065115.984124:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259624832 00000100:00100000:1.0:1746065115.984131:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259625344 00000100:00100000:1.0:1746065115.984133:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259625344 00000100:00100000:1.0:1746065115.984144:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10130 00000100:00100000:1.0:1746065115.984150:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881259624704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065115.984297:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065115.984300:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065116 -> 1746065116 00002000:00010000:1.0:1746065115.984302:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065115.984304:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065116 -> 1746065116 00002000:00010000:1.0:1746065115.984306:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2029 -> 2029 00000100:00100000:1.0:1746065115.984330:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881259624704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (371us total) trans 17179872680 rc 0/0 00000100:00100000:1.0:1746065115.984336:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10130 00000100:00100000:1.0:1746065115.984348:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10131 00000100:00100000:1.0:1746065115.984352:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881259625216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065115.984440:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065115.984443:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065115.984444:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065115.984446:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065115.984447:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065115.984465:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881259625216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (471us total) trans 17179872681 rc 0/0 00000100:00100000:1.0:1746065115.984470:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10131 00000100:00100000:1.0:1746065115.984479:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10132 00000100:00100000:1.0:1746065115.984483:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881259624832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065115.984548:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065115.984550:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065116 -> 1746065116 00002000:00010000:1.0:1746065115.984552:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065116 -> 1746065116 00002000:00010000:1.0:1746065115.984553:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065116 -> 1746065116 00002000:00010000:1.0:1746065115.984554:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065115.984572:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881259624832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (544us total) trans 17179872682 rc 0/0 00000100:00100000:1.0:1746065115.984576:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10132 00000100:00100000:1.0:1746065115.984585:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10133 00000100:00100000:1.0:1746065115.984588:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881259625344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065115.984646:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065115.984648:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065115.984650:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065115.984651:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065115.984652:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065115.984669:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881259625344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (618us total) trans 17179872683 rc 0/0 00000100:00100000:1.0:1746065115.984674:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10133 00000100:00080000:1.0:1746065115.984692:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065115.984711:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872650 gen 2 00000004:00080000:1.0:1746065115.984715:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026b800, transno 17179872598 00000004:00080000:1.0:1746065115.984720:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026bb80, transno 17179872599 00000004:00080000:1.0:1746065115.984723:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130269500, transno 17179872600 00000004:00080000:1.0:1746065115.984725:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026a680, transno 17179872601 00000004:00080000:1.0:1746065115.984727:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130268380, transno 17179872602 00000004:00080000:1.0:1746065115.984729:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130268a80, transno 17179872603 00000004:00080000:1.0:1746065115.984731:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026b100, transno 17179872604 00000004:00080000:1.0:1746065115.984733:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026ad80, transno 17179872605 00000004:00080000:1.0:1746065115.984735:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026aa00, transno 17179872606 00000004:00080000:1.0:1746065115.984737:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047800, transno 17179872610 00000004:00080000:1.0:1746065115.984739:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047100, transno 17179872611 00000004:00080000:1.0:1746065115.984741:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f044000, transno 17179872612 00000004:00080000:1.0:1746065115.984743:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046300, transno 17179872613 00000004:00080000:1.0:1746065115.984745:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff7100, transno 17179872614 00000004:00080000:1.0:1746065115.984747:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f045f80, transno 17179872615 00000004:00080000:1.0:1746065115.984749:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046680, transno 17179872616 00000004:00080000:1.0:1746065115.984751:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f044700, transno 17179872617 00000004:00080000:1.0:1746065115.984752:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047480, transno 17179872618 00000004:00080000:1.0:1746065115.984754:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f723800, transno 17179872619 00000004:00080000:1.0:1746065115.984756:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f722a00, transno 17179872620 00000004:00080000:1.0:1746065115.984757:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f722300, transno 17179872621 00000004:00080000:1.0:1746065115.984760:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f721880, transno 17179872622 00000004:00080000:1.0:1746065115.984761:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f722d80, transno 17179872623 00000004:00080000:1.0:1746065115.984763:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f721f80, transno 17179872624 00000004:00080000:1.0:1746065115.984765:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3df80, transno 17179872625 00000004:00080000:1.0:1746065115.984766:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f723480, transno 17179872626 00000004:00080000:1.0:1746065115.984768:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f723b80, transno 17179872627 00000004:00080000:1.0:1746065115.984769:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3ed80, transno 17179872633 00000004:00080000:1.0:1746065115.984771:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3d880, transno 17179872634 00000004:00080000:1.0:1746065115.984772:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3d500, transno 17179872635 00000004:00080000:1.0:1746065115.984774:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3f100, transno 17179872636 00000004:00080000:1.0:1746065115.984776:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3f800, transno 17179872637 00000004:00080000:1.0:1746065115.984778:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3d180, transno 17179872638 00000004:00080000:1.0:1746065115.984779:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3ea00, transno 17179872639 00000004:00080000:1.0:1746065115.984781:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d136a00, transno 17179872640 00000004:00080000:1.0:1746065115.984783:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801332fb480, transno 17179872641 00000004:00080000:1.0:1746065115.984785:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d134700, transno 17179872642 00000004:00080000:1.0:1746065115.984788:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3c700, transno 17179872643 00000004:00080000:1.0:1746065115.984789:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d134a80, transno 17179872644 00000004:00080000:1.0:1746065115.984791:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d137b80, transno 17179872645 00000004:00080000:1.0:1746065115.984794:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d3800, transno 17179872646 00000004:00080000:1.0:1746065115.984796:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d135f80, transno 17179872647 00000004:00080000:1.0:1746065115.984798:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d136680, transno 17179872648 00000004:00080000:1.0:1746065115.984799:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d134e00, transno 17179872649 00000004:00080000:1.0:1746065115.984801:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3c000, transno 17179872650 00000100:00100000:1.0:1746065115.984806:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880130447100 x1830881259624832/t17179872682(17179872682) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065131 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065115.984829:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130447100/2, rc 0, transno 17179872682 00000100:00100000:1.0:1746065115.984832:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259624832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065115.984843:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130446d80/2, rc 0, transno 17179872683 00000100:00100000:1.0:1746065115.984846:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259625344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065115.984852:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130446a00/2, rc 0, transno 17179872680 00000100:00100000:1.0:1746065115.984854:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259624704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065115.984859:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130447480/2, rc 0, transno 17179872681 00000100:00100000:1.0:1746065115.984862:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259625216:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065115.985098:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 45 done 00000100:00100000:1.0:1746065115.985201:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259625728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065115.985221:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065115.985239:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259625728 00000100:00100000:1.0:1746065115.985243:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259625728 00000100:00100000:1.0:1746065115.985255:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10134 00000100:00100000:1.0:1746065115.985259:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881259625728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065115.985342:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3295:x1830881259625728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (119us total) trans 17179872684 rc 0/0 00000100:00100000:1.0:1746065115.985347:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10134 00000004:00080000:1.0:1746065115.985365:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49df80/2, rc 0, transno 17179872684 00000100:00100000:1.0:1746065115.985368:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259625728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065115.987225:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259626112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065115.987251:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065115.987267:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259626624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065115.987281:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065115.987293:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065115.987297:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259626496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065115.987308:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065115.987313:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259627008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065115.987323:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065115.987339:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259626496 00000100:00100000:0.0:1746065115.987341:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259626496 00000100:00100000:0.0:1746065115.987352:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259627008 00000100:00100000:0.0:1746065115.987353:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259627008 00000100:00100000:0.0:1746065115.987360:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10144 00000100:00100000:0.0:1746065115.987363:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881259626624:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065115.987476:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a12d80/2, rc 0, transno 21474839929 00000100:00100000:0.0:1746065115.987479:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259626112:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065115.987504:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065115.987507:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065115.987509:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065115.987510:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065115.987512:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:0.0:1746065115.987532:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881259626624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (249us total) trans 21474839930 rc 0/0 00000100:00100000:0.0:1746065115.987537:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10144 00000100:00100000:0.0:1746065115.987550:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10146 00000100:00100000:0.0:1746065115.987554:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881259627008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065115.987632:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881259627008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (307us total) trans 21474839932 rc 0/0 00000100:00100000:0.0:1746065115.987637:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10146 00000004:00080000:0.0:1746065115.987658:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a13b80/2, rc 0, transno 21474839931 00000100:00100000:0.0:1746065115.987661:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259626496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065115.987668:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013026b800/2, rc 0, transno 21474839932 00000100:00100000:0.0:1746065115.987670:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259627008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065115.987673:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:0.0:1746065115.987676:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a11180/2, rc 0, transno 21474839930 00000100:00100000:0.0:1746065115.987678:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259626624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065115.987710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.990070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.990096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.991269:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260785152 00000100:00100000:0.0:1746065115.991273:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260785152 00000100:00100000:0.0:1746065115.991292:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3595 00000100:00100000:0.0:1746065115.991297:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28674:x1830881260785152:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1746065115.991390:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28674:x1830881260785152:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 92us (168us total) trans 8589942913 rc 0/0 00000100:00100000:0.0:1746065115.991410:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3595 00000100:00100000:1.0:1746065115.995993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065115.996122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065115.996219:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260785664 00000100:00100000:1.0:1746065115.996223:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260785664 00002000:00100000:1.0:1746065115.996247:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009380f480 x1830881260785664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/0 e 0 to 0 dl 1746065126 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065115.996256:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380f480 with x1830881260785664 ext(1048576->2097151) 00002000:00010000:1.0:1746065115.996261:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009380f480 00000100:00100000:1.0:1746065115.996281:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4593 00000100:00100000:1.0:1746065115.996286:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260785664:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065116.001635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.006506:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260785664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10210us (10374us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.006517:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4593 00002000:00100000:1.0:1746065116.006527:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009380f480 x1830881260785664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:31/0 lens 488/440 e 0 to 0 dl 1746065126 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.006536:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380f480 with x1830881260785664 ext(1048576->2097151) 00002000:00010000:1.0:1746065116.006541:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009380f480 00000100:00100000:0.0:1746065116.014433:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.021347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.021418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.022297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.034659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.037474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.060790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.082047:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259627648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065116.082068:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065116.082083:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259628160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065116.082095:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065116.082118:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065116.082123:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259628032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065116.082134:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065116.082142:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259628544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065116.082155:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065116.082172:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259627648 00000100:00100000:0.0:1746065116.082175:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259627648 00000100:00100000:0.0:1746065116.082190:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259628160 00000100:00100000:0.0:1746065116.082192:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259628160 00000100:00100000:0.0:1746065116.082199:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259628032 00000100:00100000:0.0:1746065116.082200:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259628032 00000100:00100000:0.0:1746065116.082209:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259628544 00000100:00100000:0.0:1746065116.082210:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259628544 00000100:00100000:0.0:1746065116.082220:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10152 00000100:00100000:0.0:1746065116.082224:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881259627648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065116.082296:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065116.082298:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065116 -> 1746065116 00002000:00010000:0.0:1746065116.082300:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065116.082302:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065116 -> 1746065116 00002000:00010000:0.0:1746065116.082303:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065116.082324:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259627648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (254us total) trans 21474839937 rc 0/0 00000100:00100000:0.0:1746065116.082329:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10152 00000100:00100000:0.0:1746065116.082343:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10153 00000100:00100000:0.0:1746065116.082348:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881259628160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065116.082425:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065116.082428:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065116.082430:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065116.082431:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065116.082433:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:0.0:1746065116.082450:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259628160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (354us total) trans 21474839938 rc 0/0 00000100:00100000:0.0:1746065116.082455:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10153 00000100:00100000:0.0:1746065116.082464:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10154 00000100:00100000:0.0:1746065116.082468:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881259628032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065116.082539:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259628032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (404us total) trans 21474839939 rc 0/0 00000100:00100000:0.0:1746065116.082544:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10154 00000100:00100000:0.0:1746065116.082555:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10155 00000100:00100000:0.0:1746065116.082559:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881259628544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065116.082626:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259628544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (469us total) trans 21474839940 rc 0/0 00000100:00100000:0.0:1746065116.082631:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10155 00000100:00100000:1.0:1746065116.083131:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259629056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.083159:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.083174:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259629568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.083186:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.083194:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065116.083198:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259628672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.083209:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.083216:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259629184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.083227:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.083241:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259629056 00000100:00100000:1.0:1746065116.083244:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259629056 00000100:00100000:1.0:1746065116.083257:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259629568 00000100:00100000:1.0:1746065116.083259:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259629568 00000100:00100000:1.0:1746065116.083264:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259628672 00000100:00100000:1.0:1746065116.083266:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259628672 00000100:00100000:1.0:1746065116.083272:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259629184 00000100:00100000:1.0:1746065116.083273:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259629184 00000100:00100000:1.0:1746065116.083280:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10156 00000100:00100000:1.0:1746065116.083284:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881259629056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065116.083367:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065116.083370:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065116.083371:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065116.083372:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065116.083374:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065116.083405:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881259629056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (245us total) trans 17179872689 rc 0/0 00000100:00100000:1.0:1746065116.083410:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10156 00000100:00100000:1.0:1746065116.083419:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10157 00000100:00100000:1.0:1746065116.083423:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881259629568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.083492:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881259629568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (304us total) trans 17179872690 rc 0/0 00000100:00100000:1.0:1746065116.083496:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10157 00000100:00100000:1.0:1746065116.083505:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10158 00000100:00100000:1.0:1746065116.083509:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881259628672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065116.083569:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065116.083571:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065116 -> 1746065116 00002000:00010000:1.0:1746065116.083573:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065116.083575:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065116 -> 1746065116 00002000:00010000:1.0:1746065116.083576:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2029 -> 2029 00000100:00100000:1.0:1746065116.083593:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881259628672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (382us total) trans 17179872691 rc 0/0 00000100:00100000:1.0:1746065116.083600:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10158 00000100:00100000:1.0:1746065116.083608:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10159 00000100:00100000:1.0:1746065116.083612:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881259629184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065116.083668:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065116.083670:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065116.083671:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065116.083673:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065116.083674:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065116.083692:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881259629184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (464us total) trans 17179872692 rc 0/0 00000100:00100000:1.0:1746065116.083697:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10159 00000004:00080000:1.0:1746065116.083719:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d2a00/2, rc 0, transno 17179872691 00000100:00100000:1.0:1746065116.083726:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259628672:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065116.083732:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d2300/2, rc 0, transno 17179872692 00000100:00100000:1.0:1746065116.083735:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259629184:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065116.083740:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d1500/2, rc 0, transno 17179872689 00000100:00100000:1.0:1746065116.083743:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259629056:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065116.083748:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9500/2, rc 0, transno 17179872690 00000100:00100000:1.0:1746065116.083750:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259629568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.083761:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259628928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.083776:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.083787:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259629440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.083798:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065116.084748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.084776:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.084791:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260787456 00000100:00100000:0.0:1746065116.084794:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260787456 00000100:00100000:0.0:1746065116.084810:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260787584 00000100:00100000:0.0:1746065116.084811:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260787584 00000100:00100000:0.0:1746065116.084834:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3597 00000100:00100000:0.0:1746065116.084838:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:28679:x1830881260787456:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065116.084903:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:28679:x1830881260787456:12345-192.168.202.46@tcp:49:cat.0 Request processed in 64us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.084907:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3597 00000100:00100000:0.0:1746065116.084919:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3598 00000100:00100000:0.0:1746065116.084923:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28675:x1830881260787584:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065116.084951:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28675:x1830881260787584:12345-192.168.202.46@tcp:49:cat.0 Request processed in 28us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.084956:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3598 00000004:00080000:0.0:1746065116.085032:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb17b80/2, rc 0, transno 21474839939 00000100:00100000:0.0:1746065116.085037:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259628032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065116.085044:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba3b80/2, rc 0, transno 21474839940 00000100:00100000:0.0:1746065116.085046:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259628544:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065116.085055:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb17800/2, rc 0, transno 21474839937 00000100:00100000:0.0:1746065116.085057:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259627648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065116.085063:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb16680/2, rc 0, transno 21474839938 00000100:00100000:0.0:1746065116.085065:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259628160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065116.085498:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259629696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.085519:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.085552:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259629696 00000100:00100000:1.0:1746065116.085555:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259629696 00000100:00100000:1.0:1746065116.085569:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10164 00000100:00100000:1.0:1746065116.085573:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881259629696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065116.085657:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881259629696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (137us total) trans 17179872697 rc 0/0 00000100:00100000:1.0:1746065116.085662:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10164 00000004:00080000:1.0:1746065116.085680:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095354380/2, rc 0, transno 17179872697 00000100:00100000:1.0:1746065116.085683:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259629696:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065116.085694:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d1880/2, rc 0, transno 17179872693 00000100:00100000:1.0:1746065116.085696:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259628928:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065116.085701:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d3800/2, rc 0, transno 17179872694 00000100:00100000:1.0:1746065116.085703:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259629440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065116.092317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.093204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.100028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.100560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.100583:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260788224 00000100:00100000:0.0:1746065116.100588:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260788224 00010000:00010000:0.0:1746065116.100609:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f18ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1b5 expref: 13 pid: 8851 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.100685:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5033 00000100:00100000:0.0:1746065116.100691:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881260788224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.100701:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.100718:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f18ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1b5 expref: 13 pid: 8851 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.100727:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f18ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1b5 expref: 13 pid: 8851 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.100745:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f3bf600/0x14b4f8542d4f18ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1b5 expref: 13 pid: 8851 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.100754:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.100771:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260788224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.100776:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5033 00000100:00100000:0.0:1746065116.102517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.107653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.111918:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.117741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.117852:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260789120 00000100:00100000:1.0:1746065116.117859:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260789120 00002000:00100000:1.0:1746065116.117893:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1888256->1892351) req@ffff88008fd73100 x1830881260789120/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.117902:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73100 with x1830881260789120 ext(1888256->1892351) 00002000:00010000:1.0:1746065116.117907:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd73100 00000100:00100000:1.0:1746065116.117921:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4599 00000100:00100000:1.0:1746065116.117927:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260789120:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065116.118050:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260789120:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 123us (316us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065116.118059:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4599 00002000:00100000:1.0:1746065116.118064:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1888256->1892351) req@ffff88008fd73100 x1830881260789120/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.118070:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73100 with x1830881260789120 ext(1888256->1892351) 00002000:00010000:1.0:1746065116.118072:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd73100 00000100:00100000:0.0:1746065116.123319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.123441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.130872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065116.131203:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065116.143896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.143936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.143958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.143984:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.144064:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260790272 00000100:00100000:1.0:1746065116.144067:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260790272 00000100:00100000:1.0:1746065116.144085:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10168 00000100:00100000:1.0:1746065116.144090:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881260790272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.144098:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.144112:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f1984 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a22c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.144128:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.144129:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.144136:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f1984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a22c expref: 22 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.144148:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f1984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a22c expref: 22 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.144157:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090bb7e00, rc 0) 00000100:00100000:1.0:1746065116.144189:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881260790272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 99us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.144194:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10168 00000100:00100000:1.0:1746065116.144213:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4603 00000100:00100000:1.0:1746065116.144218:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260790656:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065116.167736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.167770:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.167784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.167797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.168306:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260790784:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24215us (24320us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065116.168314:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4602 00002000:00100000:0.0:1746065116.168323:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009fb14380 x1830881260790784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.168331:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb14380 with x1830881260790784 ext(3145728->4194303) 00002000:00010000:0.0:1746065116.168335:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb14380 00000100:00100000:0.0:1746065116.168347:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260791552 00000100:00100000:0.0:1746065116.168349:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260791552 00002000:00100000:0.0:1746065116.168359:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009fb14000 x1830881260791552/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.168365:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb14000 with x1830881260791552 ext(2097152->3145727) 00002000:00010000:0.0:1746065116.168367:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb14000 00000100:00100000:0.0:1746065116.168380:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4604 00000100:00100000:0.0:1746065116.168385:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+23:1959:x1830881260791296:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065116.175425:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260790144:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31337us (31523us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.175439:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4601 00002000:00100000:1.0:1746065116.175454:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88008f49ca80 x1830881260790144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.175465:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ca80 with x1830881260790144 ext(2097152->3145727) 00002000:00010000:1.0:1746065116.175472:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49ca80 00000100:00100000:1.0:1746065116.179357:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260790656:12345-192.168.202.46@tcp:3:cat.0 Request processed in 35127us (35386us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.179370:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4603 00002000:00100000:1.0:1746065116.179382:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009fb15500 x1830881260790656/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.179405:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb15500 with x1830881260790656 ext(3145728->4194303) 00002000:00010000:1.0:1746065116.179413:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb15500 00000100:00100000:1.0:1746065116.195070:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+14:1959:x1830881260791552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26620us (27278us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.195079:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4606 00002000:00100000:1.0:1746065116.195087:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009fb14000 x1830881260791552/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.195095:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb14000 with x1830881260791552 ext(2097152->3145727) 00002000:00010000:1.0:1746065116.195100:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb14000 00000100:00100000:0.0:1746065116.200851:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.200881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.201307:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260791936 00000100:00100000:1.0:1746065116.201314:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260791936 00000100:00100000:1.0:1746065116.201345:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260792064 00000100:00100000:1.0:1746065116.201346:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260792064 00000100:00100000:1.0:1746065116.201359:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10169 00000100:00100000:1.0:1746065116.201364:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260791936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.201377:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.201400:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5e000/0x14b4f8542d4f198b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a233 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.201419:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.201420:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.201428:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5e000/0x14b4f8542d4f198b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a233 expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.201440:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5e000/0x14b4f8542d4f198b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a233 expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.201449:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5e000, rc 0) 00000100:00100000:1.0:1746065116.201466:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260791936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 102us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.201471:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10169 00000100:00100000:1.0:1746065116.201482:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10170 00000100:00100000:1.0:1746065116.201486:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260792064:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.201491:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.201497:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5e400/0x14b4f8542d4f1992 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a23a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065116.201525:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259630208:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065116.201572:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065116.203087:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881260791168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 34671us (35311us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.203096:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4605 00002000:00100000:1.0:1746065116.203102:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009fb17480 x1830881260791168/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.203109:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb17480 with x1830881260791168 ext(2097152->3145727) 00002000:00010000:1.0:1746065116.203112:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb17480 00002000:00010000:1.0:1746065116.204161:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065116 -> 1746065117 00002000:00010000:1.0:1746065116.204165:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065116 -> 1746065117 00002000:00010000:1.0:1746065116.204167:0:8428:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065116 -> 1746065117 00000100:00100000:1.0:1746065116.204183:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259630208:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065116.204211:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5e400/0x14b4f8542d4f1992 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a23a expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.204223:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c5e400/0x14b4f8542d4f1992 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a23a expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.205094:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5e400, rc 0) 00000100:00100000:1.0:1746065116.205141:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260792064:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3652us (4258us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065116.205147:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10170 00000100:00100000:0.0:1746065116.211386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.211535:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260792320 00000100:00100000:1.0:1746065116.211543:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260792320 00002000:00100000:1.0:1746065116.211582:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4771839) req@ffff88012b45ea00 x1830881260792320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.211591:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ea00 with x1830881260792320 ext(4194304->4771839) 00002000:00010000:1.0:1746065116.211596:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45ea00 00000100:00100000:1.0:1746065116.211629:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4608 00000100:00100000:1.0:1746065116.211637:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260792320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065116.212592:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.220082:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260792320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8437us (8694us total) trans 0 rc 577536/577536 00000100:00100000:1.0:1746065116.220093:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4608 00002000:00100000:1.0:1746065116.220102:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4771839) req@ffff88012b45ea00 x1830881260792320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.220111:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ea00 with x1830881260792320 ext(4194304->4771839) 00002000:00010000:1.0:1746065116.220115:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45ea00 00000100:00100000:0.0:1746065116.231039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.231147:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260792704 00000100:00100000:1.0:1746065116.231154:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260792704 00000100:00100000:1.0:1746065116.231191:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10171 00000100:00100000:1.0:1746065116.231198:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260792704:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.231213:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.231228:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5ec00/0x14b4f8542d4f1999 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a241 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065116.231270:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259630336:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065116.231740:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065116.233802:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259630336:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065116.233853:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5ec00/0x14b4f8542d4f1999 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a241 expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.233865:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c5ec00/0x14b4f8542d4f1999 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a241 expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.233890:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5ec00, rc 0) 00000100:00100000:1.0:1746065116.233921:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260792704:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2723us (2889us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065116.233928:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10171 00000100:00100000:0.0:1746065116.238460:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.238995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.239377:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10172 00000100:00100000:1.0:1746065116.239387:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:28681:x1830881260792832:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065116.239464:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.239475:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f19a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a248 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.239501:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c800200/0x14b4f8542d4f197d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a225 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.239510:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f1984 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a22c expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.239515:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.239517:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.239520:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f19a7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3944448->4194303] (req 3944448->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a248 expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.239545:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f1984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a22c expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.239556:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f1984 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a22c expref: 21 pid: 8428 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065116.239567:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259630464:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065116.240721:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c800200/0x14b4f8542d4f197d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a225 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.240733:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c800200/0x14b4f8542d4f197d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a225 expref: 24 pid: 25185 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065116.240742:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5804700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259630720:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065116.240973:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065116.244055:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259630464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065116.244067:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5804700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259630720:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065116.244095:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f19a7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3944448->4194303] (req 3944448->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a248 expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.244110:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5ee00, rc 0) 00000100:00100000:1.0:1746065116.244146:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28681:x1830881260792832:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4760us (5691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.244153:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10172 00000100:00100000:0.0:1746065116.250081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.250133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.250192:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260793344 00000100:00100000:1.0:1746065116.250200:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260793344 00000100:00100000:1.0:1746065116.250250:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3600 00000100:00100000:1.0:1746065116.250256:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28675:x1830881260793344:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065116.250653:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28675:x1830881260793344:12345-192.168.202.46@tcp:35:cat.0 Request processed in 396us (518us total) trans 8589942918 rc 0/0 00000100:00100000:1.0:1746065116.250659:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3600 00000100:00100000:0.0:1746065116.251661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.256156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.262130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.274951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.274998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.275576:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260793984 00000100:00100000:1.0:1746065116.275583:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260793984 00010000:00010000:1.0:1746065116.275615:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e8b1e00/0x14b4f8542d4f1976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a21e expref: 31 pid: 25185 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065116.275636:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260794112 00000100:00100000:1.0:1746065116.275638:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260794112 00010000:00010000:1.0:1746065116.275646:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350af600/0x14b4f8542d4f18c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1bc expref: 12 pid: 8429 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746065116.275659:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5037 00000100:00100000:1.0:1746065116.275665:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881260793984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065116.275677:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065116.275693:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e8b1e00/0x14b4f8542d4f1976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a21e expref: 31 pid: 25185 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.275703:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e8b1e00/0x14b4f8542d4f1976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a21e expref: 31 pid: 25185 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.275719:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e8b1e00/0x14b4f8542d4f1976 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a21e expref: 31 pid: 25185 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.275747:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065116.275786:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881260793984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 117us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.275792:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5037 00000100:00100000:0.0:1746065116.275810:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5038 00000100:00100000:0.0:1746065116.275841:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260794112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.275849:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.275859:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350af600/0x14b4f8542d4f18c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1bc expref: 12 pid: 8429 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.275874:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350af600/0x14b4f8542d4f18c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1bc expref: 12 pid: 8429 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.275887:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350af600/0x14b4f8542d4f18c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1bc expref: 12 pid: 8429 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.275900:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.275901:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.275907:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c29de00/0x14b4f8542d4f19ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a256 expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.275914:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29de00/0x14b4f8542d4f19ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a256 expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.275941:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c29de00/0x14b4f8542d4f19ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a256 expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.275951:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259631232:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065116.275999:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.297563:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.297628:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260794368 00000100:00100000:1.0:1746065116.297636:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260794368 00000100:00100000:1.0:1746065116.297679:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3601 00000100:00100000:1.0:1746065116.297685:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b559050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28681:x1830881260794368:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065116.297976:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b559050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28681:x1830881260794368:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 290us (420us total) trans 8589942919 rc 0/0 00000100:00100000:1.0:1746065116.297982:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3601 00000100:00100000:0.0:1746065116.351006:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.376612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.376675:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260794880 00000100:00100000:1.0:1746065116.376682:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260794880 00000100:00100000:1.0:1746065116.376729:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8900 00000100:00100000:1.0:1746065116.376736:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28693:x1830881260794880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.376755:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.377112:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5f600/0x14b4f8542d4f19d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a264 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.377192:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377203:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377211:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377223:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377227:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377232:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377307:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377314:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377320:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065116.377326:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065116.377382:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377388:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377405:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377410:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c5ec00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065116.377413:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377418:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377428:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065116.377430:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065116.377433:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377438:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f19df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377456:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377461:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377465:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377469:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b1600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065116.377471:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377475:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377480:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5df2800) 00010000:00010000:1.0:1746065116.377482:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065116.377484:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377487:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f19e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.377514:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5f600/0x14b4f8542d4f19d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a264 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.377524:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a264 expref: 252 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.377528:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065116.377530:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065116.377532:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090bb7e00, rc 0) 00000100:00100000:1.0:1746065116.377587:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:28693:x1830881260794880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 850us (981us total) trans 8589942921 rc 0/0 00000100:00100000:1.0:1746065116.377592:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8900 00000100:00100000:0.0:1746065116.389150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.392407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.407080:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.407179:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260795264 00000100:00100000:1.0:1746065116.407187:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260795264 00002000:00100000:1.0:1746065116.407225:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4974111) req@ffff88008fc59c00 x1830881260795264/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.407233:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59c00 with x1830881260795264 ext(4194304->4974111) 00010000:00010000:1.0:1746065116.407241:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29de00/0x14b4f8542d4f19ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a256 expref: 30 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.407251:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29de00/0x14b4f8542d4f19ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a256 expref: 30 pid: 8427 timeout: 815 lvb_type: 0 00002000:00010000:1.0:1746065116.407257:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc59c00 00000100:00100000:1.0:1746065116.407282:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1442 00000100:00100000:1.0:1746065116.407288:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260795264:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065116.423635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.423666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.423687:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260795520 00000100:00100000:1.0:1746065116.423693:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260795520 00002000:00100000:1.0:1746065116.423723:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8800a5804700 x1830881260795520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.423731:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5804700 with x1830881260795520 ext(0->1048575) 00002000:00010000:1.0:1746065116.423736:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5804700 00000100:00100000:1.0:1746065116.425585:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260795776 00000100:00100000:1.0:1746065116.425594:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260795776 00002000:00100000:1.0:1746065116.425619:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a5805c00 x1830881260795776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.425626:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5805c00 with x1830881260795776 ext(1048576->2097151) 00002000:00010000:1.0:1746065116.425630:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5805c00 00000100:00100000:0.0:1746065116.428768:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4613 00000100:00100000:0.0:1746065116.428780:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881260796032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065116.439161:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881260795264:12345-192.168.202.46@tcp:4:cat.0 Request processed in 31864us (32078us total) trans 17179872698 rc 0/0 00000100:00100000:1.0:1746065116.439172:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1442 00002000:00100000:1.0:1746065116.439182:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4974111) req@ffff88008fc59c00 x1830881260795264/t17179872698(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.439191:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59c00 with x1830881260795264 ext(4194304->4974111) 00010000:00010000:1.0:1746065116.439199:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29de00/0x14b4f8542d4f19ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a256 expref: 34 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.439214:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29de00/0x14b4f8542d4f19ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a256 expref: 34 pid: 8427 timeout: 815 lvb_type: 0 00002000:00010000:1.0:1746065116.439220:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc59c00 00000100:00100000:1.0:1746065116.439305:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.439328:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260796160 00000100:00100000:1.0:1746065116.439333:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260796160 00000100:00100000:1.0:1746065116.450951:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8901 00000100:00100000:1.0:1746065116.450965:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:28694:x1830881260796160:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065116.450986:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.451000:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013119a800/0x14b4f8542d4f1a09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a279 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.451046:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451056:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451064:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451073:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451077:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451082:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451174:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451182:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451187:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065116.451210:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:1.0:1746065116.451213:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065116.451223:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451229:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451235:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451239:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451244:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451249:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013119aa00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065116.451252:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451256:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451264:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065116.451266:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065116.451269:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451273:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013119aa00/0x14b4f8542d4f1a10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451297:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451302:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451306:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451309:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013119ac00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065116.451311:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451315:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451319:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5df2300) 00010000:00010000:1.0:1746065116.451320:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065116.451322:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451326:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ac00/0x14b4f8542d4f1a17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.451343:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013119a800/0x14b4f8542d4f1a09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a279 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.451352:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a279 expref: 7 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.451357:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065116.451359:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065116.451360:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013119ae00, rc 0) 00000100:00100000:1.0:1746065116.451430:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28694:x1830881260796160:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 469us (12124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.451435:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8901 00000100:00100000:0.0:1746065116.462443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.464105:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260796032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 35325us (37299us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.464114:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4613 00002000:00100000:1.0:1746065116.464122:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094ff6a00 x1830881260796032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.464130:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6a00 with x1830881260796032 ext(1048576->2097151) 00002000:00010000:1.0:1746065116.464135:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff6a00 00000100:00100000:0.0:1746065116.466326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.466461:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260796544 00000100:00100000:1.0:1746065116.466468:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260796544 00002000:00100000:1.0:1746065116.466499:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3670016->3674111) req@ffff88008fc5ad80 x1830881260796544/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.466506:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5ad80 with x1830881260796544 ext(3670016->3674111) 00002000:00010000:1.0:1746065116.466510:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5ad80 00000100:00100000:1.0:1746065116.466535:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4614 00000100:00100000:1.0:1746065116.466541:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260796544:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065116.466667:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260796544:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 125us (344us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065116.466673:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4614 00002000:00100000:1.0:1746065116.466677:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3670016->3674111) req@ffff88008fc5ad80 x1830881260796544/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.466684:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5ad80 with x1830881260796544 ext(3670016->3674111) 00002000:00010000:1.0:1746065116.466686:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5ad80 00000100:00100000:0.0:1746065116.472336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.472374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.472409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.472424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.472436:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.472464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.472488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.476418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.478890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.484728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.484789:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260798208 00000100:00100000:1.0:1746065116.484795:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260798208 00000100:00100000:1.0:1746065116.484846:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8902 00000100:00100000:1.0:1746065116.484852:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28694:x1830881260798208:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065116.484866:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.484878:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b400/0x14b4f8542d4f1a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a2b1 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.484950:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.484962:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f19ca lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a25d expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.484968:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a264 expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.484974:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a279 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.484979:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 6/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.485001:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a279 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.485010:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a279 expref: 8 pid: 14643 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065116.485020:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259632256:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065116.485087:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a264 expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.485095:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a264 expref: 251 pid: 14643 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065116.485102:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259632384:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065116.485123:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f19ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a25d expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.485130:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f19ca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a25d expref: 12 pid: 24350 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065116.485137:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259632512:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065116.485150:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.489495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.490951:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5040 00000100:00100000:0.0:1746065116.490957:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260798464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.490964:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.490968:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a279 expref: 9 pid: 14643 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.490976:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a279 expref: 9 pid: 14643 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.490988:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013119ae00/0x14b4f8542d4f1a1e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a279 expref: 9 pid: 14643 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.491001:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065116.491004:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065116.491009:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065116.491011:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.491035:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260798464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.491177:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.491192:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260798592 00000100:00100000:1.0:1746065116.491195:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260798592 00010000:00010000:1.0:1746065116.491207:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a264 expref: 252 pid: 14643 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.491233:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5040 00000100:00100000:1.0:1746065116.491397:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5042 00000100:00100000:1.0:1746065116.491403:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:1960:x1830881260798592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065116.491409:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065116.491412:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a264 expref: 252 pid: 14643 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.491423:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a264 expref: 252 pid: 14643 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.491433:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4f19ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a264 expref: 252 pid: 14643 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.491762:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065116.491766:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.491772:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.491777:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.492634:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065116.492657:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881260798592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1253us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.492664:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5042 00000100:00100000:0.0:1746065116.496971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.497289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.497316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.498185:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4616 00000100:00100000:1.0:1746065116.498191:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260799232:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065116.499918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.511619:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260799232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13415us (14641us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.511632:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4616 00002000:00100000:1.0:1746065116.511645:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009fb10000 x1830881260799232/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.511659:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10000 with x1830881260799232 ext(0->1048575) 00002000:00010000:1.0:1746065116.511664:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10000 00000100:00100000:0.0:1746065116.515064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.515272:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260799616 00000100:00100000:1.0:1746065116.515278:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260799616 00010000:00010000:1.0:1746065116.515300:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2b1 expref: 10 pid: 14643 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065116.515330:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5043 00000100:00100000:1.0:1746065116.515337:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260799616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065116.515347:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065116.515351:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2b1 expref: 10 pid: 14643 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.515358:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2b1 expref: 10 pid: 14643 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.515375:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013119b600/0x14b4f8542d4f1a5d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2b1 expref: 10 pid: 14643 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.515402:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065116.515406:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c200/0x14b4f8542d4f1a79 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.515414:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c200/0x14b4f8542d4f1a79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.515419:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c200/0x14b4f8542d4f1a79 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065116.515435:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065116.515466:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881260799616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 130us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.515471:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5043 00000100:00100000:0.0:1746065116.527367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.527385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.527414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.527440:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.542936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.543005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.544934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.544958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.547067:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4619 00000100:00100000:1.0:1746065116.547078:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260801280:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065116.550571:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259633408:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065116.550593:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0156c00/0x14b4f8542d4f1ac6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065116.554353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.554399:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.554429:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.554455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.554468:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.554479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.554501:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.554519:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260801408 00000100:00100000:0.0:1746065116.554526:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260801408 00000100:00100000:0.0:1746065116.554556:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260801664 00000100:00100000:0.0:1746065116.554558:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260801664 00000100:00100000:0.0:1746065116.554568:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260801920 00000100:00100000:0.0:1746065116.554569:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260801920 00000100:00100000:0.0:1746065116.554578:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260802176 00000100:00100000:0.0:1746065116.554579:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260802176 00000100:00100000:0.0:1746065116.554588:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260802048 00000100:00100000:0.0:1746065116.554589:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260802048 00000100:00100000:0.0:1746065116.554598:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10189 00000100:00100000:0.0:1746065116.554604:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260801408:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065116.554638:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.554652:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a0 expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.554658:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8b7400/0x14b4f8542d4f1a25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a280 expref: 8 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.554665:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c5e000/0x14b4f8542d4f198b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a233 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.554674:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.554676:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.554678:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.554703:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c5e000/0x14b4f8542d4f198b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a233 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.554712:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c5e000/0x14b4f8542d4f198b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a233 expref: 33 pid: 8428 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.554722:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259633664:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065116.554790:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8b7400/0x14b4f8542d4f1a25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a280 expref: 8 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.554798:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8b7400/0x14b4f8542d4f1a25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a280 expref: 8 pid: 21998 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.554805:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259633792:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065116.556532:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a0 expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.556541:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a0 expref: 15 pid: 4544 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.556553:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259634688:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065116.556567:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.556581:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10194 00000100:00100000:0.0:1746065116.556586:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260801792:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065116.556600:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.556609:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350aee00/0x14b4f8542d4f18b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1ae expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.556614:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6600/0x14b4f8542d4f1a2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a28e expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.556620:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f13b200/0x14b4f8542d4f18e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1d1 expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.556624:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.556625:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.556627:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.556638:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f13b200/0x14b4f8542d4f18e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1d1 expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.556644:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f13b200/0x14b4f8542d4f18e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1d1 expref: 22 pid: 8427 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.556651:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259634816:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065116.556669:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6600/0x14b4f8542d4f1a2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a28e expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.556674:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6600/0x14b4f8542d4f1a2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a28e expref: 10 pid: 21998 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.556680:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259634944:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065116.556693:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350aee00/0x14b4f8542d4f18b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1ae expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.556699:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350aee00/0x14b4f8542d4f18b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1ae expref: 20 pid: 8429 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.556705:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259635072:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065116.556713:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.564893:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260801152:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19429us (19950us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065116.564904:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4618 00002000:00100000:0.0:1746065116.564914:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d96300 x1830881260801152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.564923:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96300 with x1830881260801152 ext(1048576->2097151) 00010000:00010000:0.0:1746065116.564931:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f1a64 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2b8 expref: 32 pid: 25185 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.564944:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f1a64 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2b8 expref: 32 pid: 25185 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.564951:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d96300 00000100:00100000:0.0:1746065116.574063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.574094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.574106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.574135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.574205:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259634560:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065116.574221:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.574263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.574297:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259634816:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065116.574311:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260802816 00000100:00100000:0.0:1746065116.574313:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260802816 00002000:00100000:0.0:1746065116.574336:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3944448->4194303) req@ffff88009f047480 x1830881260802816/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.574343:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047480 with x1830881260802816 ext(3944448->4194303) 00010000:00010000:0.0:1746065116.574349:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f19a7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a248 expref: 24 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.574358:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f19a7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a248 expref: 24 pid: 8428 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.574368:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f047480 00000100:00100000:0.0:1746065116.574380:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1444 00000100:00100000:0.0:1746065116.574386:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260802816:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065116.574745:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259634944:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065116.574772:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259633792:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065116.574779:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259634688:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065116.574790:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259635072:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065116.574796:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.574803:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.575068:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260801280:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27991us (30108us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065116.575075:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4619 00002000:00100000:0.0:1746065116.575080:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d96d80 x1830881260801280/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.575087:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96d80 with x1830881260801280 ext(1048576->2097151) 00010000:00010000:0.0:1746065116.575092:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6000/0x14b4f8542d4f1a95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2db expref: 14 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.575101:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6000/0x14b4f8542d4f1a95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2db expref: 14 pid: 8427 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.575106:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d96d80 00000100:00100000:0.0:1746065116.578031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.587061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.587082:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260803072 00000100:00100000:0.0:1746065116.587090:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260803072 00002000:00100000:0.0:1746065116.587124:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3670016->4034559) req@ffff88009f047100 x1830881260803072/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.587132:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047100 with x1830881260803072 ext(3670016->4034559) 00010000:00010000:0.0:1746065116.587139:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29da00/0x14b4f8542d4f19fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a26b expref: 14 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.587150:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29da00/0x14b4f8542d4f19fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a26b expref: 14 pid: 8427 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.587156:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f047100 00000100:00100000:0.0:1746065116.587173:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1445 00000100:00100000:0.0:1746065116.587180:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260803072:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065116.587568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.587580:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260803584 00000100:00100000:0.0:1746065116.587583:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260803584 00010000:00010000:0.0:1746065116.587596:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f13b200/0x14b4f8542d4f18e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1d1 expref: 25 pid: 8427 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746065116.587609:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5050 00000100:00100000:0.0:1746065116.587613:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881260803584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.587620:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.587633:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f13b200/0x14b4f8542d4f18e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1d1 expref: 25 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.587645:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f13b200/0x14b4f8542d4f18e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1d1 expref: 25 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.587663:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f13b200/0x14b4f8542d4f18e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1d1 expref: 25 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.587693:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.587712:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881260803584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 98us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.587717:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5050 00000100:00100000:0.0:1746065116.587752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.587762:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260803200 00000100:00100000:0.0:1746065116.587765:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260803200 00010000:00010000:0.0:1746065116.587775:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8b7400/0x14b4f8542d4f1a25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a280 expref: 9 pid: 21998 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.587789:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5051 00000100:00100000:0.0:1746065116.587794:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260803200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.587799:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.587808:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8b7400/0x14b4f8542d4f1a25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a280 expref: 9 pid: 21998 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.587834:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8b7400/0x14b4f8542d4f1a25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a280 expref: 9 pid: 21998 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.587849:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8b7400/0x14b4f8542d4f1a25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a280 expref: 9 pid: 21998 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.587858:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.587869:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260803200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.587874:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5051 00000100:00100000:0.0:1746065116.587929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.587939:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260803456 00000100:00100000:0.0:1746065116.587941:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260803456 00010000:00010000:0.0:1746065116.587951:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6600/0x14b4f8542d4f1a2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a28e expref: 9 pid: 21998 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.587965:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5052 00000100:00100000:0.0:1746065116.587969:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260803456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.587974:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.587980:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6600/0x14b4f8542d4f1a2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a28e expref: 9 pid: 21998 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.587987:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6600/0x14b4f8542d4f1a2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a28e expref: 9 pid: 21998 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.587997:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b6600/0x14b4f8542d4f1a2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a28e expref: 9 pid: 21998 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.588008:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.588021:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260803456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.588026:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5052 00000100:00100000:0.0:1746065116.588057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.588067:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260803328 00000100:00100000:0.0:1746065116.588069:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260803328 00010000:00010000:0.0:1746065116.588078:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a0 expref: 16 pid: 4544 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.588092:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5053 00000100:00100000:0.0:1746065116.588096:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260803328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.588102:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.588108:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a0 expref: 16 pid: 4544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.588115:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a0 expref: 16 pid: 4544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.588125:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d75e400/0x14b4f8542d4f18b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1a0 expref: 16 pid: 4544 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.588134:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.588136:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.588139:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588150:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588166:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.588179:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260803328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.588184:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5053 00000100:00100000:0.0:1746065116.588214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.588223:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260803712 00000100:00100000:0.0:1746065116.588226:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260803712 00010000:00010000:0.0:1746065116.588235:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350aee00/0x14b4f8542d4f18b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1ae expref: 20 pid: 8429 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746065116.588247:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5054 00000100:00100000:0.0:1746065116.588252:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881260803712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065116.588257:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065116.588263:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350aee00/0x14b4f8542d4f18b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1ae expref: 20 pid: 8429 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.588269:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350aee00/0x14b4f8542d4f18b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1ae expref: 20 pid: 8429 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.588278:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350aee00/0x14b4f8542d4f18b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a1ae expref: 20 pid: 8429 timeout: 815 lvb_type: 1 00010000:00010000:0.0:1746065116.588285:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.588287:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.588289:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588294:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588306:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065116.588319:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260803712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.588323:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5054 00010000:00010000:0.0:1746065116.588338:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588345:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588362:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588369:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.588374:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588375:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588380:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8b7000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065116.588384:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588384:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588404:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.588411:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588413:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.588417:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.588418:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8b7000/0x14b4f8542d4f1af0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.588423:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.588433:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8b6800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065116.588435:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.588441:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.588449:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.588452:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260801792:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 31866us (33971us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065116.588455:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6800/0x14b4f8542d4f1acd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.588458:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10194 00000100:00100000:1.0:1746065116.588494:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260801408:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 33890us (34147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.588495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.588501:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10189 00000100:00100000:0.0:1746065116.588506:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260803840 00000100:00100000:0.0:1746065116.588509:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260803840 00000100:00100000:1.0:1746065116.591301:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10196 00000100:00100000:1.0:1746065116.591318:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28693:x1830881260803840:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.591333:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.591347:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a2f7 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.591368:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065116.591372:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.591383:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065116.591386:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.591407:0:8851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.591418:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.591426:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013119b200, rc 0) 00000100:00100000:1.0:1746065116.591459:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28693:x1830881260803840:12345-192.168.202.46@tcp:101:cat.0 Request processed in 149us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.591464:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10196 00000100:00100000:1.0:1746065116.596973:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260802816:12345-192.168.202.46@tcp:4:cat.0 Request processed in 22576us (22698us total) trans 21474839941 rc 0/0 00000100:00100000:1.0:1746065116.596984:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1444 00002000:00100000:1.0:1746065116.596995:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3944448->4194303) req@ffff88009f047480 x1830881260802816/t21474839941(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.597003:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047480 with x1830881260802816 ext(3944448->4194303) 00010000:00010000:1.0:1746065116.597011:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f19a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a248 expref: 24 pid: 8428 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.597023:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f19a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a248 expref: 24 pid: 8428 timeout: 815 lvb_type: 0 00002000:00010000:1.0:1746065116.597030:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f047480 00000100:00100000:0.0:1746065116.604138:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260803072:12345-192.168.202.46@tcp:4:cat.0 Request processed in 16951us (17076us total) trans 17179872700 rc 0/0 00000100:00100000:0.0:1746065116.604149:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1445 00002000:00100000:0.0:1746065116.604158:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3670016->4034559) req@ffff88009f047100 x1830881260803072/t17179872700(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/448 e 0 to 0 dl 1746065127 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.604168:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047100 with x1830881260803072 ext(3670016->4034559) 00010000:00010000:0.0:1746065116.604176:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29da00/0x14b4f8542d4f19fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3670016->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a26b expref: 15 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746065116.604188:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29da00/0x14b4f8542d4f19fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3670016->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a26b expref: 15 pid: 8427 timeout: 815 lvb_type: 0 00002000:00010000:0.0:1746065116.604195:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f047100 00000100:00100000:0.0:1746065116.606533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065116.607203:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fb73600/0x14b4f8542d4f1ae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.607212:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb73600/0x14b4f8542d4f1ae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.607230:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb73600/0x14b4f8542d4f1ae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.607237:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb73600/0x14b4f8542d4f1ae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.607244:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb73600/0x14b4f8542d4f1ae2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.607249:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb73600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065116.607253:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb73600/0x14b4f8542d4f1ae2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.607259:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb73600/0x14b4f8542d4f1ae2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.607269:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.607270:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.607275:0:8429:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.607287:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.607312:0:8429:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065116.607322:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259635200:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065116.607441:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.610856:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.610894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065116.611633:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611641:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611657:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611663:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611670:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611675:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb73800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065116.611678:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611685:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611697:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.611698:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.611702:0:8428:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611709:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611715:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.611716:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.611719:0:8428:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611724:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.611744:0:8428:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.611753:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259635328:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065116.611809:0:8428:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065116.613092:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259635456:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065116.613135:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065116.613486:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259635200:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065116.613502:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb73600/0x14b4f8542d4f1ae2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.613509:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb73600/0x14b4f8542d4f1ae2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065116.614619:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881260802176:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 58586us (60161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.614627:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10192 00000100:00100000:0.0:1746065116.616639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.617722:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260804736 00000100:00100000:1.0:1746065116.617730:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260804736 00002000:00100000:1.0:1746065116.617764:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2469888->2473983) req@ffff88009f046300 x1830881260804736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.617772:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046300 with x1830881260804736 ext(2469888->2473983) 00002000:00010000:1.0:1746065116.617777:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f046300 00000100:00100000:1.0:1746065116.617801:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4620 00000100:00100000:1.0:1746065116.617808:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881260804736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065116.619296:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881260804736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1483us (2656us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065116.619305:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4620 00002000:00100000:1.0:1746065116.619313:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2469888->2473983) req@ffff88009f046300 x1830881260804736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.619321:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046300 with x1830881260804736 ext(2469888->2473983) 00002000:00010000:1.0:1746065116.619325:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f046300 00000100:00100000:0.0:1746065116.623549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.627066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.627141:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f044e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259635328:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065116.627154:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259635456:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065116.627171:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.627178:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1ae9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065116.627229:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1961:x1830881260802048:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 71092us (72727us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.627236:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10193 00000100:00100000:1.0:1746065116.627415:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260805504 00000100:00100000:1.0:1746065116.627419:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260805504 00002000:00100000:1.0:1746065116.627440:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f046680 x1830881260805504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.627449:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046680 with x1830881260805504 ext(2097152->3145727) 00002000:00010000:1.0:1746065116.627453:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f046680 00000100:00100000:1.0:1746065116.627461:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4621 00000100:00100000:1.0:1746065116.627466:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260805504:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065116.629184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.629235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.629252:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260805248 00000100:00100000:0.0:1746065116.629258:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260805248 00002000:00100000:0.0:1746065116.629281:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2633728->2637823) req@ffff88009f047800 x1830881260805248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.629289:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047800 with x1830881260805248 ext(2633728->2637823) 00002000:00010000:0.0:1746065116.629292:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f047800 00000100:00100000:0.0:1746065116.629671:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260805632 00000100:00100000:0.0:1746065116.629674:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260805632 00002000:00100000:0.0:1746065116.629687:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->2469887) req@ffff88009f045c00 x1830881260805632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.629694:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045c00 with x1830881260805632 ext(2097152->2469887) 00002000:00010000:0.0:1746065116.629696:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f045c00 00000100:00100000:0.0:1746065116.638594:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.638620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.638637:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260806272 00000100:00100000:0.0:1746065116.638644:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260806272 00002000:00100000:0.0:1746065116.638678:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f044700 x1830881260806272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.638686:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044700 with x1830881260806272 ext(2097152->3145727) 00002000:00010000:0.0:1746065116.638691:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f044700 00000100:00100000:0.0:1746065116.638708:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4624 00000100:00100000:0.0:1746065116.638714:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260806272:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065116.651586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.651645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.655267:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260805504:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27794us (28195us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.655276:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4621 00002000:00100000:1.0:1746065116.655286:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f046680 x1830881260805504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.655293:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046680 with x1830881260805504 ext(2097152->3145727) 00002000:00010000:1.0:1746065116.655298:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f046680 00000100:00100000:0.0:1746065116.656041:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260806272:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17323us (17416us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065116.656047:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4624 00002000:00100000:0.0:1746065116.656053:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f044700 x1830881260806272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.656059:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044700 with x1830881260806272 ext(2097152->3145727) 00002000:00010000:0.0:1746065116.656062:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f044700 00000100:00100000:0.0:1746065116.657263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.663128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.663163:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.663200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.663273:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260807552 00000100:00100000:1.0:1746065116.663277:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260807552 00002000:00100000:1.0:1746065116.663300:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009b9fe300 x1830881260807552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.663308:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fe300 with x1830881260807552 ext(3145728->4194303) 00002000:00010000:1.0:1746065116.663313:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fe300 00000100:00100000:1.0:1746065116.663337:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260807808 00000100:00100000:1.0:1746065116.663339:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260807808 00002000:00100000:1.0:1746065116.663350:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009f721180 x1830881260807808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.663357:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f721180 with x1830881260807808 ext(3145728->4194303) 00002000:00010000:1.0:1746065116.663360:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f721180 00000100:00100000:1.0:1746065116.663803:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4626 00000100:00100000:1.0:1746065116.663809:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260807424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065116.666629:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260807936 00000100:00100000:1.0:1746065116.666641:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260807936 00000100:00100000:1.0:1746065116.666677:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10198 00000100:00100000:1.0:1746065116.666684:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:28697:x1830881260807936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.666699:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.666714:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a30c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.666741:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.666749:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065116.666750:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065116.666753:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a30c expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.666782:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.666794:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 26 pid: 8427 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746065116.666807:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259635584:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065116.666912:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a90840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065116.677534:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259635584:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065116.677562:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a30c expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.677575:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe10a00, rc 0) 00000100:00100000:0.0:1746065116.677609:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+20:28697:x1830881260807936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10925us (11619us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.677616:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10198 00000100:00100000:1.0:1746065116.677751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.677998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.678082:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260808192 00000100:00100000:1.0:1746065116.678088:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260808192 00000100:00100000:1.0:1746065116.678110:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10199 00000100:00100000:1.0:1746065116.678116:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:28702:x1830881260808192:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065116.678125:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.678137:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe11200/0x14b4f8542d4f1b3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a313 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065116.678155:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6dc, atime: 0x6812d6db, ctime: 0x6812d6dc, blocks: 0x7ed 00010000:00010000:1.0:1746065116.678167:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.678169:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.678174:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe11200/0x14b4f8542d4f1b3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 307200->794623) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a313 expref: 15 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.678185:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe11200/0x14b4f8542d4f1b3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 307200->794623) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a313 expref: 15 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.678192:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe11200, rc 0) 00000100:00100000:1.0:1746065116.678212:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:28702:x1830881260808192:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 96us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.678216:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10199 00000100:00100000:1.0:1746065116.678707:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260807552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15018us (15542us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.678713:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4625 00002000:00100000:1.0:1746065116.678718:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009b9fe300 x1830881260807552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.678725:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fe300 with x1830881260807552 ext(3145728->4194303) 00010000:00010000:1.0:1746065116.678730:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 27 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.678740:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 27 pid: 8427 timeout: 815 lvb_type: 0 00002000:00010000:1.0:1746065116.678746:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b9fe300 00000100:00100000:1.0:1746065116.679967:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881260807424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16154us (16842us total) trans 0 rc 507904/507904 00000100:00100000:1.0:1746065116.679976:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4626 00002000:00100000:1.0:1746065116.679983:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2637824->3145727) req@ffff88009b9fdf80 x1830881260807424/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 507904/507904 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.679990:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdf80 with x1830881260807424 ext(2637824->3145727) 00010000:00010000:1.0:1746065116.679997:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 25 pid: 8427 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746065116.680008:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093f0de00/0x14b4f8542d4f1afe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f0 expref: 25 pid: 8427 timeout: 815 lvb_type: 0 00002000:00010000:1.0:1746065116.680014:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b9fdf80 00000100:00100000:0.0:1746065116.694902:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.694934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.695300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.695555:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260808576 00000100:00100000:1.0:1746065116.695560:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260808576 00000100:00100000:1.0:1746065116.696339:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10200 00000100:00100000:1.0:1746065116.696346:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:28693:x1830881260808576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.696360:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.696372:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a31a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.696406:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.696408:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.696412:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a31a expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.696423:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a31a expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065116.696430:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe11400, rc 0) 00000100:00100000:1.0:1746065116.696472:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:28693:x1830881260808576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 126us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.696478:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10200 00000100:00100000:1.0:1746065116.696498:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260808960 00000100:00100000:1.0:1746065116.696502:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260808960 00002000:00100000:1.0:1746065116.696523:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37d:0x0] (790528->794623) req@ffff88009f720700 x1830881260808960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.696531:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f720700 with x1830881260808960 ext(790528->794623) 00002000:00010000:1.0:1746065116.696535:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f720700 00000100:00100000:1.0:1746065116.696547:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4629 00000100:00100000:1.0:1746065116.696552:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260808960:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065116.697233:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260808960:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 679us (1931us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065116.697240:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4629 00002000:00100000:1.0:1746065116.697245:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37d:0x0] (790528->794623) req@ffff88009f720700 x1830881260808960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.697252:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f720700 with x1830881260808960 ext(790528->794623) 00002000:00010000:1.0:1746065116.697255:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f720700 00000100:00100000:0.0:1746065116.701138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.701218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.703163:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260809472 00000100:00100000:1.0:1746065116.703170:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260809472 00002000:00100000:1.0:1746065116.703199:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009f722680 x1830881260809472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.703208:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f722680 with x1830881260809472 ext(3145728->4194303) 00002000:00010000:1.0:1746065116.703212:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f722680 00000100:00100000:1.0:1746065116.703241:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4630 00000100:00100000:1.0:1746065116.703248:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260809472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065116.705373:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260809856 00000100:00100000:0.0:1746065116.705379:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260809856 00002000:00100000:0.0:1746065116.705419:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094ff4380 x1830881260809856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.705429:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4380 with x1830881260809856 ext(3145728->4194303) 00000100:00100000:1.0:1746065116.705431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:0.0:1746065116.705433:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff4380 00000100:00100000:0.0:1746065116.705457:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260809984 00000100:00100000:0.0:1746065116.705459:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260809984 00002000:00100000:0.0:1746065116.705470:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880094ff5880 x1830881260809984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.705475:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff5880 with x1830881260809984 ext(2097152->3145727) 00002000:00010000:0.0:1746065116.705477:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff5880 00000100:00100000:0.0:1746065116.705657:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4631 00000100:00100000:0.0:1746065116.705662:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260809856:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065116.709438:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3297:1830881259635840:0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.709454:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830881259635968:0@lo:400:kworker.0 00000100:00100000:0.0:1746065116.709497:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.709499:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065116.709529:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259636352:0@lo:400:kworker.0 00000100:00100000:0.0:1746065116.709547:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.710063:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830881259636480:0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.710081:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.710107:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830881259636096:0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.710122:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.710132:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065116.710136:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259636224:0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.710159:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259635968 00000100:00100000:1.0:1746065116.710164:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259635968 00000100:00100000:1.0:1746065116.710196:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259636480 00000100:00100000:1.0:1746065116.710198:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259636480 00000100:00100000:1.0:1746065116.710206:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259636096 00000100:00100000:1.0:1746065116.710208:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259636096 00000100:00100000:0.0:1746065116.710213:0:14642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259635840 00000100:00100000:0.0:1746065116.710216:0:14642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259635840 00000100:00100000:1.0:1746065116.710222:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1746065116.710228:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830881259635968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065116.710234:0:14642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1746065116.710239:0:14642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3297:x1830881259635840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065116.710267:0:14642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3297:x1830881259635840:12345-0@lo:400:kworker.0 Request processed in 28us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.710268:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830881259635968:12345-0@lo:400:kworker.0 Request processed in 40us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.710273:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1746065116.710273:0:14642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1746065116.710284:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1746065116.710288:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830881259636480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.710308:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830881259636480:12345-0@lo:400:kworker.0 Request processed in 20us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.710308:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3297:1830881259635840:0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.710312:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1746065116.710321:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1746065116.710325:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830881259636096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.710341:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830881259636096:12345-0@lo:400:kworker.0 Request processed in 16us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.710345:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1746065116.710357:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065116.710366:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.710398:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830881259636096:0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.710421:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830881259635968:0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.710428:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830881259636480:0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.712310:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259636224:0@lo:400:kworker.0 00000100:00100000:0.0:1746065116.712583:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259636352:0@lo:400:kworker.0 00000100:00100000:1.0:1746065116.717299:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260809472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14042us (16072us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.717312:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4630 00002000:00100000:1.0:1746065116.717322:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009f722680 x1830881260809472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.717331:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f722680 with x1830881260809472 ext(3145728->4194303) 00002000:00010000:1.0:1746065116.717336:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f722680 00000100:00100000:1.0:1746065116.724020:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259636608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746065116.724067:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065116.724112:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259636608 00000100:00100000:1.0:1746065116.724119:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259636608 00000100:00100000:1.0:1746065116.724148:0:8431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1746065116.724154:0:8431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259636608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746065116.724173:0:8431:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 397082624 pending 22151168 free 3850371072 avail 3848273920 00000100:00100000:1.0:1746065116.724200:0:8431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259636608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.724205:0:8431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1746065116.724238:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259636608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065116.729764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.729785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.729839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.729880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.729955:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260810496 00000100:00100000:1.0:1746065116.729963:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260810496 00000100:00100000:1.0:1746065116.729996:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260810752 00000100:00100000:1.0:1746065116.729998:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260810752 00000100:00100000:1.0:1746065116.730008:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260810368 00000100:00100000:1.0:1746065116.730010:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260810368 00000100:00100000:1.0:1746065116.730018:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260810624 00000100:00100000:1.0:1746065116.730020:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260810624 00000100:00100000:1.0:1746065116.730031:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10201 00000100:00100000:1.0:1746065116.730038:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881260810496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.730054:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.730070:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe10600/0x14b4f8542d4f1b4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a328 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065116.730089:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6dc, atime: 0x6812d6db, ctime: 0x6812d6dc, blocks: 0x821 00010000:00010000:1.0:1746065116.730105:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.730107:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.730114:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe10600/0x14b4f8542d4f1b4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a328 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.730129:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe10600/0x14b4f8542d4f1b4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a328 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.730138:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe10600, rc 0) 00000100:00100000:1.0:1746065116.730174:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260810496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 137us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.730179:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10201 00000100:00100000:1.0:1746065116.730193:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10202 00000100:00100000:1.0:1746065116.730198:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881260810752:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.730204:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.730213:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe11e00/0x14b4f8542d4f1b52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a336 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065116.730226:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6dd, atime: 0x6812d6dd, ctime: 0x6812d6dd, blocks: 0x821 00010000:00010000:1.0:1746065116.730234:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.730235:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.730239:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe11e00/0x14b4f8542d4f1b52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a336 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.730249:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe11e00/0x14b4f8542d4f1b52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a336 expref: 34 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.730255:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe11e00, rc 0) 00000100:00100000:1.0:1746065116.730268:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881260810752:12345-192.168.202.46@tcp:101:cat.0 Request processed in 71us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.730272:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10202 00000100:00100000:1.0:1746065116.730281:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10204 00000100:00100000:1.0:1746065116.730285:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881260810624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.730291:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.730297:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe11a00/0x14b4f8542d4f1b60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a32f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065116.730305:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6dc, atime: 0x6812d6dc, ctime: 0x6812d6dc, blocks: 0x821 00010000:00010000:1.0:1746065116.730313:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.730314:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065116.730317:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe11a00/0x14b4f8542d4f1b60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a32f expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.730325:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe11a00/0x14b4f8542d4f1b60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a32f expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.730331:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe11a00, rc 0) 00000100:00100000:1.0:1746065116.730344:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260810624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 58us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065116.730651:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10204 00000100:00100000:0.0:1746065116.732695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.732729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.733757:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.739785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.748070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.748281:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260811776 00000100:00100000:1.0:1746065116.748289:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260811776 00000100:00100000:1.0:1746065116.748343:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10208 00000100:00100000:1.0:1746065116.748351:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260811776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.748364:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.748378:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093f0c600/0x14b4f8542d4f1b7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a352 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065116.748429:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d135f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259636864:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065116.748927:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065116.751160:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d135f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259636864:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065116.751188:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093f0c600/0x14b4f8542d4f1b7c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a352 expref: 33 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.751200:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093f0c600/0x14b4f8542d4f1b7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a352 expref: 33 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.751230:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0c600, rc 0) 00000100:00100000:1.0:1746065116.751268:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260811776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2918us (3206us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065116.751275:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10208 00000100:00100000:0.0:1746065116.753281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.753372:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260811904 00000100:00100000:1.0:1746065116.753379:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260811904 00000100:00100000:1.0:1746065116.753451:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10209 00000100:00100000:1.0:1746065116.753457:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260811904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065116.753473:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065116.753487:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093f0ca00/0x14b4f8542d4f1b83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a359 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065116.753526:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d135f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259636992:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065116.753596:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065116.755041:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d135f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259636992:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065116.755068:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093f0ca00/0x14b4f8542d4f1b83 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a359 expref: 33 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.755079:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093f0ca00/0x14b4f8542d4f1b83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a359 expref: 33 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065116.755088:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0ca00, rc 0) 00000100:00100000:1.0:1746065116.755116:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260811904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1659us (1840us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065116.755123:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10209 00000100:00100000:0.0:1746065116.758334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.773052:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065116.773070:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259637120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065116.773190:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065116.773937:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259637120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065116.789586:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.794046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.794397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.800495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.804268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.809918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.866188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.868199:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.870872:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.875809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.875879:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.893460:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.895907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.901030:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.906576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.906618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.907058:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4641 00000100:00100000:1.0:1746065116.907067:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260815616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065116.914615:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260815616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7547us (7993us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065116.914622:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4641 00002000:00100000:1.0:1746065116.914628:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012bd3c700 x1830881260815616/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/440 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065116.914636:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c700 with x1830881260815616 ext(1048576->2097151) 00002000:00010000:1.0:1746065116.914640:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3c700 00000100:00100000:0.0:1746065116.923975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.925683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.925718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.925785:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260816000 00000100:00100000:1.0:1746065116.925789:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260816000 00010000:00010000:1.0:1746065116.925808:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134d8f400/0x14b4f8542d4f1bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a36e expref: 19 pid: 20754 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065116.932096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.935173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065116.940347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.940454:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260816768 00000100:00100000:0.0:1746065116.940460:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260816768 00002000:00100000:0.0:1746065116.940496:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1056768->1060863) req@ffff88012d137480 x1830881260816768/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/0 e 0 to 0 dl 1746065127 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.940504:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137480 with x1830881260816768 ext(1056768->1060863) 00002000:00010000:0.0:1746065116.940508:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d137480 00000100:00100000:0.0:1746065116.940525:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4642 00000100:00100000:0.0:1746065116.940532:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881260816768:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065116.941376:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260816768:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 843us (1183us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065116.941382:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4642 00002000:00100000:0.0:1746065116.941395:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1056768->1060863) req@ffff88012d137480 x1830881260816768/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:32/0 lens 488/4536 e 0 to 0 dl 1746065127 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065116.941402:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137480 with x1830881260816768 ext(1056768->1060863) 00002000:00010000:0.0:1746065116.941405:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d137480 00000100:00100000:0.0:1746065116.945306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.980554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.988486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.989563:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.989909:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065116.989983:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10215 00000100:00100000:0.0:1746065116.989993:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881260817536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065116.990002:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065116.990015:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a39f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065116.990028:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.990029:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065116.990036:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a39f expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.990100:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a39f expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.990110:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7d800, rc 0) 00000100:00100000:0.0:1746065116.991372:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881260817536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1379us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065116.991379:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10215 00000100:00100000:0.0:1746065116.997224:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259638784:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065116.997255:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134d8fe00/0x14b4f8542d4f1c32 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3a6 expref: 32 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.997267:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134d8fe00/0x14b4f8542d4f1c32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3a6 expref: 32 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065116.997286:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134d8fe00, rc 0) 00000100:00100000:0.0:1746065116.998898:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881260817664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8817us (8983us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065116.998907:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10216 00000100:00100000:0.0:1746065117.001364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.005291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:1.0:1746065117.005570:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065117.017175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.025054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.025173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.025242:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.025748:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4645 00000100:00100000:0.0:1746065117.025754:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260818432:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065117.027123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:1.0:1746065117.027516:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746065117.027894:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157200/0x14b4f8542d4f1c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.027902:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0157200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.027903:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157200/0x14b4f8542d4f1c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.027908:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157200/0x14b4f8542d4f1c4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.027914:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669200) 00010000:00010000:3.0:1746065117.027915:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.027917:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157200/0x14b4f8542d4f1c4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.027921:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157200/0x14b4f8542d4f1c4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.027953:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157400/0x14b4f8542d4f1c40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3b4 expref: 261 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.027965:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157a00/0x14b4f8542d4f1c55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3b4 expref: 260 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.027970:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.027972:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065117.027974:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0157a00, rc 0) 00000100:00100000:3.0:1746065117.027996:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:28724:x1830881260819072:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 545us (875us total) trans 8589942938 rc 0/0 00000100:00100000:3.0:1746065117.028002:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8912 00000100:00100000:0.0:1746065117.039926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.041833:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881260818688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14955us (16588us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065117.041842:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4646 00002000:00100000:3.0:1746065117.041848:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009fb14a80 x1830881260818688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.041854:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb14a80 with x1830881260818688 ext(1048576->2097151) 00002000:00010000:3.0:1746065117.041857:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb14a80 00000100:00100000:3.0:1746065117.045678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.045702:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260819456 00000100:00100000:3.0:1746065117.045710:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260819456 00000100:00100000:3.0:1746065117.045754:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8913 00000100:00100000:3.0:1746065117.045761:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+18:28727:x1830881260819456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.045778:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.045793:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1c63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a3bb expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.045906:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.045917:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.045932:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046160:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046167:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046176:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046255:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046261:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046266:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:3.0:1746065117.046272:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065117.046330:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046334:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046339:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046343:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb07a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.046346:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046351:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046359:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065117.046361:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.046363:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046371:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1c6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046402:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046406:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046410:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046413:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb07800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.046415:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046418:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046423:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669a00) 00010000:00010000:3.0:1746065117.046425:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.046426:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046430:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1c71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.046456:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1c63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3bb expref: 21 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.046465:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3bb expref: 20 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.046474:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.046476:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065117.046478:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07600, rc 0) 00000100:00100000:3.0:1746065117.046511:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+20:28727:x1830881260819456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 750us (841us total) trans 8589942939 rc 0/0 00000100:00100000:3.0:1746065117.046516:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8913 00000100:00100000:0.0:1746065117.048324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.048406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.048456:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260819840 00000100:00100000:3.0:1746065117.048464:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260819840 00000100:00100000:3.0:1746065117.048507:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3610 00000100:00100000:3.0:1746065117.048515:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:28727:x1830881260819840:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065117.048694:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:28727:x1830881260819840:12345-192.168.202.46@tcp:35:cat.0 Request processed in 179us (286us total) trans 8589942940 rc 0/0 00000100:00100000:3.0:1746065117.048700:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3610 00000100:00100000:0.0:1746065117.051536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.051647:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260819968 00000100:00100000:3.0:1746065117.051653:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260819968 00000100:00100000:3.0:1746065117.051678:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10219 00000100:00100000:3.0:1746065117.051683:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260819968:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.051694:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.051706:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb07200/0x14b4f8542d4f1c8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a3c9 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.051720:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.052030:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.052040:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07200/0x14b4f8542d4f1c8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c9 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.052056:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07200/0x14b4f8542d4f1c8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c9 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.052063:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07200, rc 0) 00000100:00100000:3.0:1746065117.052100:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260819968:12345-192.168.202.46@tcp:101:cat.0 Request processed in 416us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.052105:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10219 00000100:00100000:0.0:1746065117.052613:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:1.0:1746065117.052900:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065117.055296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.055737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.055794:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260820352 00000100:00100000:0.0:1746065117.055800:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260820352 00000100:00100000:0.0:1746065117.055853:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10220 00000100:00100000:0.0:1746065117.055861:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28722:x1830881260820352:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065117.055873:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.055886:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a3d0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.055909:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.055916:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065117.055917:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065117.055920:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.055941:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.055949:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 17 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.055958:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259639424:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065117.056015:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.056173:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260820224 00000100:00100000:3.0:1746065117.056177:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260820224 00010000:00010000:3.0:1746065117.056194:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe10600/0x14b4f8542d4f1b4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a328 expref: 30 pid: 8429 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746065117.056218:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5069 00000100:00100000:3.0:1746065117.056223:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260820224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.056232:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.056249:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe10600/0x14b4f8542d4f1b4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a328 expref: 30 pid: 8429 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746065117.056258:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe10600/0x14b4f8542d4f1b4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a328 expref: 30 pid: 8429 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746065117.056272:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe10600/0x14b4f8542d4f1b4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a328 expref: 30 pid: 8429 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746065117.056492:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.056494:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.056500:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f75be00/0x14b4f8542d4f1c86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c2 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.056506:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f75be00/0x14b4f8542d4f1c86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c2 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.056578:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f75be00/0x14b4f8542d4f1c86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c2 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065117.056587:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259639552:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065117.056614:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.056626:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260820608 00000100:00100000:3.0:1746065117.056629:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260820608 00002000:00100000:3.0:1746065117.056649:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f047b80 x1830881260820608/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.056658:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047b80 with x1830881260820608 ext(0->1048575) 00002000:00010000:3.0:1746065117.056662:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f047b80 00000100:00100000:3.0:1746065117.056679:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4647 00000100:00100000:3.0:1746065117.056684:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260820608:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065117.058533:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259639424:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065117.058551:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.058561:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7de00, rc 0) 00000100:00100000:0.0:1746065117.058582:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28722:x1830881260820352:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2723us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.058588:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10220 00000100:00100000:3.0:1746065117.058843:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259639552:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065117.058852:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.058870:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260820224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2647us (3581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.058877:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5069 00000100:00100000:0.0:1746065117.058961:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.059177:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260820736 00000100:00100000:3.0:1746065117.059180:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260820736 00002000:00100000:3.0:1746065117.059197:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1056768->1191935) req@ffff88012d50b100 x1830881260820736/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.059204:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50b100 with x1830881260820736 ext(1056768->1191935) 00010000:00010000:3.0:1746065117.059209:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.059225:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746065117.059230:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d50b100 00000100:00100000:3.0:1746065117.059241:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1449 00000100:00100000:3.0:1746065117.059246:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260820736:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065117.067109:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260820608:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10416us (10576us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065117.067119:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4647 00002000:00100000:3.0:1746065117.067129:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f047b80 x1830881260820608/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.067138:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047b80 with x1830881260820608 ext(0->1048575) 00002000:00010000:3.0:1746065117.067942:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f047b80 00000100:00100000:0.0:1746065117.068724:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260820736:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9473us (9757us total) trans 17179872702 rc 0/0 00000100:00100000:0.0:1746065117.068733:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1449 00002000:00100000:0.0:1746065117.068739:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1056768->1191935) req@ffff88012d50b100 x1830881260820736/t17179872702(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.068747:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50b100 with x1830881260820736 ext(1056768->1191935) 00010000:00010000:0.0:1746065117.068755:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.068770:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746065117.068776:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d50b100 00000100:00100000:0.0:1746065117.069276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.070839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.070883:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260821504 00000100:00100000:3.0:1746065117.070888:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260821504 00000100:00100000:3.0:1746065117.070921:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8914 00000100:00100000:3.0:1746065117.070926:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:28729:x1830881260821504:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065117.070939:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.070952:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1c9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a3d7 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.071026:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071037:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071046:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071056:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071061:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071065:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071146:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06800/0x14b4f8542d4f1cb0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071155:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06800/0x14b4f8542d4f1cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071160:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06800/0x14b4f8542d4f1cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:3.0:1746065117.071167:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065117.071229:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071235:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071240:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071245:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.071248:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071254:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071262:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065117.071264:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.071267:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071271:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1ca2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071296:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071301:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071305:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071309:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.071311:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071315:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071324:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669f00) 00010000:00010000:3.0:1746065117.071325:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.071327:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071331:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ca9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.071359:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1c9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d7 expref: 24 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.071370:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06800/0x14b4f8542d4f1cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d7 expref: 23 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.071376:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.071377:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065117.071379:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06800, rc 0) 00000100:00100000:3.0:1746065117.071422:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+23:28729:x1830881260821504:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 495us (583us total) trans 8589942941 rc 0/0 00000100:00100000:3.0:1746065117.071427:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8914 00000100:00100000:0.0:1746065117.072511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.075356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.075376:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260821888 00000100:00100000:0.0:1746065117.075381:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260821888 00000100:00100000:0.0:1746065117.075417:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3611 00000100:00100000:0.0:1746065117.075423:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:28724:x1830881260821888:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065117.075600:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:28724:x1830881260821888:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 177us (245us total) trans 8589942942 rc 0/0 00000100:00100000:0.0:1746065117.075606:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3611 00000100:00100000:0.0:1746065117.075708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.076011:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260822016 00000100:00100000:3.0:1746065117.076015:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260822016 00010000:00010000:3.0:1746065117.076034:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.076053:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5070 00000100:00100000:3.0:1746065117.076057:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1959:x1830881260822016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.076065:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.076080:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.076089:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.076105:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134d8e400/0x14b4f8542d4f1bfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1191935) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a38a expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.076115:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.076116:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.076121:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.076128:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.076151:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065117.076160:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259639808:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065117.076219:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.077917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.077963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.079253:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260822400 00000100:00100000:0.0:1746065117.079260:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260822400 00000100:00100000:3.0:1746065117.079615:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 601 00000100:00100000:3.0:1746065117.079622:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260822400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.079630:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.079649:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06800/0x14b4f8542d4f1cb0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d7 expref: 24 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.079666:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.079669:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.082285:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881260822400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2661us (4318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.082293:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 601 00000100:00100000:0.0:1746065117.086004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.086025:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260822784 00000100:00100000:0.0:1746065117.086031:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260822784 00002000:00100000:0.0:1746065117.086058:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d94a80 x1830881260822784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.086067:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94a80 with x1830881260822784 ext(1048576->2097151) 00002000:00010000:0.0:1746065117.086070:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d94a80 00000100:00100000:0.0:1746065117.086092:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4650 00000100:00100000:0.0:1746065117.086098:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260822784:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065117.088403:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259639808:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065117.088419:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.088439:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260822016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 12381us (12731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.088446:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5070 00000100:00100000:0.0:1746065117.097496:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260822784:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11389us (11488us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065117.097507:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4650 00002000:00100000:0.0:1746065117.097517:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d94a80 x1830881260822784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.097526:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94a80 with x1830881260822784 ext(1048576->2097151) 00002000:00010000:0.0:1746065117.097531:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d94a80 00000100:00100000:0.0:1746065117.101682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.101731:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260822912 00000100:00100000:3.0:1746065117.101739:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260822912 00010000:00010000:3.0:1746065117.101769:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f75be00/0x14b4f8542d4f1c86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c2 expref: 31 pid: 8429 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.101804:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5071 00000100:00100000:3.0:1746065117.101810:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881260822912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.101841:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065117.101858:0:8444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065116 -> 1746065118 00002000:00010000:3.0:1746065117.101861:0:8444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065116 -> 1746065118 00010000:00010000:3.0:1746065117.101866:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f75be00/0x14b4f8542d4f1c86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c2 expref: 31 pid: 8429 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.101878:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f75be00/0x14b4f8542d4f1c86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1519615) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c2 expref: 31 pid: 8429 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.101896:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f75be00/0x14b4f8542d4f1c86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1519615) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c2 expref: 31 pid: 8429 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.101917:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.101919:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.101925:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f75b800/0x14b4f8542d4f1cbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3de expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.101932:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f75b800/0x14b4f8542d4f1cbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3de expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.101958:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f75b800/0x14b4f8542d4f1cbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3de expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065117.101968:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259639936:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065117.105626:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.110270:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259639936:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065117.110287:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.110332:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260822912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8521us (8657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.110342:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5071 00000100:00100000:0.0:1746065117.110990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.120638:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260823424 00000100:00100000:0.0:1746065117.120647:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260823424 00002000:00100000:0.0:1746065117.120682:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f720380 x1830881260823424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.120691:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f720380 with x1830881260823424 ext(1048576->2097151) 00002000:00010000:0.0:1746065117.120696:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f720380 00000100:00100000:0.0:1746065117.120715:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4652 00000100:00100000:0.0:1746065117.120722:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881260823424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065117.121444:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881260823168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10315us (10452us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065117.121453:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4651 00002000:00100000:3.0:1746065117.121459:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a5880e00 x1830881260823168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.121467:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880e00 with x1830881260823168 ext(2097152->3145727) 00002000:00010000:3.0:1746065117.121471:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880e00 00000100:00100000:0.0:1746065117.133147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.133609:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260823552 00000100:00100000:3.0:1746065117.133615:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260823552 00000100:00100000:3.0:1746065117.133643:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10222 00000100:00100000:3.0:1746065117.133650:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260823552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.133666:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.133680:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a3e5 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.133702:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.133704:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.133711:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3e5 expref: 31 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.133724:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3e5 expref: 31 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.133734:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06600, rc 0) 00000100:00100000:3.0:1746065117.133752:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881260823552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 104us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.133758:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10222 00000100:00100000:0.0:1746065117.145758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.145812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.145916:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260823808 00000100:00100000:1.0:1746065117.145923:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260823808 00000100:00100000:1.0:1746065117.145973:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3613 00000100:00100000:1.0:1746065117.145980:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:28722:x1830881260823808:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065117.146158:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:28722:x1830881260823808:12345-192.168.202.46@tcp:35:cat.0 Request processed in 177us (406us total) trans 8589942944 rc 0/0 00000100:00100000:1.0:1746065117.146165:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3613 00000100:00100000:0.0:1746065117.160928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.236370:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.244203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.244246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.244452:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260824576 00000100:00100000:3.0:1746065117.244460:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260824576 00000100:00100000:1.0:1746065117.244486:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260824448 00010000:00010000:3.0:1746065117.244488:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134d8f400/0x14b4f8542d4f1c39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ad expref: 33 pid: 8429 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746065117.244490:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260824448 00010000:00010000:1.0:1746065117.244506:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07200/0x14b4f8542d4f1c8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c9 expref: 21 pid: 8429 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746065117.244528:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5072 00000100:00100000:1.0:1746065117.244534:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5073 00000100:00100000:3.0:1746065117.244536:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260824576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065117.244540:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260824448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.244547:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065117.244547:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.244564:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134d8f400/0x14b4f8542d4f1c39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ad expref: 33 pid: 8429 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.244564:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07200/0x14b4f8542d4f1c8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c9 expref: 21 pid: 8429 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746065117.244574:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134d8f400/0x14b4f8542d4f1c39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ad expref: 33 pid: 8429 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.244582:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb07200/0x14b4f8542d4f1c8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c9 expref: 21 pid: 8429 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746065117.244599:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134d8f400/0x14b4f8542d4f1c39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ad expref: 33 pid: 8429 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.244664:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07200/0x14b4f8542d4f1c8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3c9 expref: 21 pid: 8429 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746065117.244683:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.244684:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.244691:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.244698:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.244725:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.244736:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259640320:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065117.244788:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e15ec00 going to sleep for 11 seconds 00010000:00010000:3.0:1746065117.244799:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.244843:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260824576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 307us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.244850:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5072 00000100:00100000:1.0:1746065117.248560:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259640320:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065117.248582:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065117.248617:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260824448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4075us (4368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.248626:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5073 00000100:00100000:0.0:1746065117.249961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.258759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.264276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.264398:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260825088 00000100:00100000:1.0:1746065117.264403:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260825088 00010000:00010000:1.0:1746065117.264426:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3e5 expref: 31 pid: 25185 timeout: 816 lvb_type: 1 00000100:00100000:1.0:1746065117.264457:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5074 00000100:00100000:1.0:1746065117.264464:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260825088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065117.264474:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065117.264490:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3e5 expref: 31 pid: 25185 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746065117.264499:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3e5 expref: 31 pid: 25185 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746065117.264516:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3e5 expref: 31 pid: 25185 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746065117.264533:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065117.264552:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260825088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.264557:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5074 00000100:00100000:0.0:1746065117.269654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.269827:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260825216 00000100:00100000:3.0:1746065117.269836:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260825216 00010000:00010000:3.0:1746065117.269870:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f75b800/0x14b4f8542d4f1cbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3de expref: 23 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.269907:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5075 00000100:00100000:3.0:1746065117.269914:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881260825216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.269926:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.269943:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f75b800/0x14b4f8542d4f1cbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3de expref: 23 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.269953:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f75b800/0x14b4f8542d4f1cbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3de expref: 23 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.269970:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f75b800/0x14b4f8542d4f1cbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3de expref: 23 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.269995:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.269997:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.270003:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.270009:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.270036:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065117.270046:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259640704:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065117.273020:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.278338:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259640704:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065117.278355:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.278412:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260825216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8496us (8763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.278421:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5075 00000100:00100000:0.0:1746065117.281891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.282091:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260825472 00000100:00100000:3.0:1746065117.282098:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260825472 00002000:00100000:3.0:1746065117.282132:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1478656->1482751) req@ffff88008fd73800 x1830881260825472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.282141:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73800 with x1830881260825472 ext(1478656->1482751) 00002000:00010000:3.0:1746065117.282146:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd73800 00000100:00100000:3.0:1746065117.282176:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4655 00000100:00100000:3.0:1746065117.282182:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260825472:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065117.282321:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260825472:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 138us (436us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065117.282327:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4655 00002000:00100000:3.0:1746065117.282332:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1478656->1482751) req@ffff88008fd73800 x1830881260825472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.282339:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73800 with x1830881260825472 ext(1478656->1482751) 00002000:00010000:3.0:1746065117.282341:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd73800 00000100:00100000:0.0:1746065117.299955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.300266:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260825728 00000100:00100000:3.0:1746065117.300273:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260825728 00000100:00100000:3.0:1746065117.300315:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8915 00000100:00100000:3.0:1746065117.300321:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:28734:x1830881260825728:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065117.300338:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.300351:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a401 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.300440:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300453:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300461:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300471:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300475:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300480:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300551:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cf6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300557:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300562:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:3.0:1746065117.300568:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065117.300625:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300630:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300635:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300643:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.300646:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300651:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300659:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065117.300662:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.300665:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300669:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300697:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300701:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300705:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300708:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.300710:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300713:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300718:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669600) 00010000:00010000:3.0:1746065117.300720:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.300722:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300726:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1cef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.300755:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a401 expref: 264 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.300766:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a401 expref: 263 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.300771:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.300773:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065117.300775:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06600, rc 0) 00000100:00100000:3.0:1746065117.300838:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:28734:x1830881260825728:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 516us (889us total) trans 8589942945 rc 0/0 00000100:00100000:3.0:1746065117.300844:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8915 00000100:00100000:0.0:1746065117.311878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.314420:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260825856 00000100:00100000:3.0:1746065117.314429:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260825856 00000100:00100000:3.0:1746065117.314489:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 602 00000100:00100000:3.0:1746065117.314496:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:1959:x1830881260825856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.314509:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.314531:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1cf6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a401 expref: 263 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.314563:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.314567:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.314613:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1959:x1830881260825856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 117us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.314619:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 602 00000100:00100000:0.0:1746065117.318449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.324863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.324973:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260826240 00000100:00100000:1.0:1746065117.324982:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260826240 00000100:00100000:1.0:1746065117.325035:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 603 00000100:00100000:1.0:1746065117.325043:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881260826240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065117.325056:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065117.325076:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909ac600/0x14b4f8542d4f1d19 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a408 expref: 25 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.325106:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065117.325110:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065117.325145:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260826240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.325151:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 603 00000100:00100000:0.0:1746065117.328886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.328992:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260826496 00000100:00100000:3.0:1746065117.329000:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260826496 00000100:00100000:3.0:1746065117.329035:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3614 00000100:00100000:3.0:1746065117.329042:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:28738:x1830881260826496:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065117.329213:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:28738:x1830881260826496:12345-192.168.202.46@tcp:35:cat.0 Request processed in 171us (335us total) trans 8589942947 rc 0/0 00000100:00100000:3.0:1746065117.329218:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3614 00000100:00100000:0.0:1746065117.335402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.336092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.339163:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4657 00000100:00100000:3.0:1746065117.339174:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260827008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065117.351199:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260827008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12021us (15100us total) trans 0 rc 614400/614400 00000100:00100000:3.0:1746065117.351209:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4657 00002000:00100000:3.0:1746065117.351218:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1482752->2097151) req@ffff88008fd71880 x1830881260827008/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.351226:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71880 with x1830881260827008 ext(1482752->2097151) 00002000:00010000:3.0:1746065117.351231:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd71880 00000100:00100000:0.0:1746065117.391859:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.391986:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260827264 00000100:00100000:3.0:1746065117.391994:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260827264 00000100:00100000:3.0:1746065117.392044:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8917 00000100:00100000:3.0:1746065117.392051:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:28742:x1830881260827264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.392072:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.392086:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a40f expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.392190:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392200:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392208:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392217:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392222:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392227:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392308:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392315:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392321:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:3.0:1746065117.392327:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065117.392407:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392413:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392421:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392426:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.392429:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392434:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392443:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065117.392446:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.392449:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392453:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1d2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392468:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392473:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392477:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392481:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.392483:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392488:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392496:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669a00) 00010000:00010000:3.0:1746065117.392498:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.392500:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392504:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1d35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.392534:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a40f expref: 265 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.392545:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a40f expref: 264 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.392551:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.392553:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065117.392555:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07400, rc 0) 00000100:00100000:3.0:1746065117.392595:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:28742:x1830881260827264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 543us (743us total) trans 8589942948 rc 0/0 00000100:00100000:3.0:1746065117.392601:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8917 00000100:00100000:0.0:1746065117.410528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.410616:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260827392 00000100:00100000:3.0:1746065117.410624:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260827392 00000100:00100000:3.0:1746065117.410678:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 604 00000100:00100000:3.0:1746065117.410686:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1959:x1830881260827392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.410698:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.410719:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d3c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a40f expref: 264 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.410740:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.410744:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.410781:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:1959:x1830881260827392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.410787:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 604 00000100:00100000:0.0:1746065117.411435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.411470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.411526:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260827520 00000100:00100000:1.0:1746065117.411531:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260827520 00000100:00100000:1.0:1746065117.411552:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260827648 00000100:00100000:1.0:1746065117.411553:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260827648 00000100:00100000:1.0:1746065117.411577:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10226 00000100:00100000:1.0:1746065117.411582:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881260827520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065117.411594:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065117.411606:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe11c00/0x14b4f8542d4f1d4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a416 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.411644:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259640832:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065117.411699:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972780 going to sleep for 11 seconds 00002000:00010000:0.0:1746065117.422915:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime: 1746065117 -> 1746065118 00002000:00010000:0.0:1746065117.422922:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime: 1746065117 -> 1746065118 00002000:00010000:0.0:1746065117.422925:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime: 1746065117 -> 1746065118 00000100:00100000:0.0:1746065117.422945:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259640832:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065117.422975:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe11c00/0x14b4f8542d4f1d4a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a416 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.422986:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe11c00/0x14b4f8542d4f1d4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a416 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.423011:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe11c00, rc 0) 00000100:00100000:0.0:1746065117.423049:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881260827520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11466us (11614us total) trans 0 rc 301/301 00010000:00010000:2.0:1746065117.423055:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f888a00/0x14b4f8542d4f1d51 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a41d expref: 31 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065117.423056:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10226 00010000:00010000:2.0:1746065117.423066:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f888a00/0x14b4f8542d4f1d51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a41d expref: 31 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.423077:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f888a00, rc 0) 00000100:00100000:2.0:1746065117.423093:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260827648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11241us (11623us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065117.423098:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10227 00000100:00100000:1.0:1746065117.426207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.426340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.426430:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260828032 00000100:00100000:3.0:1746065117.426437:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260828032 00000100:00100000:3.0:1746065117.426513:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10228 00000100:00100000:3.0:1746065117.426521:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28742:x1830881260828032:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.426536:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.426548:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a42b expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.426571:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.426578:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065117.426579:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065117.426582:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.426606:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.426620:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 19 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.426636:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641088:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.426699:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065117.426914:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260827904 00000100:00100000:2.0:1746065117.426919:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260827904 00000100:00100000:2.0:1746065117.426956:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8918 00000100:00100000:2.0:1746065117.426961:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:28744:x1830881260827904:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065117.426972:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.426981:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888600/0x14b4f8542d4f1d5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a424 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.427052:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427061:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427068:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427077:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427080:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427085:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427671:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888000/0x14b4f8542d4f1d74 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427680:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888000/0x14b4f8542d4f1d74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427687:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888000/0x14b4f8542d4f1d74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065117.427695:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065117.427760:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427767:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427772:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427776:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f888400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065117.427779:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427784:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427793:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065117.427795:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065117.427798:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427805:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888400/0x14b4f8542d4f1d66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427843:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427847:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427851:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427854:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f888200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065117.427856:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427860:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427865:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205e00) 00010000:00010000:2.0:1746065117.427867:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065117.427869:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427873:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888200/0x14b4f8542d4f1d6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.427900:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888600/0x14b4f8542d4f1d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a424 expref: 28 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.427909:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888000/0x14b4f8542d4f1d74 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a424 expref: 27 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.427919:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.427921:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065117.427923:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f888000, rc 0) 00000100:00100000:2.0:1746065117.427964:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:28744:x1830881260827904:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1002us (1765us total) trans 8589942949 rc 0/0 00000100:00100000:2.0:1746065117.427970:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8918 00000100:00100000:0.0:1746065117.428615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.428964:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641088:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065117.428969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065117.428984:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.428996:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07e00, rc 0) 00000100:00100000:3.0:1746065117.429027:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28742:x1830881260828032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2506us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.429034:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10228 00000100:00100000:3.0:1746065117.429048:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260828160 00000100:00100000:3.0:1746065117.429052:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260828160 00000100:00100000:3.0:1746065117.429083:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10229 00000100:00100000:3.0:1746065117.429089:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28734:x1830881260828160:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065117.429098:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.429106:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a432 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.429122:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.429130:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909ad400/0x14b4f8542d4f1ccc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ec expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.429140:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.429142:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.429145:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1593344->2097151] (req 1593344->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.429164:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800909ad400/0x14b4f8542d4f1ccc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ec expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.429174:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800909ad400/0x14b4f8542d4f1ccc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ec expref: 19 pid: 8429 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.429183:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641216:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.429248:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.429256:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 34 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.429264:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641344:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.429280:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.429293:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260828288 00000100:00100000:3.0:1746065117.429296:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260828288 00002000:00100000:3.0:1746065117.429315:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (626688->1048575) req@ffff880094ad7800 x1830881260828288/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.429323:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad7800 with x1830881260828288 ext(626688->1048575) 00010000:00010000:3.0:1746065117.429328:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.429336:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 20 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746065117.429341:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094ad7800 00000100:00100000:3.0:1746065117.429354:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1451 00000100:00100000:3.0:1746065117.429359:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260828288:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065117.433020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.433218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.433287:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260828544 00000100:00100000:2.0:1746065117.433291:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260828672 00000100:00100000:1.0:1746065117.433295:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260828544 00000100:00100000:2.0:1746065117.433302:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260828672 00000100:00100000:1.0:1746065117.433325:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3615 00000100:00100000:1.0:1746065117.433331:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+28:28744:x1830881260828544:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065117.433332:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 605 00000100:00100000:2.0:1746065117.433337:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260828672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.433347:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.433364:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f888000/0x14b4f8542d4f1d74 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a424 expref: 28 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.433390:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.433394:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.433423:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260828672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.433429:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 605 00000100:00100000:1.0:1746065117.433479:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+27:28744:x1830881260828544:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 146us (465us total) trans 8589942950 rc 0/0 00000100:00100000:1.0:1746065117.433484:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3615 00000100:00100000:3.0:1746065117.433717:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641216:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.433726:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641344:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.433746:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1593344->2097151] (req 1593344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.433758:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07800, rc 0) 00000100:00100000:3.0:1746065117.433774:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:28734:x1830881260828160:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4686us (5161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.433780:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10229 00000100:00100000:2.0:1746065117.435229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.435848:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260828800 00000100:00100000:0.0:1746065117.435855:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260828800 00010000:00010000:0.0:1746065117.437934:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800909ad400/0x14b4f8542d4f1ccc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ec expref: 22 pid: 8429 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.437976:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5076 00000100:00100000:0.0:1746065117.437988:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260828800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.438000:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.438018:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800909ad400/0x14b4f8542d4f1ccc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ec expref: 22 pid: 8429 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.438035:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800909ad400/0x14b4f8542d4f1ccc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ec expref: 22 pid: 8429 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.438059:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909ad400/0x14b4f8542d4f1ccc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3ec expref: 22 pid: 8429 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746065117.438085:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065117.438371:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260828800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 387us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.438377:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5076 00000100:00100000:1.0:1746065117.438400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.438435:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260828928 00000100:00100000:0.0:1746065117.438440:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260828928 00010000:00010000:0.0:1746065117.438453:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 34 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.438471:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5077 00000100:00100000:0.0:1746065117.438476:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881260828928:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065117.438497:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065117.438506:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 34 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.438514:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 34 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.438526:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1c94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3d0 expref: 34 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.438533:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.438536:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.438541:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.438551:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.438576:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.438585:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259641472:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065117.438704:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.441775:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260828288:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12408us (12799us total) trans 17179872703 rc 0/0 00000100:00100000:3.0:1746065117.441785:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1451 00002000:00100000:3.0:1746065117.441795:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (626688->1048575) req@ffff880094ad7800 x1830881260828288/t17179872703(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.441803:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad7800 with x1830881260828288 ext(626688->1048575) 00010000:00010000:3.0:1746065117.441981:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 21 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.441995:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 21 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746065117.442001:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094ad7800 00000100:00100000:0.0:1746065117.442367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.442431:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260829184 00000100:00100000:3.0:1746065117.442437:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260829184 00002000:00100000:3.0:1746065117.442461:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1593344->1597439) req@ffff880094ad7480 x1830881260829184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.442468:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad7480 with x1830881260829184 ext(1593344->1597439) 00002000:00010000:3.0:1746065117.442471:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad7480 00000100:00100000:3.0:1746065117.442484:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4658 00000100:00100000:3.0:1746065117.442489:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881260829184:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065117.442585:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881260829184:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 95us (219us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065117.442590:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4658 00002000:00100000:3.0:1746065117.442595:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1593344->1597439) req@ffff880094ad7480 x1830881260829184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.442601:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad7480 with x1830881260829184 ext(1593344->1597439) 00002000:00010000:3.0:1746065117.442603:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad7480 00000100:00100000:1.0:1746065117.442756:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259641472:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065117.442771:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065117.442802:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260828928:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4325us (4402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.442809:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5077 00000100:00100000:0.0:1746065117.445912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.446479:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260829312 00000100:00100000:1.0:1746065117.446486:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260829312 00010000:00010000:1.0:1746065117.446514:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 21 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746065117.446552:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5078 00000100:00100000:1.0:1746065117.446559:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881260829312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065117.446571:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065117.446589:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 21 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.446605:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 21 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.446624:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909ad800/0x14b4f8542d4f1cd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3f3 expref: 21 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.446635:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.446637:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.446644:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.446652:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.446678:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.446690:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259641600:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065117.446762:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.448364:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259641600:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065117.448398:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065117.448487:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1958:x1830881260829312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1927us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.448495:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5078 00000100:00100000:0.0:1746065117.449843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.449897:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260829440 00000100:00100000:3.0:1746065117.449903:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260829440 00000100:00100000:3.0:1746065117.449943:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10230 00000100:00100000:3.0:1746065117.449950:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28734:x1830881260829440:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065117.449964:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.449979:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a439 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.450001:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.450009:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.450014:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.450016:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.450019:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->2363391] (req 2097152->2363391) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.450039:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.450050:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 19 pid: 9716 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.450060:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.450130:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.450138:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 34 pid: 8851 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.450151:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641856:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.450168:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.456678:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641728:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.456690:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259641856:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.456716:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->2363391] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.456730:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07400, rc 0) 00000100:00100000:3.0:1746065117.458117:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:28734:x1830881260829440:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8162us (8300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.458126:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10230 00000100:00100000:0.0:1746065117.458555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.459372:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260829696 00000100:00100000:1.0:1746065117.459388:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260829696 00002000:00100000:1.0:1746065117.459422:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009c7ac000 x1830881260829696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.459430:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac000 with x1830881260829696 ext(0->1048575) 00002000:00010000:1.0:1746065117.459434:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ac000 00000100:00100000:1.0:1746065117.459465:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4659 00000100:00100000:1.0:1746065117.459472:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881260829696:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065117.459861:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.459895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.459943:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260829952 00000100:00100000:2.0:1746065117.459947:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260829952 00010000:00010000:2.0:1746065117.459967:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 35 pid: 8851 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746065117.459989:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260829824 00000100:00100000:2.0:1746065117.459991:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260829824 00010000:00010000:2.0:1746065117.459999:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 20 pid: 9716 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746065117.460026:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5079 00000100:00100000:2.0:1746065117.460032:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881260829952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.460040:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.460052:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 35 pid: 8851 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.460062:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 35 pid: 8851 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.460081:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013119b200/0x14b4f8542d4f1b05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2f7 expref: 35 pid: 8851 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.460094:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.460122:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881260829952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.460127:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5079 00000100:00100000:2.0:1746065117.460139:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5080 00000100:00100000:2.0:1746065117.460144:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+20:1959:x1830881260829824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.460150:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.460156:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 20 pid: 9716 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.460164:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 20 pid: 9716 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.460175:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013697a200/0x14b4f8542d4f1b0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a2fe expref: 20 pid: 9716 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.460183:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.460184:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.460190:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.460197:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.460220:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065117.460230:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259641984:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065117.460273:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.469893:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260829696:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10412us (11331us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065117.469903:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4659 00002000:00100000:1.0:1746065117.469913:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009c7ac000 x1830881260829696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.469921:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac000 with x1830881260829696 ext(0->1048575) 00002000:00010000:1.0:1746065117.469925:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ac000 00000100:00100000:2.0:1746065117.470014:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259641984:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065117.470031:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.470048:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260829824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 9904us (10157us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.470055:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5080 00000100:00100000:0.0:1746065117.474997:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.475094:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260830208 00000100:00100000:1.0:1746065117.475102:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260830208 00002000:00100000:1.0:1746065117.475138:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2359296->2363391) req@ffff88009c7ace00 x1830881260830208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.475147:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ace00 with x1830881260830208 ext(2359296->2363391) 00002000:00010000:1.0:1746065117.475151:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ace00 00000100:00100000:1.0:1746065117.475180:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4660 00000100:00100000:1.0:1746065117.475187:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260830208:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065117.475348:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260830208:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 160us (359us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065117.475358:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4660 00002000:00100000:1.0:1746065117.475363:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2359296->2363391) req@ffff88009c7ace00 x1830881260830208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.475370:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ace00 with x1830881260830208 ext(2359296->2363391) 00002000:00010000:1.0:1746065117.475373:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ace00 00000100:00100000:0.0:1746065117.477687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.477806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.477891:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260830336 00000100:00100000:3.0:1746065117.477897:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260830336 00000100:00100000:0.0:1746065117.478374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.478478:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260830592 00000100:00100000:1.0:1746065117.478482:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260830592 00000100:00100000:3.0:1746065117.478602:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10231 00000100:00100000:3.0:1746065117.478609:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28742:x1830881260830336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.478623:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.478636:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a440 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.478659:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.478664:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065117.478667:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065117.478669:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.478692:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.478701:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 21 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.478711:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259642112:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.478761:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.479278:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3616 00000100:00100000:1.0:1746065117.479289:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:28734:x1830881260830592:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065117.479389:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260830720 00000100:00100000:2.0:1746065117.479394:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260830720 00000100:00100000:2.0:1746065117.479434:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8919 00000100:00100000:2.0:1746065117.479439:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28746:x1830881260830720:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065117.479447:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.479456:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1d97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a447 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.479457:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:28734:x1830881260830592:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 169us (1651us total) trans 8589942951 rc 0/0 00000100:00100000:1.0:1746065117.479463:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3616 00000100:00080000:1.0:1746065117.479479:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065117.479501:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.479510:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.479519:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.479529:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.479534:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.479539:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.479723:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.479732:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d8ea00/0x14b4f8542d4f1bec lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a383 expref: 26 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.479738:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.479755:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134d8ea00/0x14b4f8542d4f1bec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a383 expref: 26 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.479762:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d8ea00/0x14b4f8542d4f1bec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a383 expref: 26 pid: 20754 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746065117.479770:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259642240:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065117.480103:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.480419:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259642112:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.480435:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.480445:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07000, rc 0) 00000100:00100000:3.0:1746065117.480477:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28742:x1830881260830336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1867us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.480482:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10231 00000100:00100000:0.0:1746065117.481358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.481418:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260830848 00000100:00100000:3.0:1746065117.481423:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260830848 00002000:00100000:3.0:1746065117.481447:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1896447) req@ffff88009c7afb80 x1830881260830848/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 504/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.481455:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7afb80 with x1830881260830848 ext(1048576->1896447) 00010000:00010000:3.0:1746065117.481460:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 22 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.481470:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 22 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746065117.481476:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7afb80 00000100:00100000:3.0:1746065117.481551:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1452 00000100:00100000:3.0:1746065117.481557:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260830848:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065117.481674:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.481725:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260831104 00000100:00100000:1.0:1746065117.481729:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260831104 00000100:00100000:1.0:1746065117.481750:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3617 00000100:00100000:1.0:1746065117.481755:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+27:19663:x1830881260831104:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065117.481890:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+28:19663:x1830881260831104:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 134us (216us total) trans 8589942952 rc 0/0 00000100:00100000:1.0:1746065117.481896:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3617 00000100:00100000:2.0:1746065117.482106:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259642240:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065117.482123:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065117.487220:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.487277:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260831232 00000100:00100000:3.0:1746065117.487286:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260831232 00010000:00010000:3.0:1746065117.487314:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134d8ea00/0x14b4f8542d4f1bec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a383 expref: 28 pid: 20754 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.487338:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5081 00000100:00100000:3.0:1746065117.487345:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260831232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.487355:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.487360:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134d8ea00/0x14b4f8542d4f1bec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a383 expref: 28 pid: 20754 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.487370:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134d8ea00/0x14b4f8542d4f1bec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a383 expref: 28 pid: 20754 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.487399:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d8ea00/0x14b4f8542d4f1bec lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a383 expref: 28 pid: 20754 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.487428:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.487432:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.487440:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.487445:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.487460:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.487494:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260831232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 149us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.487499:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5081 00010000:00010000:2.0:1746065117.487695:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487704:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065117.487740:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:2.0:1746065117.487743:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065117.487755:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487763:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487770:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487775:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487781:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487786:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb72c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065117.487789:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487794:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487801:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065117.487803:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065117.487806:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487810:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1d9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487848:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487852:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487856:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487859:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb72e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065117.487861:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487865:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487874:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205a00) 00010000:00010000:2.0:1746065117.487876:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065117.487878:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487881:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1da5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.487912:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1d97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a447 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.487922:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a447 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.487927:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.487929:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065117.487931:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb73a00, rc 0) 00000100:00100000:2.0:1746065117.487967:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28746:x1830881260830720:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 8527us (9593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.487972:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8919 00000100:00100000:0.0:1746065117.491760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.491781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.492104:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.492120:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260831360 00000100:00100000:2.0:1746065117.492128:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260831360 00000100:00100000:2.0:1746065117.492173:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260831616 00000100:00100000:2.0:1746065117.492175:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260831616 00000100:00100000:2.0:1746065117.492187:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10232 00000100:00100000:2.0:1746065117.492193:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881260831360:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065117.492207:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.492220:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a44e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.492238:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.492240:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.492247:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a44e expref: 6 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.492259:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a44e expref: 6 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.492269:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb72200, rc 0) 00000100:00100000:2.0:1746065117.492525:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260831360:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 330us (769us total) trans 0 rc 0/0 00000100:00080000:1.0:1746065117.492527:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065117.492531:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10232 00000100:00100000:2.0:1746065117.492544:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260831872 00000100:00100000:2.0:1746065117.492547:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260831872 00000100:00100000:1.0:1746065117.492576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.492968:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260831488 00000100:00100000:2.0:1746065117.492972:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260831488 00000100:00100000:1.0:1746065117.492975:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10233 00000100:00100000:1.0:1746065117.492982:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260831616:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:2.0:1746065117.492987:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10234 00010000:00010000:1.0:1746065117.492989:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065117.492991:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260831872:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065117.492996:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065117.492996:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a45c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.493001:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb72800/0x14b4f8542d4f1dc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a46a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.493008:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.493009:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.493013:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a45c expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.493021:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a45c expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.493026:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe11000, rc 0) 00000100:00100000:2.0:1746065117.493027:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259642368:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065117.493042:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260831616:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 62us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.493047:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10233 00000100:00100000:1.0:1746065117.493057:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10235 00000100:00100000:1.0:1746065117.493060:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260831488:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065117.493065:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065117.493069:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5840 going to sleep for 11 seconds 00010000:00010000:1.0:1746065117.493071:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe11e00/0x14b4f8542d4f1dc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a455 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.493090:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259642496:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065117.493109:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.493128:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.493166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.493254:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260831744 00000100:00100000:0.0:1746065117.493257:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260831744 00000100:00100000:0.0:1746065117.493271:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260832000 00000100:00100000:0.0:1746065117.493273:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260832000 00000100:00100000:0.0:1746065117.493283:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10236 00000100:00100000:0.0:1746065117.493287:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260831744:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065117.493293:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.493299:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7c600/0x14b4f8542d4f1dcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a463 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065117.493304:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10237 00000100:00100000:2.0:1746065117.493310:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260832000:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065117.493315:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065117.493318:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259642624:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065117.493320:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a471 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.493329:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.493330:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.493334:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a471 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065117.493338:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00010000:00010000:2.0:1746065117.493343:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a471 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.493349:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb73200, rc 0) 00000100:00100000:2.0:1746065117.493363:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260832000:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.493368:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10237 00002000:00010000:3.0:1746065117.495589:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065117 -> 1746065118 00002000:00010000:3.0:1746065117.495595:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065117 -> 1746065118 00002000:00010000:3.0:1746065117.495598:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065117 -> 1746065118 00000100:00100000:3.0:1746065117.495615:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259642368:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065117.495641:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb72800/0x14b4f8542d4f1dc1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a46a expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.495650:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb72800/0x14b4f8542d4f1dc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a46a expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.495659:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb72800, rc 0) 00000100:00100000:3.0:1746065117.495689:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260831872:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2696us (3584us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065117.495695:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10234 00002000:00010000:0.0:1746065117.495808:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065117 -> 1746065118 00002000:00010000:0.0:1746065117.495810:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065117 -> 1746065118 00002000:00010000:0.0:1746065117.495812:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065117 -> 1746065118 00000100:00100000:0.0:1746065117.495832:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259642624:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065117.495844:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7c600/0x14b4f8542d4f1dcf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a463 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.495852:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7c600/0x14b4f8542d4f1dcf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a463 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.495861:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7c600, rc 0) 00000100:00100000:0.0:1746065117.495878:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260831744:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2591us (2750us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065117.495883:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10236 00000100:00100000:2.0:1746065117.496072:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881260830848:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 14514us (14714us total) trans 21474839945 rc 0/0 00000100:00100000:2.0:1746065117.496080:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1452 00002000:00100000:2.0:1746065117.496087:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1896447) req@ffff88009c7afb80 x1830881260830848/t21474839945(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 504/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.496094:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7afb80 with x1830881260830848 ext(1048576->1896447) 00010000:00010000:2.0:1746065117.496100:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 24 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.496111:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 24 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746065117.496117:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7afb80 00000100:00100000:1.0:1746065117.496141:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259642496:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065117.496157:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe11e00/0x14b4f8542d4f1dc8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a455 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.496165:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe11e00/0x14b4f8542d4f1dc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a455 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.496176:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe11e00, rc 0) 00000100:00100000:1.0:1746065117.496193:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260831488:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3131us (3616us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065117.496198:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10235 00000100:00100000:0.0:1746065117.501617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.501692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.501754:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260832128 00000100:00100000:3.0:1746065117.501762:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260832128 00010000:00010000:3.0:1746065117.501790:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 24 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.501832:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5082 00000100:00100000:3.0:1746065117.501840:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260832128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.501851:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.501869:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 24 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.501880:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 24 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.501898:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909ac200/0x14b4f8542d4f1cda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3fa expref: 24 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.501909:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.501911:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.501917:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.501923:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.501948:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065117.501958:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259642752:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065117.502052:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065117.502197:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260832384 00000100:00100000:2.0:1746065117.502200:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260832384 00000100:00100000:2.0:1746065117.502226:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8920 00000100:00100000:2.0:1746065117.502232:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28746:x1830881260832384:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065117.502246:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.502259:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73e00/0x14b4f8542d4f1ddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a478 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.502327:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.502340:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a447 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.502345:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.502362:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a447 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.502370:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a447 expref: 12 pid: 16767 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746065117.502377:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259642880:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065117.502413:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.505588:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259642752:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065117.505606:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.505654:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881260832128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3813us (4042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.505663:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5082 00000100:00100000:3.0:1746065117.506589:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259642880:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.506612:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065117.506860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.506895:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.506947:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260832640 00000100:00100000:3.0:1746065117.506952:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260832640 00000100:00100000:3.0:1746065117.506991:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8921 00000100:00100000:3.0:1746065117.506999:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+27:28750:x1830881260832640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.507023:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.507036:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07200/0x14b4f8542d4f1deb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a47f expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.507122:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507132:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507141:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507150:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507155:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507161:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507249:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1e00 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507257:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1e00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507262:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1e00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:3.0:1746065117.507269:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065117.507338:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507344:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507349:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507353:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.507356:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507361:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507370:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065117.507372:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.507375:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507393:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06200/0x14b4f8542d4f1df2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507401:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507404:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507408:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507411:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.507412:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507416:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507420:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669200) 00010000:00010000:3.0:1746065117.507422:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.507423:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507427:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06400/0x14b4f8542d4f1df9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.507454:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07200/0x14b4f8542d4f1deb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a47f expref: 30 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.507462:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1e00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a47f expref: 29 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.507471:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.507473:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065117.507475:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06000, rc 0) 00000100:00100000:3.0:1746065117.507512:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+29:28750:x1830881260832640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 514us (656us total) trans 8589942953 rc 0/0 00000100:00100000:3.0:1746065117.507517:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8921 00000100:00100000:3.0:1746065117.507533:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260832768 00000100:00100000:3.0:1746065117.507536:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260832768 00010000:00010000:3.0:1746065117.507546:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a447 expref: 13 pid: 16767 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.507560:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5083 00000100:00100000:3.0:1746065117.507564:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260832768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.507572:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.507575:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a447 expref: 13 pid: 16767 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.507583:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a447 expref: 13 pid: 16767 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.507593:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1dac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a447 expref: 13 pid: 16767 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.507601:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.507604:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.507613:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.507617:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.507630:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.507646:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260832768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.507651:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5083 00010000:00010000:3.0:1746065117.507665:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.507670:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065117.507679:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065117.507726:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73e00/0x14b4f8542d4f1ddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a478 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.507735:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a478 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.507740:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.507741:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065117.507743:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb73000, rc 0) 00000100:00100000:3.0:1746065117.507758:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28746:x1830881260832384:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5526us (6066us total) trans 8589942954 rc 0/0 00000100:00100000:3.0:1746065117.507762:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8920 00000100:00100000:0.0:1746065117.510488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.511563:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260833152 00000100:00100000:2.0:1746065117.511571:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260833152 00002000:00100000:2.0:1746065117.511609:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800913fa680 x1830881260833152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.511618:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fa680 with x1830881260833152 ext(1048576->2097151) 00002000:00010000:2.0:1746065117.511623:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913fa680 00000100:00100000:2.0:1746065117.511641:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4661 00000100:00100000:2.0:1746065117.511647:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260833152:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065117.512653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.513355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.515570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.515612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.515669:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260833536 00000100:00100000:1.0:1746065117.515677:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260833536 00000100:00100000:1.0:1746065117.515699:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260833792 00000100:00100000:1.0:1746065117.515701:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260833792 00000100:00100000:1.0:1746065117.515730:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3618 00000100:00100000:1.0:1746065117.515737:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:28750:x1830881260833792:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065117.515922:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+31:28750:x1830881260833792:12345-192.168.202.46@tcp:35:cat.0 Request processed in 184us (357us total) trans 8589942955 rc 0/0 00000100:00100000:1.0:1746065117.515928:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3618 00000100:00100000:0.0:1746065117.516202:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260833280 00000100:00100000:0.0:1746065117.516206:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260833280 00002000:00100000:0.0:1746065117.516228:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1593343) req@ffff8800913f8a80 x1830881260833280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.516237:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f8a80 with x1830881260833280 ext(1048576->1593343) 00002000:00010000:0.0:1746065117.516240:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f8a80 00000100:00100000:0.0:1746065117.516261:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4662 00000100:00100000:0.0:1746065117.516266:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260833280:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065117.518525:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260833408 00000100:00100000:3.0:1746065117.518534:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260833408 00000100:00100000:3.0:1746065117.518571:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8922 00000100:00100000:3.0:1746065117.518577:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28746:x1830881260833408:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065117.518595:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.518610:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1e15 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a486 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.518668:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.518694:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a478 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.518700:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.518725:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a478 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.518735:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a478 expref: 13 pid: 16767 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.518745:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259643008:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.518797:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.519448:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 606 00000100:00100000:1.0:1746065117.519457:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881260833536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065117.519465:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065117.519479:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1e00 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a47f expref: 30 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.519491:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065117.519494:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065117.519499:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065117.519503:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065117.519507:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065117.519524:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881260833536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (6170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.519528:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 606 00000100:00100000:0.0:1746065117.526236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.526262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.526290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.526312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.526374:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260833920 00000100:00100000:2.0:1746065117.526391:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260833920 00000100:00100000:2.0:1746065117.526421:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260834176 00000100:00100000:2.0:1746065117.526423:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260834176 00000100:00100000:2.0:1746065117.526431:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260834048 00000100:00100000:2.0:1746065117.526432:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260834048 00000100:00100000:2.0:1746065117.526441:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260834304 00000100:00100000:2.0:1746065117.526442:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260834304 00000100:00100000:2.0:1746065117.526452:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10238 00000100:00100000:2.0:1746065117.526458:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260833920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065117.526474:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.526486:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a48d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.526504:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.526506:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.526513:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a48d expref: 22 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.526524:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a48d expref: 22 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.526538:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb73600, rc 0) 00000100:00100000:2.0:1746065117.526569:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260833920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 111us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.526574:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10238 00000100:00100000:2.0:1746065117.526585:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10239 00000100:00100000:2.0:1746065117.526589:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260834176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065117.526594:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.526598:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb72400/0x14b4f8542d4f1e2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a49b expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065117.526631:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259643136:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065117.526671:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065117.526685:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10240 00000100:00100000:2.0:1746065117.526690:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260834048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065117.526695:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.526702:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a494 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.526711:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.526712:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.526717:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a494 expref: 24 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.526725:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a494 expref: 24 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.526731:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb72a00, rc 0) 00000100:00100000:2.0:1746065117.526744:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881260834048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 54us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.526748:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10240 00000100:00100000:2.0:1746065117.526757:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10241 00000100:00100000:2.0:1746065117.526761:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260834304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065117.526766:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.526771:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb73e00/0x14b4f8542d4f1e38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4a2 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065117.526790:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259643264:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065117.526808:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065117.527018:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260833152:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 15371us (16536us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065117.527025:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4661 00002000:00100000:2.0:1746065117.527032:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800913fa680 x1830881260833152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.527040:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fa680 with x1830881260833152 ext(1048576->2097151) 00002000:00010000:2.0:1746065117.527043:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913fa680 00000100:00100000:3.0:1746065117.529868:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259643008:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.529889:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065117.529938:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259643136:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065117.529963:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb72400/0x14b4f8542d4f1e2a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a49b expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.529973:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb72400/0x14b4f8542d4f1e2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a49b expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.529998:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb72400, rc 0) 00000100:00100000:3.0:1746065117.530031:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260834176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3440us (3767us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065117.530038:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10239 00000100:00100000:3.0:1746065117.530075:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259643264:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065117.530089:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb73e00/0x14b4f8542d4f1e38 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a2 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.530096:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb73e00/0x14b4f8542d4f1e38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a2 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.530103:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb73e00, rc 0) 00000100:00100000:3.0:1746065117.530118:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881260834304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3356us (3805us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065117.530122:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10241 00000100:00100000:2.0:1746065117.532626:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260833280:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 16350us (19965us total) trans 0 rc 544768/544768 00000100:00100000:2.0:1746065117.532636:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4662 00002000:00100000:2.0:1746065117.532646:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1593343) req@ffff8800913f8a80 x1830881260833280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 544768/544768 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.532655:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f8a80 with x1830881260833280 ext(1048576->1593343) 00002000:00010000:2.0:1746065117.532659:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f8a80 00000100:00100000:2.0:1746065117.533964:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.534201:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260834432 00000100:00100000:3.0:1746065117.534209:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260834432 00010000:00010000:3.0:1746065117.534236:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a478 expref: 14 pid: 16767 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.534264:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5084 00000100:00100000:3.0:1746065117.534270:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1958:x1830881260834432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.534281:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.534286:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a478 expref: 14 pid: 16767 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.534296:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a478 expref: 14 pid: 16767 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.534313:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73000/0x14b4f8542d4f1de4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a478 expref: 14 pid: 16767 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.534327:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.534331:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.534339:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.534344:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065117.534360:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.534399:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1958:x1830881260834432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 129us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.534405:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5084 00010000:00010000:2.0:1746065117.534455:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.534460:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065117.534495:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:2.0:1746065117.534498:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065117.534511:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.534534:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1e15 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a486 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.534548:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a486 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.534553:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.534556:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065117.534558:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06c00, rc 0) 00000100:00100000:2.0:1746065117.534580:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28746:x1830881260833408:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 16004us (18968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.534586:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8922 00000100:00100000:0.0:1746065117.546068:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.546115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.546195:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260834688 00000100:00100000:3.0:1746065117.546202:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260834688 00002000:00100000:3.0:1746065117.546238:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f9b8700 x1830881260834688/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.546247:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8700 with x1830881260834688 ext(0->1048575) 00002000:00010000:3.0:1746065117.546251:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b8700 00000100:00100000:3.0:1746065117.546276:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260834944 00000100:00100000:3.0:1746065117.546279:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260834944 00002000:00100000:3.0:1746065117.546289:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f9b8a80 x1830881260834944/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.546296:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8a80 with x1830881260834944 ext(1048576->2097151) 00002000:00010000:3.0:1746065117.546299:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9b8a80 00000100:00100000:3.0:1746065117.546309:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4663 00000100:00100000:3.0:1746065117.546316:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260834688:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065117.547419:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4664 00000100:00100000:1.0:1746065117.547428:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260834944:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065117.551296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.551315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.551355:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.553203:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260835712 00000100:00100000:2.0:1746065117.553214:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260835712 00000100:00100000:2.0:1746065117.553259:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10242 00000100:00100000:2.0:1746065117.553266:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881260835712:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065117.553280:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.553294:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1e3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4b0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065117.553340:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259643392:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065117.553431:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.553626:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260835200 00000100:00100000:1.0:1746065117.553631:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260835200 00002000:00100000:1.0:1746065117.553654:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2363392->3411967) req@ffff88009f9b8e00 x1830881260835200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.553663:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8e00 with x1830881260835200 ext(2363392->3411967) 00002000:00010000:1.0:1746065117.553667:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b8e00 00000100:00100000:1.0:1746065117.553796:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260835456 00000100:00100000:1.0:1746065117.553799:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260835456 00002000:00100000:1.0:1746065117.553813:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3411968->4194303) req@ffff88009f9b9180 x1830881260835456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.553836:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9180 with x1830881260835456 ext(3411968->4194303) 00002000:00010000:1.0:1746065117.553839:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b9180 00000100:00100000:3.0:1746065117.553874:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4665 00000100:00100000:3.0:1746065117.553882:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881260835200:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065117.554932:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4666 00000100:00100000:1.0:1746065117.554941:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881260835456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065117.559163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.559209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.559295:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260835584 00000100:00100000:3.0:1746065117.559296:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260835840 00000100:00100000:3.0:1746065117.559303:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260835840 00000100:00100000:1.0:1746065117.559303:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260835584 00000100:00100000:1.0:1746065117.559489:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10243 00000100:00100000:3.0:1746065117.559496:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10244 00000100:00100000:1.0:1746065117.559498:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260835584:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:3.0:1746065117.559502:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260835840:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065117.559512:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065117.559512:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.559526:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1e46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4b7 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.559526:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4a9 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.559543:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.559545:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.559552:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a9 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.559565:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a9 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065117.559566:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259643520:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065117.559573:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cdc00, rc 0) 00000100:00100000:1.0:1746065117.559623:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260835584:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 126us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.559630:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10243 00000100:00100000:3.0:1746065117.559645:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.560561:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260834688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14243us (14500us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065117.560568:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4663 00002000:00100000:3.0:1746065117.560576:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f9b8700 x1830881260834688/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.560771:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8700 with x1830881260834688 ext(0->1048575) 00002000:00010000:3.0:1746065117.560775:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b8700 00000100:00100000:3.0:1746065117.562639:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259643392:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065117.562670:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1e3f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4b0 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.562682:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb73800/0x14b4f8542d4f1e3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4b0 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.562694:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb73800, rc 0) 00000100:00100000:3.0:1746065117.562721:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260835712:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 9457us (11366us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065117.562727:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10242 00000100:00100000:1.0:1746065117.563231:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260834944:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15803us (17114us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065117.563239:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4664 00002000:00100000:1.0:1746065117.563246:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f9b8a80 x1830881260834944/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.563254:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8a80 with x1830881260834944 ext(1048576->2097151) 00002000:00010000:1.0:1746065117.563257:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9b8a80 00000100:00100000:3.0:1746065117.565769:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259643520:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065117.565797:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1e46 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4b7 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.565809:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07a00/0x14b4f8542d4f1e46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4b7 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.565858:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07a00, rc 0) 00000100:00100000:3.0:1746065117.565903:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881260835840:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6400us (6693us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065117.565909:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10244 00000100:00100000:1.0:1746065117.569980:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881260835456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15031us (18654us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746065117.569990:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4666 00002000:00100000:1.0:1746065117.570000:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3411968->4194303) req@ffff88009f9b9180 x1830881260835456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.570009:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9180 with x1830881260835456 ext(3411968->4194303) 00002000:00010000:1.0:1746065117.570015:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b9180 00000100:00100000:0.0:1746065117.571251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.571280:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881260835200:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17398us (19989us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065117.571287:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4665 00002000:00100000:3.0:1746065117.571294:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2363392->3411967) req@ffff88009f9b8e00 x1830881260835200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.571302:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8e00 with x1830881260835200 ext(2363392->3411967) 00002000:00010000:3.0:1746065117.571306:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b8e00 00000100:00100000:0.0:1746065117.571400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.571557:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260836096 00000100:00100000:3.0:1746065117.571564:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260836096 00000100:00100000:2.0:1746065117.571588:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260836352 00000100:00100000:2.0:1746065117.571592:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260836352 00000100:00100000:3.0:1746065117.571608:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8923 00000100:00100000:3.0:1746065117.571614:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28746:x1830881260836096:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:2.0:1746065117.571619:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8924 00000100:00100000:2.0:1746065117.571623:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+29:28752:x1830881260836352:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065117.571628:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.571630:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.571645:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1e5b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4be expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.571645:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1e54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4c5 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.571729:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571741:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571750:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571759:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571764:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571772:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571870:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571878:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571884:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065117.571891:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065117.571955:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571961:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571967:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571971:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb72e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065117.571974:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571979:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.571988:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065117.571990:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065117.571993:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.572001:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1e62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.572013:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.572017:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.572021:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.572024:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb72c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065117.572026:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.572030:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.572035:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205400) 00010000:00010000:2.0:1746065117.572036:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065117.572038:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.572042:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb72c00/0x14b4f8542d4f1e69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065117.572071:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73a00/0x14b4f8542d4f1e54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4c5 expref: 32 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.572079:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4c5 expref: 31 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.572089:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.572090:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065117.572092:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb73400, rc 0) 00000100:00100000:2.0:1746065117.572112:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+31:28752:x1830881260836352:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 489us (712us total) trans 8589942956 rc 0/0 00000100:00100000:2.0:1746065117.572117:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8924 00010000:00010000:3.0:1746065117.572848:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572857:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572863:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572871:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572876:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572880:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572884:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb07c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.572886:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572890:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572896:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.572898:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065117.572901:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572905:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07c00/0x14b4f8542d4f1e7e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.572925:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1e5b lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4be expref: 13 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.572931:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1e5b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4be expref: 13 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.572938:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06a00, rc 0) 00000100:00100000:3.0:1746065117.572960:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28746:x1830881260836096:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1346us (1713us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065117.572965:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8923 00000100:00100000:0.0:1746065117.574077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.574139:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260836608 00000100:00100000:1.0:1746065117.574145:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260836608 00000100:00100000:1.0:1746065117.575154:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3619 00000100:00100000:1.0:1746065117.575164:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28746:x1830881260836608:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1746065117.575329:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28746:x1830881260836608:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 167us (1253us total) trans 8589942957 rc 0/0 00000100:00100000:1.0:1746065117.575335:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3619 00000100:00100000:0.0:1746065117.578677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.578850:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260836736 00000100:00100000:3.0:1746065117.578858:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260836736 00000100:00100000:3.0:1746065117.578897:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10245 00000100:00100000:3.0:1746065117.578905:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:28750:x1830881260836736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.578920:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.578935:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4cc expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.578959:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.578965:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065117.578967:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065117.578969:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.578993:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.579002:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 32 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.579012:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259643648:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.579093:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065117.579371:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.579648:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260836992 00000100:00100000:3.0:1746065117.579652:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260836992 00002000:00100000:3.0:1746065117.579675:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88012b4b1500 x1830881260836992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.579687:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b1500 with x1830881260836992 ext(4194304->4976639) 00002000:00010000:3.0:1746065117.579691:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4b1500 00000100:00100000:3.0:1746065117.579714:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4667 00000100:00100000:3.0:1746065117.579720:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881260836992:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065117.582056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.582320:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259643648:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.582342:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.582355:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06e00, rc 0) 00000100:00100000:1.0:1746065117.582455:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260837120 00000100:00100000:1.0:1746065117.582461:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260837120 00002000:00100000:1.0:1746065117.582485:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1593344->2097151) req@ffff88012b4b0380 x1830881260837120/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.582493:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0380 with x1830881260837120 ext(1593344->2097151) 00010000:00010000:1.0:1746065117.582499:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 35 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.582509:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 35 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:1.0:1746065117.582514:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b0380 00000100:00100000:1.0:1746065117.582528:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1453 00000100:00100000:1.0:1746065117.582533:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881260837120:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065117.582569:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:28750:x1830881260836736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3664us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.582575:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10245 00000100:00100000:1.0:1746065117.587343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.587507:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260837248 00000100:00100000:3.0:1746065117.587515:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260837248 00000100:00100000:3.0:1746065117.587561:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10246 00000100:00100000:3.0:1746065117.587569:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:28752:x1830881260837248:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065117.587583:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.587597:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4d3 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.587622:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a30c expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.587629:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a471 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.587636:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a31a expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.587643:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.587645:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.587648:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2699264->3031039] (req 2699264->3031039) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.587673:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a31a expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.587682:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a31a expref: 30 pid: 8428 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.587693:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259643776:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.587780:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a471 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.587787:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a471 expref: 8 pid: 8427 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746065117.587794:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259643904:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.587837:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a30c expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.587849:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a30c expref: 25 pid: 8428 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.587857:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259644032:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.587885:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.588617:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881260836992:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8894us (9243us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746065117.588625:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4667 00002000:00100000:3.0:1746065117.588633:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88012b4b1500 x1830881260836992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.588641:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b1500 with x1830881260836992 ext(4194304->4976639) 00002000:00010000:3.0:1746065117.588645:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4b1500 00000100:00100000:3.0:1746065117.589659:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259643776:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065117.589667:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259643904:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065117.590480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.590527:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260837376 00000100:00100000:2.0:1746065117.590534:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260837376 00010000:00010000:2.0:1746065117.590560:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a471 expref: 9 pid: 8427 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746065117.590594:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5085 00000100:00100000:2.0:1746065117.590601:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260837376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.590611:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.590628:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a471 expref: 9 pid: 8427 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746065117.590639:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a471 expref: 9 pid: 8427 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746065117.590656:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb73200/0x14b4f8542d4f1dd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a471 expref: 9 pid: 8427 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746065117.590688:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.590716:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260837376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 115us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.590722:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5085 00000100:00100000:1.0:1746065117.590891:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881260837120:12345-192.168.202.46@tcp:4:cat.0 Request processed in 8355us (8839us total) trans 17179872704 rc 0/0 00000100:00100000:1.0:1746065117.590899:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1453 00002000:00100000:1.0:1746065117.590906:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1593344->2097151) req@ffff88012b4b0380 x1830881260837120/t17179872704(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.590919:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0380 with x1830881260837120 ext(1593344->2097151) 00010000:00010000:1.0:1746065117.591050:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 35 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.591059:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 35 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:1.0:1746065117.591065:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b0380 00000100:00100000:0.0:1746065117.596206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.596237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.596269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.596308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.596309:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260837504 00000100:00100000:3.0:1746065117.596317:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260837504 00000100:00100000:2.0:1746065117.596502:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260837632 00000100:00100000:2.0:1746065117.596507:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260837632 00000100:00100000:3.0:1746065117.596508:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10247 00000100:00100000:3.0:1746065117.596516:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881260837504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.596532:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065117.596532:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10248 00000100:00100000:2.0:1746065117.596537:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260837632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065117.596544:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.596548:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fde6800/0x14b4f8542d4f1e93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4da expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.596554:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb72000/0x14b4f8542d4f1e9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4e1 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.596567:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.596575:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb72000/0x14b4f8542d4f1e9a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e1 expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.596584:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb72000/0x14b4f8542d4f1e9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e1 expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065117.596589:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259644160:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065117.596603:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb72000, rc 0) 00000100:00100000:2.0:1746065117.596632:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260837632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 95us (394us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065117.596638:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10248 00000100:00100000:3.0:1746065117.596641:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.596655:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260837760 00000100:00100000:3.0:1746065117.596658:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260837760 00000100:00100000:2.0:1746065117.596661:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260837888 00000100:00100000:2.0:1746065117.596664:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260837888 00010000:00010000:3.0:1746065117.596670:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a31a expref: 31 pid: 8428 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.596674:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746065117.596994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.597564:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260838016 00000100:00100000:3.0:1746065117.597568:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260838016 00000100:00100000:2.0:1746065117.597572:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5086 00000100:00100000:2.0:1746065117.597580:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881260837760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.597581:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a30c expref: 26 pid: 8428 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.597589:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065117.597599:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5087 00000100:00100000:1.0:1746065117.597603:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5088 00000100:00100000:3.0:1746065117.597604:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881260837888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.597606:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a31a expref: 31 pid: 8428 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746065117.597609:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260838016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.597610:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.597615:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a31a expref: 31 pid: 8428 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.597617:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.597623:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.597629:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe11400/0x14b4f8542d4f1b44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a31a expref: 31 pid: 8428 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.597630:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a30c expref: 26 pid: 8428 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.597631:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746065117.597638:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a30c expref: 26 pid: 8428 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.597642:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.597643:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.597644:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065117.597647:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.597648:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.597649:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.597652:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.597656:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.597658:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.597675:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.597675:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065117.597678:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881260837760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 99us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.597683:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259644416:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065117.597683:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5086 00000100:00100000:1.0:1746065117.597683:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259644288:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065117.597718:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e540 going to sleep for 11 seconds 00010000:00010000:3.0:1746065117.597724:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe10a00/0x14b4f8542d4f1b36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a30c expref: 26 pid: 8428 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.597738:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259644032:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.597756:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.597763:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06600, rc 0) 00000100:00100000:3.0:1746065117.597776:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:28752:x1830881260837248:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10209us (10441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.597781:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10246 00000100:00100000:3.0:1746065117.597795:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9240 going to sleep for 11 seconds 00010000:00010000:3.0:1746065117.599211:0:8429:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff880130268380 x1830881259644160) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746065117.599231:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07800/0x14b4f8542d4f1d82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a432 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746065117.599240:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259644160:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065117.599257:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fde6800/0x14b4f8542d4f1e93 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4da expref: 36 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.599266:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fde6800/0x14b4f8542d4f1e93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4da expref: 36 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.599272:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fde6800, rc 0) 00000100:00100000:3.0:1746065117.599296:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881260837504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2781us (3096us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065117.599301:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10247 00000100:00100000:3.0:1746065117.599567:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259644416:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065117.599575:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.599596:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881260837888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1992us (3288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.599602:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5087 00000100:00100000:0.0:1746065117.599647:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.599688:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259644288:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065117.599696:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065117.599725:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260838016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2116us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.599730:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5088 00000100:00100000:1.0:1746065117.599749:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260838272 00000100:00100000:1.0:1746065117.599753:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260838272 00002000:00100000:1.0:1746065117.599775:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2699264->2703359) req@ffff88009f9bb800 x1830881260838272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.599783:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb800 with x1830881260838272 ext(2699264->2703359) 00002000:00010000:1.0:1746065117.599786:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9bb800 00000100:00100000:1.0:1746065117.599809:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4668 00000100:00100000:1.0:1746065117.599846:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260838272:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065117.599967:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260838272:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 151us (319us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065117.599972:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4668 00002000:00100000:1.0:1746065117.599977:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2699264->2703359) req@ffff88009f9bb800 x1830881260838272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.599983:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb800 with x1830881260838272 ext(2699264->2703359) 00002000:00010000:1.0:1746065117.599986:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9bb800 00000100:00100000:0.0:1746065117.601957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.602365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.602411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.602431:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260838528 00000100:00100000:2.0:1746065117.602438:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260838528 00002000:00100000:2.0:1746065117.602472:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f9ba680 x1830881260838528/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.602480:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ba680 with x1830881260838528 ext(1048576->2097151) 00002000:00010000:2.0:1746065117.602484:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9ba680 00000100:00100000:2.0:1746065117.602512:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4669 00000100:00100000:2.0:1746065117.602520:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260838528:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065117.603105:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260838656 00000100:00100000:0.0:1746065117.603109:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260838656 00000100:00100000:0.0:1746065117.603131:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260838784 00000100:00100000:0.0:1746065117.603132:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260838784 00000100:00100000:0.0:1746065117.603215:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10249 00000100:00100000:0.0:1746065117.603221:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881260838656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065117.603230:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.603242:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4e8 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.603256:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.603258:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.603264:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e8 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.603275:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e8 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.603283:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7de00, rc 0) 00000100:00100000:0.0:1746065117.603311:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881260838656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 90us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.603316:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10249 00000100:00100000:0.0:1746065117.603330:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10250 00000100:00100000:0.0:1746065117.603334:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260838784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065117.603339:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.603346:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd7cc00/0x14b4f8542d4f1ea8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4ef expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065117.603371:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259644544:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065117.603418:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.613543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.613897:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260838528:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11377us (11530us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065117.613907:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4669 00002000:00100000:3.0:1746065117.613917:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f9ba680 x1830881260838528/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.613926:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ba680 with x1830881260838528 ext(1048576->2097151) 00002000:00010000:3.0:1746065117.613931:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9ba680 00000100:00100000:3.0:1746065117.613950:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260839040 00000100:00100000:3.0:1746065117.613956:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260839040 00002000:00100000:3.0:1746065117.613980:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3026944->3031039) req@ffff880135cdf800 x1830881260839040/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.613988:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf800 with x1830881260839040 ext(3026944->3031039) 00002000:00010000:3.0:1746065117.613991:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdf800 00000100:00100000:3.0:1746065117.614003:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4670 00000100:00100000:3.0:1746065117.614010:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881260839040:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065117.614129:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881260839040:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 119us (593us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065117.614135:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4670 00002000:00100000:3.0:1746065117.614140:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3026944->3031039) req@ffff880135cdf800 x1830881260839040/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.614146:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf800 with x1830881260839040 ext(3026944->3031039) 00002000:00010000:3.0:1746065117.614149:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdf800 00002000:00010000:2.0:1746065117.614567:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065117 -> 1746065118 00002000:00010000:2.0:1746065117.614571:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065117 -> 1746065118 00002000:00010000:2.0:1746065117.614573:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065117 -> 1746065118 00000100:00100000:2.0:1746065117.614583:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259644544:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065117.614606:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7cc00/0x14b4f8542d4f1ea8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4ef expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.614616:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7cc00/0x14b4f8542d4f1ea8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4ef expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.614625:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7cc00, rc 0) 00000100:00100000:2.0:1746065117.614644:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260838784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11310us (12233us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065117.614737:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10250 00000100:00100000:0.0:1746065117.616862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.617018:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260839296 00000100:00100000:2.0:1746065117.617026:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260839296 00000100:00100000:2.0:1746065117.617750:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3620 00000100:00100000:2.0:1746065117.617760:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+31:28752:x1830881260839296:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065117.619084:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+32:28752:x1830881260839296:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1323us (2224us total) trans 8589942958 rc 0/0 00000100:00100000:2.0:1746065117.619092:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3620 00000100:00100000:3.0:1746065117.624633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.624720:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260839552 00000100:00100000:0.0:1746065117.624728:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260839552 00000100:00100000:3.0:1746065117.625113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.625160:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260839680 00000100:00100000:2.0:1746065117.625163:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260839680 00000100:00100000:0.0:1746065117.625248:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3621 00000100:00100000:0.0:1746065117.625256:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:28742:x1830881260839552:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065117.625346:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10251 00000100:00100000:2.0:1746065117.625353:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:28750:x1830881260839680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065117.625362:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.625375:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4f6 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.625406:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.625414:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065117.625415:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065117.625418:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.625441:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.625451:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 34 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746065117.625460:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259644672:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065117.625520:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.625776:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:28742:x1830881260839552:12345-192.168.202.46@tcp:35:cat.0 Request processed in 519us (1147us total) trans 8589942959 rc 0/0 00000100:00100000:0.0:1746065117.625782:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3621 00000100:00100000:2.0:1746065117.628435:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259644672:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065117.628464:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.628478:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb72e00, rc 0) 00000100:00100000:2.0:1746065117.628523:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:28750:x1830881260839680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3170us (3409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.628531:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10251 00000100:00100000:0.0:1746065117.632131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.633612:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260839808 00000100:00100000:2.0:1746065117.633622:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260839808 00002000:00100000:2.0:1746065117.633664:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2363391) req@ffff88009f9b8380 x1830881260839808/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.633674:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8380 with x1830881260839808 ext(2097152->2363391) 00010000:00010000:2.0:1746065117.633682:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 35 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.633695:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 35 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746065117.633702:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9b8380 00000100:00100000:2.0:1746065117.633736:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1454 00000100:00100000:2.0:1746065117.633744:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881260839808:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065117.638468:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881260839808:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4718us (6338us total) trans 17179872705 rc 0/0 00000100:00100000:2.0:1746065117.638478:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1454 00002000:00100000:2.0:1746065117.638489:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2363391) req@ffff88009f9b8380 x1830881260839808/t17179872705(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.638497:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8380 with x1830881260839808 ext(2097152->2363391) 00010000:00010000:2.0:1746065117.638505:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.638523:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746065117.638529:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9b8380 00000100:00100000:0.0:1746065117.652118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.652375:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260839936 00000100:00100000:2.0:1746065117.652392:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260839936 00010000:00010000:2.0:1746065117.652422:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746065117.652615:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5089 00000100:00100000:2.0:1746065117.652623:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881260839936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.652636:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.652655:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.652666:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.652683:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07400/0x14b4f8542d4f1d89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2363391) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a439 expref: 37 pid: 25185 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746065117.652786:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.652788:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.652794:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.652806:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.652848:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065117.652858:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259644800:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065117.655259:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.656481:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259644800:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065117.656499:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065117.656543:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881260839936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3920us (4430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.656552:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5089 00000100:00100000:0.0:1746065117.669547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.669634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.669860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.670143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.670165:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260840192 00000100:00100000:2.0:1746065117.670173:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260840192 00002000:00100000:2.0:1746065117.670215:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009a4e8e00 x1830881260840192/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.670225:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8e00 with x1830881260840192 ext(2097152->3145727) 00002000:00010000:2.0:1746065117.670230:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e8e00 00000100:00100000:1.0:1746065117.670385:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260840320 00000100:00100000:1.0:1746065117.670389:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260840320 00002000:00100000:1.0:1746065117.670404:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009a4e9180 x1830881260840320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.670410:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9180 with x1830881260840320 ext(3145728->4194303) 00002000:00010000:1.0:1746065117.670413:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e9180 00000100:00100000:2.0:1746065117.670441:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260840704 00000100:00100000:2.0:1746065117.670444:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260840704 00002000:00100000:2.0:1746065117.670456:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3477503) req@ffff8800a5882a00 x1830881260840704/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 504/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.670462:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882a00 with x1830881260840704 ext(2097152->3477503) 00002000:00010000:2.0:1746065117.670465:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5882a00 00000100:00100000:3.0:1746065117.670674:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260840832 00000100:00100000:3.0:1746065117.670678:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260840832 00000100:00100000:3.0:1746065117.670688:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4671 00000100:00100000:3.0:1746065117.670694:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260840192:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065117.670982:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4672 00000100:00100000:1.0:1746065117.670988:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881260840320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065117.670995:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4673 00000100:00100000:2.0:1746065117.671001:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881260840704:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065117.671956:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3477504->4194303) req@ffff8800a5880000 x1830881260840832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.671964:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880000 with x1830881260840832 ext(3477504->4194303) 00002000:00010000:3.0:1746065117.671968:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880000 00000100:00100000:3.0:1746065117.671983:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4674 00000100:00100000:3.0:1746065117.671988:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881260840832:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065117.685299:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260840832:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13301us (15147us total) trans 0 rc 716800/716800 00000100:00100000:3.0:1746065117.685370:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4674 00002000:00100000:3.0:1746065117.685390:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3477504->4194303) req@ffff8800a5880000 x1830881260840832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 716800/716800 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.685398:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880000 with x1830881260840832 ext(3477504->4194303) 00002000:00010000:3.0:1746065117.685404:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880000 00000100:00100000:2.0:1746065117.685576:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881260840704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14574us (15714us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065117.685586:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4673 00002000:00100000:2.0:1746065117.685593:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3477503) req@ffff8800a5882a00 x1830881260840704/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 504/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.685600:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882a00 with x1830881260840704 ext(2097152->3477503) 00002000:00010000:2.0:1746065117.685602:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5882a00 00000100:00100000:1.0:1746065117.694323:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881260840320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22538us (23892us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065117.694336:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4672 00002000:00100000:1.0:1746065117.694347:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009a4e9180 x1830881260840320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.694355:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9180 with x1830881260840320 ext(3145728->4194303) 00002000:00010000:1.0:1746065117.694360:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e9180 00000100:00100000:0.0:1746065117.696484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.697186:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260841088 00000100:00100000:3.0:1746065117.697194:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260841088 00000100:00100000:3.0:1746065117.697228:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8925 00000100:00100000:3.0:1746065117.697234:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28757:x1830881260841088:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065117.697253:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.697267:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07200/0x14b4f8542d4f1eb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a4fd expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.697313:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697324:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697333:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697344:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697349:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697357:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697456:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1ecb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697464:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1ecb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697470:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1ecb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:3.0:1746065117.697494:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:3.0:1746065117.697498:0:20754:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065117.697510:0:20754:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1ecb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697518:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1ecb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697524:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697529:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697533:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697537:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.697540:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697545:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697553:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065117.697556:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.697559:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697562:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06000/0x14b4f8542d4f1ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697588:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697593:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697597:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697601:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb06a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065117.697602:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697606:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697612:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669a00) 00010000:00010000:3.0:1746065117.697613:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065117.697615:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697619:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06a00/0x14b4f8542d4f1ec4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065117.697640:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07200/0x14b4f8542d4f1eb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4fd expref: 15 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.697650:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1ecb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4fd expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.697655:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.697657:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065117.697659:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07400, rc 0) 00000100:00100000:3.0:1746065117.697693:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28757:x1830881260841088:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 458us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.697698:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8925 00000100:00100000:3.0:1746065117.702141:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260840192:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31440us (32595us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065117.702152:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4671 00002000:00100000:3.0:1746065117.702162:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009a4e8e00 x1830881260840192/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.702171:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8e00 with x1830881260840192 ext(2097152->3145727) 00002000:00010000:3.0:1746065117.702176:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e8e00 00000100:00100000:0.0:1746065117.703900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.704904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.705012:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260841216 00000100:00100000:0.0:1746065117.705015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.705020:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260841216 00000100:00100000:2.0:1746065117.705054:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260841344 00000100:00100000:2.0:1746065117.705056:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260841344 00000100:00100000:2.0:1746065117.705065:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260841472 00000100:00100000:2.0:1746065117.705067:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260841472 00000100:00100000:2.0:1746065117.705078:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10252 00000100:00100000:2.0:1746065117.705085:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260841216:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:0.0:1746065117.705095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065117.705100:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.705113:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a504 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.705131:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.705134:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.705141:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a504 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.705153:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a504 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.705162:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f75a800, rc 0) 00000100:00100000:3.0:1746065117.705167:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10253 00000100:00100000:3.0:1746065117.705173:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260841344:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065117.705179:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.705186:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a50b expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.705195:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.705196:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.705201:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a50b expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.705210:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a50b expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065117.705210:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260841216:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 126us (1315us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065117.705216:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb06200, rc 0) 00000100:00100000:2.0:1746065117.705216:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10252 00000100:00100000:2.0:1746065117.705228:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10254 00000100:00100000:3.0:1746065117.705230:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260841344:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 59us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.705233:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260841472:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:3.0:1746065117.705235:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10253 00010000:00010000:2.0:1746065117.705239:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.705247:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f75a200/0x14b4f8542d4f1ee0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a512 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065117.705265:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260841600 00000100:00100000:3.0:1746065117.705268:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260841600 00000100:00100000:2.0:1746065117.705278:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259644928:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065117.705287:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 607 00000100:00100000:3.0:1746065117.705290:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260841600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.705297:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.705311:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07400/0x14b4f8542d4f1ecb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4fd expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.705324:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065117.705328:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.705328:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.705339:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881260841600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 48us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.705344:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 607 00000100:00100000:0.0:1746065117.711538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.711638:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260841856 00000100:00100000:3.0:1746065117.711645:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260841856 00002000:00100000:3.0:1746065117.711684:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880094d94700 x1830881260841856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.711698:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94700 with x1830881260841856 ext(4194304->4976639) 00002000:00010000:3.0:1746065117.711702:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d94700 00000100:00100000:2.0:1746065117.712577:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259644928:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065117.712605:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f75a200/0x14b4f8542d4f1ee0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a512 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.712615:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f75a200/0x14b4f8542d4f1ee0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a512 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.712627:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f75a200, rc 0) 00000100:00100000:2.0:1746065117.712661:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260841472:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 7427us (7645us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065117.712668:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10254 00000100:00100000:3.0:1746065117.713310:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4675 00000100:00100000:3.0:1746065117.713320:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260841856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065117.717270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.717618:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260842112 00000100:00100000:2.0:1746065117.717626:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260842112 00000100:00100000:2.0:1746065117.717677:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8926 00000100:00100000:2.0:1746065117.717685:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28757:x1830881260842112:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065117.717704:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.717718:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75aa00/0x14b4f8542d4f1ee7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a519 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.717791:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.717803:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a486 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.717810:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4c5 expref: 31 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.717832:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.717857:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4c5 expref: 31 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.717868:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4c5 expref: 31 pid: 16767 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065117.717878:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259645056:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065117.717948:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a486 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.717955:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a486 expref: 14 pid: 16767 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065117.717966:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d136680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259645184:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065117.717992:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.722010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.722227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.722289:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260842240 00000100:00100000:3.0:1746065117.722296:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260842240 00010000:00010000:3.0:1746065117.722323:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4c5 expref: 32 pid: 16767 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065117.722613:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260842368 00000100:00100000:3.0:1746065117.722617:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260842368 00010000:00010000:3.0:1746065117.722629:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a486 expref: 15 pid: 16767 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065117.722755:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5090 00000100:00100000:2.0:1746065117.722767:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+32:1958:x1830881260842240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.722778:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.722784:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4c5 expref: 32 pid: 16767 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.722793:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4c5 expref: 32 pid: 16767 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.722811:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.722841:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.722848:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.722853:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.722887:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+32:1958:x1830881260842240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 124us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.722893:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5090 00000100:00100000:2.0:1746065117.722907:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5091 00000100:00100000:2.0:1746065117.722913:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1958:x1830881260842368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.722918:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.722922:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a486 expref: 15 pid: 16767 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.722929:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a486 expref: 15 pid: 16767 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.722938:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.722941:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.722946:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.722952:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.722965:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.722976:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1958:x1830881260842368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.722981:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5091 00010000:00010000:2.0:1746065117.723012:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb73400/0x14b4f8542d4f1e70 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4c5 expref: 31 pid: 16767 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065117.723026:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259645056:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065117.723035:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb06c00/0x14b4f8542d4f1e1c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a486 expref: 14 pid: 16767 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065117.723041:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d136680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259645184:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065117.723055:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.723065:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.723070:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065117.723083:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065117.723191:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75aa00/0x14b4f8542d4f1ee7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a519 expref: 15 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.723201:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a519 expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.723206:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.723209:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065117.723210:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f75ac00, rc 0) 00000100:00100000:2.0:1746065117.725130:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28757:x1830881260842112:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 7439us (7861us total) trans 8589942960 rc 0/0 00000100:00100000:2.0:1746065117.725138:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8926 00000100:00100000:0.0:1746065117.725926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.725986:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260842624 00000100:00100000:2.0:1746065117.725992:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260842624 00000100:00100000:2.0:1746065117.726029:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8927 00000100:00100000:2.0:1746065117.726035:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:28759:x1830881260842624:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065117.726051:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.726065:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b200/0x14b4f8542d4f1efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a520 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.726145:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726155:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726163:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726173:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726178:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726183:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726270:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b000/0x14b4f8542d4f1f11 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726278:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b000/0x14b4f8542d4f1f11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726284:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b000/0x14b4f8542d4f1f11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065117.726291:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065117.726354:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726360:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726365:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726372:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f75b400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065117.726375:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726394:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726402:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065117.726405:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065117.726408:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726412:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726421:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726425:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726429:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726433:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f75ae00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065117.726434:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726439:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726444:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205200) 00010000:00010000:2.0:1746065117.726445:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065117.726447:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726451:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065117.726477:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b200/0x14b4f8542d4f1efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a520 expref: 268 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.726486:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b000/0x14b4f8542d4f1f11 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a520 expref: 267 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.726490:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.726492:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065117.726494:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f75b000, rc 0) 00000100:00100000:2.0:1746065117.726535:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:28759:x1830881260842624:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 500us (611us total) trans 8589942961 rc 0/0 00000100:00100000:2.0:1746065117.726540:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8927 00000100:00100000:3.0:1746065117.726768:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260841856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13447us (15235us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746065117.726777:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4675 00002000:00100000:3.0:1746065117.726786:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880094d94700 x1830881260841856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.726795:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94700 with x1830881260841856 ext(4194304->4976639) 00002000:00010000:3.0:1746065117.726799:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d94700 00000100:00100000:0.0:1746065117.740216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.740439:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260842880 00000100:00100000:2.0:1746065117.740448:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260842880 00000100:00100000:2.0:1746065117.740489:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8928 00000100:00100000:2.0:1746065117.740496:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28757:x1830881260842880:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065117.740517:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065117.740520:0:20754:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065117.740546:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ac00/0x14b4f8542d4f1eee lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a519 expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.740576:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.740580:0:20754:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065117.740591:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f1f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a527 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.740673:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740684:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740692:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740701:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740706:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740711:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740716:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f75b400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065117.740719:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740725:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740731:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065117.740734:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065117.740736:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740740:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f26 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065117.740765:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f1f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a527 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.740772:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75ae00/0x14b4f8542d4f1f1f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a527 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.740778:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f75ae00, rc 0) 00000100:00100000:2.0:1746065117.740835:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28757:x1830881260842880:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 320us (608us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065117.740841:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8928 00000100:00100000:1.0:1746065117.744974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.744992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.745039:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260843008 00000100:00100000:0.0:1746065117.745047:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260843008 00000100:00100000:1.0:1746065117.745048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.745081:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 608 00000100:00100000:0.0:1746065117.745087:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:1958:x1830881260843008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.745097:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.745117:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f75b000/0x14b4f8542d4f1f11 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a520 expref: 267 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.745135:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065117.745138:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.745146:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260843520 00000100:00100000:0.0:1746065117.745168:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:1958:x1830881260843008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.745174:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 608 00000100:00100000:0.0:1746065117.745217:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260843264 00000100:00100000:0.0:1746065117.745219:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260843264 00000100:00100000:0.0:1746065117.745234:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8929 00000100:00100000:0.0:1746065117.745238:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+31:28762:x1830881260843264:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065117.745253:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.745262:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7da00/0x14b4f8542d4f1f2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a52e expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065117.745265:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260843520 00000100:00100000:2.0:1746065117.745288:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3622 00000100:00100000:2.0:1746065117.745294:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28757:x1830881260843520:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065117.745417:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28757:x1830881260843520:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 123us (369us total) trans 8589942962 rc 0/0 00000100:00100000:2.0:1746065117.745423:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3622 00010000:00010000:1.0:1746065117.746545:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.746556:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.746565:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065117.746573:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065117.746637:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7da00/0x14b4f8542d4f1f2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a52e expref: 34 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.746654:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a52e expref: 33 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.746660:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065117.746662:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065117.746664:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cd600, rc 0) 00000100:00100000:1.0:1746065117.747225:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+33:28762:x1830881260843264:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1982us (2231us total) trans 8589942963 rc 0/0 00000100:00100000:1.0:1746065117.747234:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8929 00000100:00100000:0.0:1746065117.760788:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.760908:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260843776 00000100:00100000:1.0:1746065117.760916:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260843776 00000100:00100000:1.0:1746065117.761690:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8930 00000100:00100000:1.0:1746065117.761698:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:28766:x1830881260843776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065117.761716:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065117.761729:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cde00/0x14b4f8542d4f1f42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a535 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.761806:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.761910:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.761920:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.761930:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.761936:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.761940:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.762016:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1f57 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.762023:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1f57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.762028:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1f57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065117.762035:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065117.762088:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.762093:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.762098:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.762103:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00cd400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065117.762105:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.762111:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.762118:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065117.762121:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065117.762124:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.762127:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f1f49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.763451:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.763459:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.763467:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.763470:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00cd000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065117.763473:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.763477:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.763487:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f49fa00) 00010000:00010000:1.0:1746065117.763489:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065117.763490:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.763494:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065117.763539:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cde00/0x14b4f8542d4f1f42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a535 expref: 269 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.763550:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1f57 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a535 expref: 268 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.763554:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065117.763556:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065117.763557:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cd200, rc 0) 00000100:00100000:1.0:1746065117.763620:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:28766:x1830881260843776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1922us (2838us total) trans 8589942964 rc 0/0 00000100:00100000:1.0:1746065117.763626:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8930 00000100:00100000:0.0:1746065117.765366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.765405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.765433:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260843904 00000100:00100000:0.0:1746065117.765440:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260843904 00000100:00100000:0.0:1746065117.765473:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260844032 00000100:00100000:0.0:1746065117.765475:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260844032 00000100:00100000:0.0:1746065117.765487:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10255 00000100:00100000:0.0:1746065117.765493:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881260843904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065117.765505:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.765517:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a53c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.765532:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065117.765533:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10256 00010000:00010000:0.0:1746065117.765534:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.765541:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a53c expref: 37 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065117.765542:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881260844032:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.765550:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.765553:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a53c expref: 37 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.765559:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1f6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a543 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.765561:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7ce00, rc 0) 00000100:00100000:0.0:1746065117.765582:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881260843904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.765587:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10255 00000100:00100000:3.0:1746065117.765592:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259645312:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065117.765645:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.766147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.766161:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260844160 00000100:00100000:0.0:1746065117.766164:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260844160 00000100:00100000:0.0:1746065117.766183:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 609 00000100:00100000:0.0:1746065117.766188:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:1961:x1830881260844160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.766195:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.766207:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1f57 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a535 expref: 268 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.766220:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065117.766224:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065117.766240:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:1961:x1830881260844160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065117.766244:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 609 00000100:00100000:2.0:1746065117.767796:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259645312:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065117.767836:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1f6c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a543 expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.767847:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07800/0x14b4f8542d4f1f6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a543 expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.767858:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb07800, rc 0) 00000100:00100000:2.0:1746065117.768508:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881260844032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2965us (3100us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065117.768514:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10256 00000100:00100000:0.0:1746065117.775340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.775423:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260844416 00000100:00100000:3.0:1746065117.775430:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260844416 00002000:00100000:3.0:1746065117.775461:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d97800 x1830881260844416/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.775469:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97800 with x1830881260844416 ext(1048576->2097151) 00002000:00010000:3.0:1746065117.775474:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d97800 00000100:00100000:1.0:1746065117.776696:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4676 00000100:00100000:1.0:1746065117.776706:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881260844416:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065117.785220:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881260844416:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8509us (9880us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065117.785231:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4676 00002000:00100000:1.0:1746065117.785241:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d97800 x1830881260844416/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.785250:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97800 with x1830881260844416 ext(1048576->2097151) 00002000:00010000:1.0:1746065117.785255:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d97800 00000100:00100000:0.0:1746065117.792532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.792742:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260844672 00000100:00100000:1.0:1746065117.792749:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260844672 00002000:00100000:1.0:1746065117.792783:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800913faa00 x1830881260844672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.792791:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913faa00 with x1830881260844672 ext(2097152->3145727) 00002000:00010000:1.0:1746065117.792795:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913faa00 00000100:00100000:1.0:1746065117.793066:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4677 00000100:00100000:1.0:1746065117.793073:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881260844672:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065117.803432:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881260844672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10349us (10898us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065117.803443:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4677 00002000:00100000:1.0:1746065117.803452:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800913faa00 x1830881260844672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.803461:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913faa00 with x1830881260844672 ext(2097152->3145727) 00002000:00010000:1.0:1746065117.803465:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913faa00 00000100:00100000:0.0:1746065117.811774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.811839:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260844800 00000100:00100000:2.0:1746065117.811847:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260844800 00000100:00100000:0.0:1746065117.811897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.811900:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10257 00000100:00100000:2.0:1746065117.811908:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28766:x1830881260844800:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065117.811924:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065117.811926:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260844928 00010000:00010000:2.0:1746065117.811938:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a54a expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.811964:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.811970:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065117.811972:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065117.811975:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.811999:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.812009:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 23 pid: 8851 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065117.812020:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259645440:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065117.812099:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.812261:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260844928 00000100:00100000:0.0:1746065117.812287:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10258 00000100:00100000:0.0:1746065117.812292:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:28759:x1830881260844928:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065117.812299:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065117.812307:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a551 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.812322:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.812329:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a53c expref: 38 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.812335:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a50b expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.812340:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.812341:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.812344:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3366912->4009983] (req 3366912->4009983) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 38 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.812359:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a50b expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.812366:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a50b expref: 7 pid: 25185 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1746065117.812372:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259645568:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065117.812427:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a53c expref: 38 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065117.812437:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a53c expref: 38 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1746065117.812444:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259645696:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065117.812466:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.812500:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 21 pid: 8851 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065117.812511:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259645824:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065117.812540:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746065117.814401:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065117.814704:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259645440:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065117.814727:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.814739:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f75b400, rc 0) 00000100:00100000:2.0:1746065117.814773:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28766:x1830881260844800:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2866us (3007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.814780:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10257 00000100:00100000:0.0:1746065117.814920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.814997:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259645568:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065117.815341:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260845056 00000100:00100000:2.0:1746065117.815346:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260845056 00002000:00100000:2.0:1746065117.815372:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2699264->3031039) req@ffff880094ff7b80 x1830881260845056/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.815391:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7b80 with x1830881260845056 ext(2699264->3031039) 00010000:00010000:2.0:1746065117.815397:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 24 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.815405:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 24 pid: 8851 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065117.815410:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ff7b80 00000100:00100000:2.0:1746065117.815435:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1455 00000100:00100000:2.0:1746065117.815442:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881260845056:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065117.816234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.816513:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259645696:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065117.816521:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259645824:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065117.816541:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3366912->4009983] (req 3366912->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 38 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.816552:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bace00, rc 0) 00000100:00100000:1.0:1746065117.816579:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:28759:x1830881260844928:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4286us (4682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.816585:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10258 00000100:00100000:2.0:1746065117.816749:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260845184 00000100:00100000:2.0:1746065117.816753:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260845184 00010000:00010000:2.0:1746065117.816769:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a50b expref: 8 pid: 25185 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746065117.816800:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5092 00000100:00100000:2.0:1746065117.816806:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260845184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.816830:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.816846:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a50b expref: 8 pid: 25185 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065117.816854:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a50b expref: 8 pid: 25185 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065117.816870:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06200/0x14b4f8542d4f1ed9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a50b expref: 8 pid: 25185 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065117.816893:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.816916:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260845184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 110us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.816921:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5092 00000100:00100000:0.0:1746065117.819867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.819911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.819990:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260845312 00000100:00100000:1.0:1746065117.819997:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260845312 00010000:00010000:1.0:1746065117.820023:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a53c expref: 38 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1746065117.820051:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260845440 00000100:00100000:1.0:1746065117.820053:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260845440 00010000:00010000:1.0:1746065117.820063:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 22 pid: 8851 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065117.820078:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5093 00000100:00100000:1.0:1746065117.820084:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881260845312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065117.820094:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065117.820110:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a53c expref: 38 pid: 4544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1746065117.820124:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a53c expref: 38 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065117.820140:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5094 00010000:00010000:1.0:1746065117.820142:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7ce00/0x14b4f8542d4f1f65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a53c expref: 38 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065117.820148:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260845440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.820156:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065117.820156:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065117.820166:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 22 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065117.820174:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 22 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065117.820185:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb72e00/0x14b4f8542d4f1eaf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4f6 expref: 22 pid: 8851 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065117.820190:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881260845312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (330us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065117.820198:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.820200:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065117.820200:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5093 00010000:00010000:3.0:1746065117.820206:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.820213:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 36 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.820241:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 36 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065117.820251:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259645952:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065117.820507:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.822760:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260845056:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7313us (7834us total) trans 21474839946 rc 0/0 00000100:00100000:3.0:1746065117.822770:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1455 00002000:00100000:3.0:1746065117.822779:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2699264->3031039) req@ffff880094ff7b80 x1830881260845056/t21474839946(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.822787:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7b80 with x1830881260845056 ext(2699264->3031039) 00010000:00010000:3.0:1746065117.822794:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 26 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065117.822805:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 26 pid: 8851 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065117.822810:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ff7b80 00000100:00100000:3.0:1746065117.823793:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259645952:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065117.823864:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.824115:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260845440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3966us (4202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.824123:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5094 00000100:00100000:0.0:1746065117.824551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.824798:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260845696 00000100:00100000:3.0:1746065117.824803:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260845696 00002000:00100000:3.0:1746065117.825140:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3366912->3371007) req@ffff88012d50b800 x1830881260845696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.825148:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50b800 with x1830881260845696 ext(3366912->3371007) 00002000:00010000:3.0:1746065117.825152:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d50b800 00000100:00100000:3.0:1746065117.825174:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4678 00000100:00100000:3.0:1746065117.825179:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881260845696:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065117.825302:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881260845696:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 123us (752us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065117.825307:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4678 00002000:00100000:3.0:1746065117.825312:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3366912->3371007) req@ffff88012d50b800 x1830881260845696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.825318:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50b800 with x1830881260845696 ext(3366912->3371007) 00002000:00010000:3.0:1746065117.825320:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d50b800 00000100:00100000:0.0:1746065117.826502:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.826576:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260845824 00000100:00100000:3.0:1746065117.826581:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260845824 00010000:00010000:3.0:1746065117.826599:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 26 pid: 8851 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065117.826669:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5095 00000100:00100000:3.0:1746065117.826675:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260845824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.826686:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.826699:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 26 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065117.826709:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 26 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065117.826727:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb06600/0x14b4f8542d4f1e8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3031039) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4d3 expref: 26 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065117.826741:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.826743:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.826749:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.826756:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.826782:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065117.826792:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259646080:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065117.827713:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.832225:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259646080:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065117.832244:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.832809:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881260845824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6131us (6307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.832836:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5095 00000100:00100000:0.0:1746065117.832979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.833064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.835201:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260846336 00000100:00100000:1.0:1746065117.835210:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260846336 00002000:00100000:1.0:1746065117.835248:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3366911) req@ffff88012bd3f100 x1830881260846336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.835257:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f100 with x1830881260846336 ext(3145728->3366911) 00002000:00010000:1.0:1746065117.835262:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3f100 00000100:00100000:1.0:1746065117.835293:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260846208 00000100:00100000:1.0:1746065117.835296:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260846208 00002000:00100000:1.0:1746065117.835438:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012bd3df80 x1830881260846208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.835445:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3df80 with x1830881260846208 ext(2097152->3145727) 00002000:00010000:1.0:1746065117.835452:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3df80 00000100:00100000:0.0:1746065117.836120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.836673:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260846592 00000100:00100000:1.0:1746065117.836678:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260846592 00000100:00100000:0.0:1746065117.836691:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4679 00002000:00100000:1.0:1746065117.836698:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4005888->4009983) req@ffff88012bd3d180 x1830881260846592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065117.836699:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881260846336:12345-192.168.202.46@tcp:3:multiop.0 00002000:00100000:1.0:1746065117.836707:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3d180 with x1830881260846592 ext(4005888->4009983) 00002000:00010000:1.0:1746065117.836710:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3d180 00000100:00100000:1.0:1746065117.836727:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4680 00000100:00100000:1.0:1746065117.836733:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881260846208:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065117.837112:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4681 00000100:00100000:2.0:1746065117.837126:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881260846592:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065117.837198:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881260846592:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 76us (1079us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065117.837204:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4681 00002000:00100000:2.0:1746065117.837208:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (4005888->4009983) req@ffff88012bd3d180 x1830881260846592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.837219:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3d180 with x1830881260846592 ext(4005888->4009983) 00002000:00010000:2.0:1746065117.837221:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3d180 00000100:00100000:2.0:1746065117.842422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.843469:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881260846336:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 6768us (10487us total) trans 0 rc 221184/221184 00000100:00100000:1.0:1746065117.843478:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4679 00002000:00100000:1.0:1746065117.843487:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3366911) req@ffff88012bd3f100 x1830881260846336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 221184/221184 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.843495:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f100 with x1830881260846336 ext(3145728->3366911) 00002000:00010000:1.0:1746065117.843500:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3f100 00000100:00100000:3.0:1746065117.844089:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260846848 00000100:00100000:3.0:1746065117.844096:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260846848 00000100:00100000:3.0:1746065117.844127:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3623 00000100:00100000:3.0:1746065117.844133:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:28759:x1830881260846848:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065117.844284:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:28759:x1830881260846848:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 151us (1869us total) trans 8589942965 rc 0/0 00000100:00100000:3.0:1746065117.844289:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3623 00000100:00100000:1.0:1746065117.846228:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881260846208:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 9490us (13159us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065117.846238:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4680 00002000:00100000:1.0:1746065117.846246:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012bd3df80 x1830881260846208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.846255:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3df80 with x1830881260846208 ext(2097152->3145727) 00002000:00010000:1.0:1746065117.846258:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3df80 00000100:00100000:3.0:1746065117.852760:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.852791:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260847104 00000100:00100000:3.0:1746065117.852797:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260847104 00002000:00100000:3.0:1746065117.852849:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4009984->4194303) req@ffff88013026aa00 x1830881260847104/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.852859:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026aa00 with x1830881260847104 ext(4009984->4194303) 00002000:00010000:3.0:1746065117.852863:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013026aa00 00000100:00100000:3.0:1746065117.852893:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4682 00000100:00100000:3.0:1746065117.852899:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881260847104:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065117.854997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.856238:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260847360 00000100:00100000:0.0:1746065117.856246:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260847360 00002000:00100000:0.0:1746065117.856278:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880094ff4e00 x1830881260847360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065117.856287:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4e00 with x1830881260847360 ext(3145728->4194303) 00002000:00010000:0.0:1746065117.856291:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff4e00 00000100:00100000:0.0:1746065117.856320:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4683 00000100:00100000:0.0:1746065117.856327:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260847360:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065117.864944:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881260847104:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12038us (12183us total) trans 0 rc 184320/184320 00000100:00100000:2.0:1746065117.864954:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4682 00002000:00100000:2.0:1746065117.864964:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4009984->4194303) req@ffff88013026aa00 x1830881260847104/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 184320/184320 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.864973:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026aa00 with x1830881260847104 ext(4009984->4194303) 00002000:00010000:2.0:1746065117.864978:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013026aa00 00000100:00100000:0.0:1746065117.869261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.869368:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260847488 00000100:00100000:1.0:1746065117.869385:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260847488 00000100:00100000:1.0:1746065117.869437:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10259 00000100:00100000:1.0:1746065117.869445:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:28762:x1830881260847488:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065117.869462:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065117.869483:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a558 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.869511:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.869519:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a504 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.869526:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e8 expref: 36 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.869536:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.869538:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.869541:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1642496->2097151] (req 1642496->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.869571:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e8 expref: 36 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.869581:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e8 expref: 36 pid: 8851 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1746065117.869592:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646208:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065117.869675:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a504 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.869687:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a504 expref: 6 pid: 8851 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1746065117.869695:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646336:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065117.869734:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.869742:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 22 pid: 8851 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065117.869754:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065117.869777:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.874078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.874111:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646208:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065117.874121:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646336:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065117.874129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.874129:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646464:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065117.874154:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1642496->2097151] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.874169:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cca00, rc 0) 00000100:00100000:0.0:1746065117.874201:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:28762:x1830881260847488:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4757us (4951us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.874203:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260847616 00000100:00100000:3.0:1746065117.874208:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260847616 00000100:00100000:0.0:1746065117.874208:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10259 00010000:00010000:3.0:1746065117.874231:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a504 expref: 7 pid: 8851 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065117.874699:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260847744 00000100:00100000:3.0:1746065117.874703:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260847744 00010000:00010000:3.0:1746065117.874720:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e8 expref: 37 pid: 8851 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746065117.876254:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5096 00000100:00100000:2.0:1746065117.876269:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881260847616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.876283:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065117.876302:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a504 expref: 7 pid: 8851 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065117.876312:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a504 expref: 7 pid: 8851 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065117.876330:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f75a800/0x14b4f8542d4f1ed2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a504 expref: 7 pid: 8851 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065117.876345:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5097 00010000:00010000:2.0:1746065117.876347:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.876352:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881260847744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065117.876359:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065117.876366:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e8 expref: 37 pid: 8851 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746065117.876373:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e8 expref: 37 pid: 8851 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746065117.876394:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7de00/0x14b4f8542d4f1ea1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4e8 expref: 37 pid: 8851 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746065117.876424:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1959:x1830881260847616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 162us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.876430:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5096 00000100:00100000:0.0:1746065117.876553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.876568:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260847872 00000100:00100000:0.0:1746065117.876571:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260847872 00010000:00010000:0.0:1746065117.876584:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 22 pid: 8851 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065117.876597:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5098 00000100:00100000:0.0:1746065117.876603:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881260847872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065117.876608:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065117.876615:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 22 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.876623:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 22 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.876632:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb06e00/0x14b4f8542d4f1e85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4cc expref: 22 pid: 8851 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065117.876643:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.876644:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065117.876649:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.876656:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065117.876678:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065117.876687:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259646592:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065117.876722:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065117.876756:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260847360:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 20429us (21763us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065117.876762:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4683 00002000:00100000:2.0:1746065117.876769:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880094ff4e00 x1830881260847360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.876777:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4e00 with x1830881260847360 ext(3145728->4194303) 00002000:00010000:2.0:1746065117.876780:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff4e00 00010000:00010000:3.0:1746065117.876866:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065117.876901:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881260847744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 550us (2771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.876907:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5097 00000100:00100000:1.0:1746065117.879351:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259646592:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065117.879365:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065117.879412:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260847872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2807us (2858us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.879419:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5098 00000100:00100000:0.0:1746065117.880279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.880320:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.880436:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260848128 00000100:00100000:2.0:1746065117.880442:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260848128 00000100:00100000:1.0:1746065117.880442:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260848256 00000100:00100000:1.0:1746065117.880446:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260848256 00002000:00100000:2.0:1746065117.880474:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37f:0x0] (1642496->1646591) req@ffff88008fd72680 x1830881260848128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065117.880480:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10260 00002000:00100000:2.0:1746065117.880483:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72680 with x1830881260848128 ext(1642496->1646591) 00002000:00010000:2.0:1746065117.880487:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd72680 00000100:00100000:1.0:1746065117.880487:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881260848256:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065117.880498:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065117.880500:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4684 00000100:00100000:2.0:1746065117.880506:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260848128:12345-192.168.202.46@tcp:3:multiop.0 00010000:00010000:1.0:1746065117.880510:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00cde00/0x14b4f8542d4f1f88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a55f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.880547:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646720:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065117.880589:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065117.881251:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260848128:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 744us (972us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065117.881257:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4684 00002000:00100000:2.0:1746065117.881263:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37f:0x0] (1642496->1646591) req@ffff88008fd72680 x1830881260848128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.881270:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72680 with x1830881260848128 ext(1642496->1646591) 00002000:00010000:2.0:1746065117.881273:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd72680 00000100:00100000:1.0:1746065117.882341:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646720:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065117.882364:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00cde00/0x14b4f8542d4f1f88 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a55f expref: 37 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.882375:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cde00/0x14b4f8542d4f1f88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a55f expref: 37 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.882409:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cde00, rc 0) 00000100:00100000:1.0:1746065117.882434:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881260848256:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1947us (2114us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065117.882440:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10260 00000100:00100000:0.0:1746065117.889678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.889724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.889769:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260848640 00000100:00100000:2.0:1746065117.889780:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260848640 00002000:00100000:2.0:1746065117.889847:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88008fc5bb80 x1830881260848640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.889855:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5bb80 with x1830881260848640 ext(4194304->4976639) 00002000:00010000:2.0:1746065117.889859:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5bb80 00000100:00100000:2.0:1746065117.889887:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4685 00000100:00100000:2.0:1746065117.889895:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881260848640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065117.890033:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260848384 00000100:00100000:1.0:1746065117.890037:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260848384 00000100:00100000:1.0:1746065117.890070:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10261 00000100:00100000:1.0:1746065117.890075:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:28762:x1830881260848384:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065117.890253:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065117.890267:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a566 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.890288:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 36 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.890641:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065117.890642:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065117.890646:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->2469887] (req 2097152->2469887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.890670:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.890680:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 37 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065117.890691:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646848:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065117.890758:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.899866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.899927:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260848768 00000100:00100000:3.0:1746065117.899936:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260848768 00002000:00100000:3.0:1746065117.899972:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3366912->4009983) req@ffff88008fc5b100 x1830881260848768/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065117.899981:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b100 with x1830881260848768 ext(3366912->4009983) 00010000:00010000:3.0:1746065117.899988:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 38 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065117.900000:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 38 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065117.900007:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5b100 00000100:00100000:3.0:1746065117.900022:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1456 00000100:00100000:3.0:1746065117.900028:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881260848768:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065117.900217:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881260848640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10322us (10491us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746065117.900224:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4685 00002000:00100000:2.0:1746065117.900231:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88008fc5bb80 x1830881260848640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.900238:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5bb80 with x1830881260848640 ext(4194304->4976639) 00010000:00010000:2.0:1746065117.900243:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 37 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.900253:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 37 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065117.900259:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5bb80 00000100:00100000:1.0:1746065117.900562:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259646848:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065117.900580:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->2469887] (req 2097152->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.900592:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cd000, rc 0) 00000100:00100000:1.0:1746065117.900609:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:28762:x1830881260848384:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10534us (10939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.900614:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10261 00000100:00100000:2.0:1746065117.906274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.906965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.907028:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260848896 00000100:00100000:3.0:1746065117.907036:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260848896 00000100:00100000:3.0:1746065117.907066:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260849024 00000100:00100000:3.0:1746065117.907068:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260849024 00000100:00100000:3.0:1746065117.907081:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10262 00000100:00100000:3.0:1746065117.907088:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881260848896:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.907103:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.907118:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1f96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a56d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065117.907163:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259646976:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065117.907216:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.907229:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10263 00000100:00100000:1.0:1746065117.907242:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1961:x1830881260849024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065117.907249:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065117.907258:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00cc000/0x14b4f8542d4f1f9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a574 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.907281:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259647104:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065117.907301:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.909243:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259646976:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065117.909251:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259647104:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065117.909266:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1f96 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a56d expref: 41 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.909268:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00cc000/0x14b4f8542d4f1f9d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a574 expref: 41 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.909277:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1f96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a56d expref: 41 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065117.909277:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cc000/0x14b4f8542d4f1f9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a574 expref: 41 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.909289:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350dfa00, rc 0) 00010000:00010000:1.0:1746065117.909290:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cc000, rc 0) 00000100:00100000:1.0:1746065117.909363:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881260849024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2127us (2398us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065117.909370:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10263 00000100:00100000:3.0:1746065117.909851:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881260848896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2762us (3583us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065117.909858:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10262 00000100:00100000:2.0:1746065117.911315:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881260848768:12345-192.168.202.46@tcp:4:cat.0 Request processed in 11283us (11453us total) trans 17179872706 rc 0/0 00000100:00100000:2.0:1746065117.911323:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1456 00002000:00100000:2.0:1746065117.911332:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3366912->4009983) req@ffff88008fc5b100 x1830881260848768/t17179872706(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.911340:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b100 with x1830881260848768 ext(3366912->4009983) 00010000:00010000:2.0:1746065117.911347:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 38 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.911361:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 38 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065117.911367:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5b100 00000100:00100000:0.0:1746065117.914196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065117.914438:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260849152 00000100:00100000:3.0:1746065117.914446:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260849152 00000100:00100000:0.0:1746065117.914567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.915089:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260849280 00000100:00100000:1.0:1746065117.915094:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260849280 00010000:00010000:1.0:1746065117.915117:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 39 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065117.915140:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5099 00000100:00100000:1.0:1746065117.915147:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881260849280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065117.915325:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065117.915354:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 39 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065117.915369:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 39 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065117.915401:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bace00/0x14b4f8542d4f1f7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->4009983) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a551 expref: 39 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065117.915423:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.915424:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.915430:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.915437:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.915461:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.915471:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259647232:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065117.917290:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10264 00000100:00100000:3.0:1746065117.917301:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:28766:x1830881260849152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065117.917320:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.917333:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a57b expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.917355:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.917362:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065117.917363:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065117.917366:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.917394:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.918567:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 21 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065117.918581:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259647360:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065117.918733:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065117.918798:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065117.920301:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259647232:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065117.920317:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065117.920349:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881260849280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5201us (5781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.920358:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5099 00000100:00100000:3.0:1746065117.921657:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259647360:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065117.921679:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [4972544->5242879] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 38 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.921693:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350dfc00, rc 0) 00000100:00100000:3.0:1746065117.921726:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:28766:x1830881260849152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4427us (7537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.921733:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10264 00000100:00100000:0.0:1746065117.927742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.928297:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260849536 00000100:00100000:2.0:1746065117.928306:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260849536 00002000:00100000:2.0:1746065117.928345:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2465792->2469887) req@ffff88008fc5b480 x1830881260849536/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.928356:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b480 with x1830881260849536 ext(2465792->2469887) 00010000:00010000:2.0:1746065117.928364:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 22 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.928387:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 22 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065117.928394:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5b480 00000100:00100000:2.0:1746065117.928413:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1457 00000100:00100000:2.0:1746065117.928421:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260849536:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065117.929697:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881260849536:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1274us (1960us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065117.929708:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1457 00002000:00100000:2.0:1746065117.929715:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2465792->2469887) req@ffff88008fc5b480 x1830881260849536/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.929722:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b480 with x1830881260849536 ext(2465792->2469887) 00010000:00010000:2.0:1746065117.929728:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 22 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.929738:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 22 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065117.929745:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5b480 00000100:00100000:0.0:1746065117.932508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.932770:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260849792 00000100:00100000:2.0:1746065117.932778:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260849792 00002000:00100000:2.0:1746065117.932836:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2469887) req@ffff88008fc58a80 x1830881260849792/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.932846:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58a80 with x1830881260849792 ext(2097152->2469887) 00010000:00010000:2.0:1746065117.932854:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 22 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.932867:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 22 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065117.932877:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc58a80 00000100:00100000:2.0:1746065117.932894:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1458 00000100:00100000:2.0:1746065117.932901:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881260849792:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065117.942878:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260849792:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 9969us (10369us total) trans 17179872707 rc 0/0 00000100:00100000:2.0:1746065117.942889:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1458 00002000:00100000:2.0:1746065117.942898:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2469887) req@ffff88008fc58a80 x1830881260849792/t17179872707(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/448 e 0 to 0 dl 1746065128 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.942907:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58a80 with x1830881260849792 ext(2097152->2469887) 00010000:00010000:2.0:1746065117.942916:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 24 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065117.942929:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 24 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065117.942935:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc58a80 00000100:00100000:0.0:1746065117.950956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.951000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.951042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.951106:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260850048 00000100:00100000:2.0:1746065117.951113:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260850048 00000100:00100000:3.0:1746065117.951132:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260850176 00000100:00100000:3.0:1746065117.951136:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260850176 00000100:00100000:2.0:1746065117.951164:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10265 00000100:00100000:2.0:1746065117.951172:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881260850048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065117.951190:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065117.951197:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260849920 00000100:00100000:1.0:1746065117.951201:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260849920 00010000:00010000:2.0:1746065117.951204:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093368400/0x14b4f8542d4f1fab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a582 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.951217:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 26 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065117.951256:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5100 00000100:00100000:2.0:1746065117.951262:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260849920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065117.951271:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065117.951289:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10266 00010000:00010000:2.0:1746065117.951289:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 26 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065117.951295:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881260850176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065117.951300:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 26 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065117.951303:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065117.951312:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a589 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065117.951319:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.951321:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.951323:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065117.951325:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065117.951328:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.951330:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a589 expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065117.951335:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065117.951341:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a589 expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.951349:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350dfa00, rc 0) 00010000:00010000:2.0:1746065117.951363:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065117.951373:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259647488:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065117.951394:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260850176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 99us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065117.951399:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10266 00000100:00100000:2.0:1746065117.951436:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065117.951500:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259647616:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065117.951524:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.953693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.953695:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259647488:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065117.953712:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065117.953742:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260849920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2480us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065117.953751:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5100 00010000:00010000:3.0:1746065117.954142:0:8429:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88012d136300 x1830881259647616) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 25 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065117.954178:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f1f8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a566 expref: 25 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065117.954194:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259647616:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065117.954202:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260850304 00000100:00100000:1.0:1746065117.954207:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260850304 00010000:00010000:3.0:1746065117.954213:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093368400/0x14b4f8542d4f1fab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a582 expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.954223:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093368400/0x14b4f8542d4f1fab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a582 expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065117.954229:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093368400, rc 0) 00000100:00100000:1.0:1746065117.954238:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10267 00000100:00100000:1.0:1746065117.954244:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881260850304:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065117.954251:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260850048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3081us (3251us total) trans 0 rc 301/301 00010000:00010000:1.0:1746065117.954255:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065117.954256:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10265 00010000:00010000:1.0:1746065117.954264:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f1fb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a590 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065117.954303:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259647744:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065117.954348:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065117.966217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.966421:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260850560 00000100:00100000:2.0:1746065117.966427:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260850560 00000100:00100000:1.0:1746065117.966453:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259647744:192.168.202.46@tcp:106: 00002000:00100000:2.0:1746065117.966464:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1642495) req@ffff880094a13800 x1830881260850560/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.966472:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13800 with x1830881260850560 ext(1048576->1642495) 00002000:00010000:2.0:1746065117.966476:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13800 00010000:00010000:1.0:1746065117.966483:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f1fb9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a590 expref: 39 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065117.966494:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4686 00010000:00010000:1.0:1746065117.966494:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f1fb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a590 expref: 39 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065117.966502:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881260850560:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:1.0:1746065117.966507:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00ccc00, rc 0) 00000100:00100000:1.0:1746065117.966553:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881260850304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 12308us (12865us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065117.966560:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10267 00000100:00100000:0.0:1746065117.970802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.970924:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260850816 00000100:00100000:2.0:1746065117.970932:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260850816 00002000:00100000:2.0:1746065117.970970:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (4972544->4976639) req@ffff880093750000 x1830881260850816/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.970979:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093750000 with x1830881260850816 ext(4972544->4976639) 00002000:00010000:2.0:1746065117.970984:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093750000 00000100:00100000:2.0:1746065117.971002:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4687 00000100:00100000:2.0:1746065117.971009:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881260850816:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065117.971160:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881260850816:12345-192.168.202.46@tcp:3:cat.0 Request processed in 150us (365us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065117.971166:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4687 00002000:00100000:2.0:1746065117.971172:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (4972544->4976639) req@ffff880093750000 x1830881260850816/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:33/0 lens 488/4536 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.971178:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093750000 with x1830881260850816 ext(4972544->4976639) 00002000:00010000:2.0:1746065117.971181:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093750000 00000100:00100000:2.0:1746065117.972531:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881260850560:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6026us (6317us total) trans 0 rc 593920/593920 00000100:00100000:2.0:1746065117.972538:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4686 00002000:00100000:2.0:1746065117.972546:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1642495) req@ffff880094a13800 x1830881260850560/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 593920/593920 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.972554:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13800 with x1830881260850560 ext(1048576->1642495) 00002000:00010000:2.0:1746065117.972558:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13800 00000100:00100000:0.0:1746065117.974283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.975707:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260851072 00000100:00100000:1.0:1746065117.975717:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260851072 00000100:00100000:1.0:1746065117.975772:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3624 00000100:00100000:1.0:1746065117.975780:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:28766:x1830881260851072:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065117.975994:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:28766:x1830881260851072:12345-192.168.202.46@tcp:35:cat.0 Request processed in 214us (1714us total) trans 8589942966 rc 0/0 00000100:00100000:1.0:1746065117.976000:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3624 00000100:00100000:0.0:1746065117.980993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065117.981057:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260851200 00000100:00100000:1.0:1746065117.981065:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260851200 00000100:00100000:1.0:1746065117.981110:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10268 00000100:00100000:1.0:1746065117.981117:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093750700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+23:28771:x1830881260851200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065117.981131:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065117.981146:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a597 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.981167:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.981169:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065117.981176:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a597 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.981192:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a597 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065117.981201:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cd200, rc 0) 00000100:00100000:1.0:1746065117.981771:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093750700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+24:28771:x1830881260851200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 652us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065117.981778:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10268 00000100:00100000:0.0:1746065117.989884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.989923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065117.989947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065117.989948:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260851456 00000100:00100000:2.0:1746065117.989956:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260851456 00000100:00100000:0.0:1746065117.989987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:2.0:1746065117.989998:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880093750a80 x1830881260851456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.990012:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093750a80 with x1830881260851456 ext(2097152->3145727) 00002000:00010000:2.0:1746065117.990016:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093750a80 00000100:00100000:2.0:1746065117.990036:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260851712 00000100:00100000:2.0:1746065117.990038:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260851712 00002000:00100000:2.0:1746065117.990051:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880093750e00 x1830881260851712/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.990057:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093750e00 with x1830881260851712 ext(3145728->4194303) 00002000:00010000:2.0:1746065117.990059:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093750e00 00000100:00100000:1.0:1746065117.990061:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260852096 00000100:00100000:1.0:1746065117.990065:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260852096 00000100:00100000:2.0:1746065117.990068:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260851968 00000100:00100000:2.0:1746065117.990070:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260851968 00002000:00100000:2.0:1746065117.990080:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880093751500 x1830881260851968/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065117.990084:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880093751180 x1830881260852096/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/0 e 0 to 0 dl 1746065128 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065117.990086:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093751500 with x1830881260851968 ext(2097152->3145727) 00002000:00010000:2.0:1746065117.990089:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093751500 00002000:00100000:1.0:1746065117.990091:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093751180 with x1830881260852096 ext(3145728->4194303) 00002000:00010000:1.0:1746065117.990095:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093751180 00000100:00100000:2.0:1746065117.990101:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4688 00000100:00100000:2.0:1746065117.990108:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260851456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065117.990108:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4689 00000100:00100000:1.0:1746065117.990113:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881260851712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065117.990160:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4690 00000100:00100000:2.0:1746065117.990166:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+27:1959:x1830881260851968:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065117.990561:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4691 00000100:00100000:3.0:1746065117.990567:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+27:1959:x1830881260852096:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.004880:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881260851968:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14703us (14882us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.004890:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4690 00002000:00100000:2.0:1746065118.004900:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880093751500 x1830881260851968/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.004909:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093751500 with x1830881260851968 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.004913:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093751500 00000100:00100000:3.0:1746065118.009595:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093751180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881260852096:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19021us (19639us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065118.009605:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4691 00002000:00100000:3.0:1746065118.009614:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880093751180 x1830881260852096/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.009627:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093751180 with x1830881260852096 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.009633:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093751180 00000100:00100000:1.0:1746065118.010153:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881260851456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20044us (20736us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065118.010161:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4688 00002000:00100000:1.0:1746065118.010167:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880093750a80 x1830881260851456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.010174:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093750a80 with x1830881260851456 ext(2097152->3145727) 00002000:00010000:1.0:1746065118.010177:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093750a80 00000100:00100000:3.0:1746065118.011595:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881260851712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21476us (21666us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065118.011602:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4689 00002000:00100000:3.0:1746065118.011608:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880093750e00 x1830881260851712/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:33/0 lens 488/440 e 0 to 0 dl 1746065128 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.011616:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093750e00 with x1830881260851712 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.011620:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093750e00 00000100:00100000:1.0:1746065118.023032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.023414:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260852480 00000100:00100000:3.0:1746065118.023422:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260852480 00002000:00100000:3.0:1746065118.023457:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88012d7fd500 x1830881260852480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.023466:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fd500 with x1830881260852480 ext(4194304->4976639) 00002000:00010000:3.0:1746065118.023471:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fd500 00000100:00100000:3.0:1746065118.023522:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4692 00000100:00100000:3.0:1746065118.023530:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260852480:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065118.031463:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260852480:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7924us (8429us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746065118.031473:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4692 00002000:00100000:3.0:1746065118.031483:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88012d7fd500 x1830881260852480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.031492:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fd500 with x1830881260852480 ext(4194304->4976639) 00002000:00010000:3.0:1746065118.031498:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fd500 00000100:00100000:0.0:1746065118.079599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.079701:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260852736 00000100:00100000:1.0:1746065118.079708:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260852736 00000100:00100000:1.0:1746065118.079760:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8931 00000100:00100000:1.0:1746065118.079768:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:28778:x1830881260852736:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065118.079788:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.079802:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1ce00/0x14b4f8542d4f1fc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a59e expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.079922:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.079932:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.079942:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.079952:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.079957:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.079961:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080055:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f1fdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080063:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f1fdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080068:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f1fdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065118.080076:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065118.080150:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080155:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080161:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080166:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb1d000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065118.080169:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080176:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080185:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065118.080188:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065118.080191:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080195:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d000/0x14b4f8542d4f1fce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080215:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080219:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080223:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080227:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb1d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065118.080228:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080233:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080238:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f49f500) 00010000:00010000:1.0:1746065118.080240:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065118.080242:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080274:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f1fd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.080310:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1ce00/0x14b4f8542d4f1fc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a59e expref: 272 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.080632:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f1fdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a59e expref: 271 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.080640:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065118.080642:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065118.080644:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1d400, rc 0) 00000100:00100000:1.0:1746065118.080692:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:28778:x1830881260852736:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 924us (1099us total) trans 8589942967 rc 0/0 00000100:00100000:1.0:1746065118.080698:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8931 00000100:00100000:0.0:1746065118.083530:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.083791:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260852864 00000100:00100000:2.0:1746065118.083802:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260852864 00000100:00100000:2.0:1746065118.083880:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 610 00000100:00100000:2.0:1746065118.083888:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093751c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:1958:x1830881260852864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.083900:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.083925:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f1fdc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a59e expref: 271 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.083955:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065118.083959:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.084005:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093751c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:1958:x1830881260852864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 118us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.084011:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 610 00000100:00100000:0.0:1746065118.092912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.093002:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260852992 00000100:00100000:1.0:1746065118.093010:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260852992 00000100:00080000:2.0:1746065118.093162:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065118.093276:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10269 00000100:00100000:1.0:1746065118.093284:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:28778:x1830881260852992:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065118.093298:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.093311:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5a5 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.093334:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.093342:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a597 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.093352:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.093354:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.093357:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2555904->2756607] (req 2555904->2756607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 39 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.093399:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a597 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.093409:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a597 expref: 23 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065118.093419:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259647872:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065118.096187:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.096200:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 39 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065118.096209:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259648000:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065118.096294:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.096314:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259647872:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065118.099777:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259648000:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065118.099805:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2555904->2756607] (req 2555904->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 39 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.099853:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1d600, rc 0) 00000100:00100000:1.0:1746065118.099893:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:28778:x1830881260852992:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6610us (6987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.099901:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10269 00000100:00100000:0.0:1746065118.100269:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.100856:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.100899:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260853120 00000100:00100000:2.0:1746065118.100905:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260853120 00010000:00010000:2.0:1746065118.100931:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 39 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065118.101321:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260853248 00000100:00100000:1.0:1746065118.101325:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260853248 00000100:00100000:2.0:1746065118.101326:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5101 00000100:00100000:2.0:1746065118.101334:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881260853120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.101337:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a597 expref: 24 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.101344:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065118.101350:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5102 00000100:00100000:1.0:1746065118.101353:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093752680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881260853248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.101358:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.101361:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 39 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.101365:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a597 expref: 24 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.101372:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 39 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.101390:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a597 expref: 24 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.101748:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350dfc00/0x14b4f8542d4f1fa4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4972544->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a57b expref: 39 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.101753:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd200/0x14b4f8542d4f1fc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a597 expref: 24 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.101771:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.101773:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.101777:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 38 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.101785:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 38 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.101964:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065118.101980:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 38 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.101990:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259648128:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.101991:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881260853120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 658us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.101998:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5101 00000100:00100000:1.0:1746065118.102029:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.103449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.103503:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259648128:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065118.103516:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065118.103529:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260853504 00000100:00100000:3.0:1746065118.103533:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260853504 00000100:00100000:1.0:1746065118.103538:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093752680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260853248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2183us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.103543:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5102 00002000:00100000:3.0:1746065118.103559:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2555904->2559999) req@ffff880093752a00 x1830881260853504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.103567:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093752a00 with x1830881260853504 ext(2555904->2559999) 00002000:00010000:3.0:1746065118.103571:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093752a00 00000100:00100000:3.0:1746065118.103591:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4693 00000100:00100000:3.0:1746065118.103596:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881260853504:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065118.103795:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881260853504:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 198us (349us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065118.103801:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4693 00002000:00100000:3.0:1746065118.103807:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2555904->2559999) req@ffff880093752a00 x1830881260853504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.103837:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093752a00 with x1830881260853504 ext(2555904->2559999) 00002000:00010000:3.0:1746065118.103840:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093752a00 00000100:00100000:0.0:1746065118.106453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.106527:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260853760 00000100:00100000:3.0:1746065118.106534:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260853760 00002000:00100000:3.0:1746065118.106563:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2752512->2756607) req@ffff880093752d80 x1830881260853760/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.106571:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093752d80 with x1830881260853760 ext(2752512->2756607) 00002000:00010000:3.0:1746065118.106575:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093752d80 00000100:00100000:3.0:1746065118.106652:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4694 00000100:00100000:3.0:1746065118.106659:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881260853760:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065118.107068:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881260853760:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 408us (619us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065118.107074:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4694 00002000:00100000:3.0:1746065118.107080:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2752512->2756607) req@ffff880093752d80 x1830881260853760/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.107087:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093752d80 with x1830881260853760 ext(2752512->2756607) 00002000:00010000:3.0:1746065118.107089:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093752d80 00000100:00100000:0.0:1746065118.108496:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.108598:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260854016 00000100:00100000:3.0:1746065118.108605:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260854016 00000100:00100000:3.0:1746065118.108646:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3625 00000100:00100000:3.0:1746065118.108653:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:28778:x1830881260854016:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065118.108858:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:28778:x1830881260854016:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 205us (366us total) trans 8589942968 rc 0/0 00000100:00100000:3.0:1746065118.108865:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3625 00000100:00100000:0.0:1746065118.167404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.167621:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260854144 00000100:00100000:1.0:1746065118.167629:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260854144 00000100:00100000:1.0:1746065118.167680:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10270 00000100:00100000:1.0:1746065118.167688:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260854144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065118.167703:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.167717:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1dc00/0x14b4f8542d4f1ff1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5ac expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.167760:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259648256:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065118.167865:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746065118.171155:0:4544:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065118 -> 1746065119 00002000:00010000:1.0:1746065118.171162:0:4544:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065118 -> 1746065119 00000100:00100000:1.0:1746065118.171182:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259648256:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065118.171207:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1dc00/0x14b4f8542d4f1ff1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5ac expref: 24 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065118.171220:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1dc00/0x14b4f8542d4f1ff1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5ac expref: 24 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065118.171248:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1dc00, rc 0) 00000100:00100000:1.0:1746065118.171287:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260854144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3599us (3890us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065118.171294:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10270 00000100:00100000:0.0:1746065118.186869:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.186955:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260854272 00000100:00100000:1.0:1746065118.186963:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260854272 00000100:00100000:1.0:1746065118.187016:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10271 00000100:00100000:1.0:1746065118.187023:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+23:28783:x1830881260854272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065118.187039:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.187052:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5b3 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.187076:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 37 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.187083:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065118.187084:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065118.187087:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.187116:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 37 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.187126:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 37 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065118.187136:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259648384:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065118.187208:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.189014:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259648384:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065118.189032:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.189043:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1de00, rc 0) 00000100:00100000:1.0:1746065118.189076:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+24:28783:x1830881260854272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2054us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.189082:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10271 00000100:00100000:0.0:1746065118.190305:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.190366:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260854400 00000100:00100000:3.0:1746065118.190372:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260854400 00002000:00100000:3.0:1746065118.190433:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2555904->2756607) req@ffff880093753800 x1830881260854400/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.190440:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093753800 with x1830881260854400 ext(2555904->2756607) 00010000:00010000:3.0:1746065118.190447:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 38 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.190457:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 38 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.190467:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093753800 00000100:00100000:3.0:1746065118.190493:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1459 00000100:00100000:3.0:1746065118.190499:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881260854400:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065118.194124:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1960:x1830881260854400:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 3619us (3816us total) trans 17179872708 rc 0/0 00000100:00100000:3.0:1746065118.194132:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1459 00002000:00100000:3.0:1746065118.194140:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2555904->2756607) req@ffff880093753800 x1830881260854400/t17179872708(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.194148:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093753800 with x1830881260854400 ext(2555904->2756607) 00010000:00010000:3.0:1746065118.194155:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 40 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.194166:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 40 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.194171:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093753800 00000100:00100000:0.0:1746065118.199924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.200938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.200978:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260854784 00000100:00100000:0.0:1746065118.200984:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260854784 00000100:00100000:0.0:1746065118.201031:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8932 00000100:00100000:0.0:1746065118.201037:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:28786:x1830881260854784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065118.201054:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.201067:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c200/0x14b4f8542d4f1fff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5ba expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.201156:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065118.201159:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260854528 00000100:00100000:1.0:1746065118.201162:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260854528 00010000:00010000:0.0:1746065118.201171:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201180:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.201181:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 40 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.201192:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201197:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065118.201198:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5103 00010000:00010000:0.0:1746065118.201201:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065118.201203:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1961:x1830881260854528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.201211:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065118.201226:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 40 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.201237:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 40 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.201252:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d600/0x14b4f8542d4f1fea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2555904->2756607) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5a5 expref: 40 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.201270:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.201271:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.201277:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.201282:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9a00/0x14b4f8542d4f2014 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.201283:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.201290:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9a00/0x14b4f8542d4f2014 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201295:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9a00/0x14b4f8542d4f2014 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065118.201301:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065118.201306:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.201316:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259648512:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065118.201364:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201371:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065118.201387:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746065118.201388:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201397:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800900c9e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065118.201400:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201406:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201413:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065118.201416:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065118.201419:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201423:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9e00/0x14b4f8542d4f2006 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201435:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201440:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201444:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201448:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800900c9c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065118.201450:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201454:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201460:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715f00) 00010000:00010000:0.0:1746065118.201462:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065118.201464:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201468:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9c00/0x14b4f8542d4f200d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.201496:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c200/0x14b4f8542d4f1fff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5ba expref: 274 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.201506:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9a00/0x14b4f8542d4f2014 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5ba expref: 273 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.201511:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065118.201513:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065118.201515:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900c9a00, rc 0) 00000100:00100000:0.0:1746065118.201539:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:28786:x1830881260854784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 502us (602us total) trans 8589942969 rc 0/0 00000100:00100000:0.0:1746065118.201544:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8932 00000100:00100000:2.0:1746065118.207345:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.207392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.207419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.207443:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260855040 00000100:00100000:2.0:1746065118.207449:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260855040 00000100:00100000:2.0:1746065118.207478:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260855168 00000100:00100000:2.0:1746065118.207480:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260855168 00000100:00100000:2.0:1746065118.207492:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10272 00000100:00100000:2.0:1746065118.207499:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1958:x1830881260855040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065118.207518:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.207532:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093368200/0x14b4f8542d4f2022 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5c1 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.207548:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10273 00000100:00100000:1.0:1746065118.207556:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1958:x1830881260855168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065118.207563:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065118.207570:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259648640:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065118.207570:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5c8 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.207587:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.207589:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.207595:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c8 expref: 43 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065118.207607:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c8 expref: 43 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065118.207615:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1d400, rc 0) 00000100:00100000:2.0:1746065118.207628:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.207634:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1958:x1830881260855168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.207640:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10273 00000100:00100000:3.0:1746065118.207870:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260854912 00000100:00100000:3.0:1746065118.207878:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260854912 00000100:00100000:3.0:1746065118.207916:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 611 00000100:00100000:3.0:1746065118.207922:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:1958:x1830881260854912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065118.207930:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065118.207944:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900c9a00/0x14b4f8542d4f2014 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5ba expref: 273 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.207962:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065118.207964:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065118.207979:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:1958:x1830881260854912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.207984:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 611 00000100:00100000:0.0:1746065118.208220:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259648512:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065118.208231:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065118.208247:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881260854528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7044us (8331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.208252:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5103 00000100:00100000:0.0:1746065118.208904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.208940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.208991:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260855552 00000100:00100000:1.0:1746065118.208995:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260855552 00002000:00100000:1.0:1746065118.209018:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880093751c00 x1830881260855552/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.209026:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093751c00 with x1830881260855552 ext(3145728->4194303) 00002000:00010000:1.0:1746065118.209030:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093751c00 00000100:00100000:1.0:1746065118.209051:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260855424 00000100:00100000:1.0:1746065118.209054:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260855424 00002000:00100000:1.0:1746065118.209065:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880093752300 x1830881260855424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.209071:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093752300 with x1830881260855424 ext(2097152->3145727) 00002000:00010000:1.0:1746065118.209074:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093752300 00000100:00100000:1.0:1746065118.209084:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4695 00000100:00100000:1.0:1746065118.209090:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881260855552:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065118.210106:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4696 00000100:00100000:1.0:1746065118.210113:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260855424:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:2.0:1746065118.211011:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065118 -> 1746065119 00002000:00010000:2.0:1746065118.211015:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065118 -> 1746065119 00002000:00010000:2.0:1746065118.211017:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065118 -> 1746065119 00000100:00100000:2.0:1746065118.211030:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259648640:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065118.211056:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093368200/0x14b4f8542d4f2022 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c1 expref: 41 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.211067:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093368200/0x14b4f8542d4f2022 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c1 expref: 41 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.211079:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093368200, rc 0) 00000100:00100000:2.0:1746065118.211105:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1958:x1830881260855040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3606us (3713us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065118.211111:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10272 00000100:00100000:1.0:1746065118.222426:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881260855552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13326us (13514us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.222427:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093752300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881260855424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12304us (13476us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.222438:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4696 00000100:00100000:1.0:1746065118.222446:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4695 00002000:00100000:2.0:1746065118.222451:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880093752300 x1830881260855424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.222452:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880093751c00 x1830881260855552/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.222460:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093751c00 with x1830881260855552 ext(3145728->4194303) 00002000:00100000:2.0:1746065118.222465:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093752300 with x1830881260855424 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.222475:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093752300 00002000:00010000:1.0:1746065118.222475:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093751c00 00000100:00100000:0.0:1746065118.227133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.228055:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260855808 00000100:00100000:2.0:1746065118.228065:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260855808 00000100:00100000:2.0:1746065118.228131:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10274 00000100:00100000:2.0:1746065118.228139:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:28786:x1830881260855808:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065118.228154:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.228181:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5cf expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.228207:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.228213:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.228215:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.228218:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 41 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.228242:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.228253:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 23 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.228262:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259648768:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.229105:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.233871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.233919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.233955:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260856320 00000100:00100000:2.0:1746065118.233964:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260856320 00000100:00100000:3.0:1746065118.233991:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260856064 00000100:00100000:3.0:1746065118.233994:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260856064 00002000:00100000:2.0:1746065118.234006:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88008fc5aa00 x1830881260856320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.234015:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5aa00 with x1830881260856320 ext(4194304->4976639) 00000100:00100000:3.0:1746065118.234019:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8933 00002000:00010000:2.0:1746065118.234019:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5aa00 00000100:00100000:3.0:1746065118.234024:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:28788:x1830881260856064:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:2.0:1746065118.234035:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4697 00000100:00100000:2.0:1746065118.234039:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881260856320:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065118.234041:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.234055:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802a00/0x14b4f8542d4f2037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5d6 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.234146:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234156:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234165:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234173:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234178:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234182:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234263:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f803000/0x14b4f8542d4f204c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234270:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f803000/0x14b4f8542d4f204c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234274:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f803000/0x14b4f8542d4f204c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:3.0:1746065118.234280:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065118.234342:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234347:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234351:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234356:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f802c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065118.234358:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234363:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234371:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065118.234383:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065118.234386:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234390:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802c00/0x14b4f8542d4f203e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234407:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234411:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234415:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234418:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f802e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065118.234419:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234422:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234427:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669500) 00010000:00010000:3.0:1746065118.234429:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065118.234431:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234434:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802e00/0x14b4f8542d4f2045 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065118.234460:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f802a00/0x14b4f8542d4f2037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5d6 expref: 275 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.234469:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f803000/0x14b4f8542d4f204c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5d6 expref: 274 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.234475:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065118.234477:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065118.234479:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f803000, rc 0) 00000100:00100000:3.0:1746065118.234513:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:28788:x1830881260856064:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 488us (650us total) trans 8589942970 rc 0/0 00000100:00100000:3.0:1746065118.234519:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8933 00000100:00100000:3.0:1746065118.236672:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259648768:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.236699:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 41 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.236712:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093368600, rc 0) 00000100:00100000:3.0:1746065118.236966:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:28786:x1830881260855808:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8828us (9841us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.236974:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10274 00000100:00100000:0.0:1746065118.240391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.240432:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.240443:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260856448 00000100:00100000:1.0:1746065118.240451:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260856448 00000100:00100000:0.0:1746065118.240475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:1.0:1746065118.240493:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1318912->2097151) req@ffff88009fb11c00 x1830881260856448/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 504/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.240506:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881260856448 ext(1318912->2097151) 00010000:00010000:1.0:1746065118.240515:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 26 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.240527:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 26 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:1.0:1746065118.240532:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb11c00 00000100:00100000:2.0:1746065118.240540:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260856576 00000100:00100000:2.0:1746065118.240545:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260856576 00000100:00100000:1.0:1746065118.240550:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1460 00000100:00100000:1.0:1746065118.240557:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260856448:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065118.240577:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 612 00000100:00100000:2.0:1746065118.240582:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:1960:x1830881260856576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.240591:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.240610:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f803000/0x14b4f8542d4f204c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5d6 expref: 274 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.240626:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065118.240630:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.240662:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:1960:x1830881260856576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.240668:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 612 00000100:00100000:3.0:1746065118.240736:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260856704 00000100:00100000:3.0:1746065118.240739:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260856704 00000100:00100000:3.0:1746065118.240760:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10275 00000100:00100000:3.0:1746065118.240765:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+27:1959:x1830881260856704:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065118.240773:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.240787:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f205a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5dd expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065118.240842:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259648896:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065118.240882:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.242191:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259648896:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065118.242210:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f205a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5dd expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.242225:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f205a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5dd expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.242236:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f803400, rc 0) 00000100:00100000:3.0:1746065118.242268:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881260856704:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1502us (1792us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065118.242273:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10275 00000100:00100000:2.0:1746065118.242297:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881260856320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8256us (8376us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746065118.242306:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4697 00002000:00100000:2.0:1746065118.242313:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88008fc5aa00 x1830881260856320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.242327:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5aa00 with x1830881260856320 ext(4194304->4976639) 00002000:00010000:2.0:1746065118.242331:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5aa00 00000100:00100000:2.0:1746065118.249168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.249242:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260856832 00000100:00100000:3.0:1746065118.249250:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260856832 00000100:00100000:3.0:1746065118.249284:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10276 00000100:00100000:3.0:1746065118.249291:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881260856832:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065118.249305:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.249319:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f803600/0x14b4f8542d4f2061 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5e4 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065118.249363:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259649024:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065118.249446:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.253056:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260856448:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12490us (12673us total) trans 17179872709 rc 0/0 00000100:00100000:1.0:1746065118.253069:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1460 00002000:00100000:1.0:1746065118.253080:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1318912->2097151) req@ffff88009fb11c00 x1830881260856448/t17179872709(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 504/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.253089:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881260856448 ext(1318912->2097151) 00010000:00010000:1.0:1746065118.253098:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 28 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.253113:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 28 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:1.0:1746065118.253119:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb11c00 00000100:00100000:3.0:1746065118.257063:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259649024:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065118.257090:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f803600/0x14b4f8542d4f2061 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5e4 expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.257101:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f803600/0x14b4f8542d4f2061 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5e4 expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.257128:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f803600, rc 0) 00000100:00100000:3.0:1746065118.257168:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881260856832:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7876us (8006us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065118.257175:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10276 00000100:00100000:0.0:1746065118.259811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.259877:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260856960 00000100:00100000:2.0:1746065118.259884:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260856960 00010000:00010000:2.0:1746065118.259915:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 26 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.259920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.259939:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5104 00000100:00100000:2.0:1746065118.259945:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260856960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.259957:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.259974:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 26 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.259984:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 26 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.260003:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cca00/0x14b4f8542d4f1f81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a558 expref: 26 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.260019:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.260021:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.260027:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 40 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.260035:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 40 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.260066:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 40 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.260077:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259649152:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.260145:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.260186:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260857088 00000100:00100000:3.0:1746065118.260190:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260857088 00000100:00100000:3.0:1746065118.260212:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10277 00000100:00100000:3.0:1746065118.260217:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881260857088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065118.260228:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.260238:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5eb expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.260250:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.260252:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.260256:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5eb expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.260267:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5eb expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.260274:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f803800, rc 0) 00000100:00100000:3.0:1746065118.260297:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260857088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 80us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.260303:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10277 00000100:00100000:3.0:1746065118.264418:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259649152:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065118.264441:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065118.264494:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260856960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4548us (4691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.264501:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5104 00000100:00100000:0.0:1746065118.265538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.266247:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260857344 00000100:00100000:1.0:1746065118.266254:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260857344 00002000:00100000:1.0:1746065118.266288:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009ff20e00 x1830881260857344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.266296:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20e00 with x1830881260857344 ext(1048576->2097151) 00002000:00010000:1.0:1746065118.266301:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff20e00 00000100:00100000:1.0:1746065118.266655:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4698 00000100:00100000:1.0:1746065118.266662:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1958:x1830881260857344:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065118.290408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.291444:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260857472 00000100:00100000:3.0:1746065118.291453:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260857472 00000100:00100000:1.0:1746065118.291639:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1958:x1830881260857344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24975us (26101us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065118.291649:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4698 00002000:00100000:1.0:1746065118.291660:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009ff20e00 x1830881260857344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.291668:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20e00 with x1830881260857344 ext(1048576->2097151) 00002000:00010000:1.0:1746065118.291673:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff20e00 00000100:00100000:3.0:1746065118.292012:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10278 00000100:00100000:3.0:1746065118.292021:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28788:x1830881260857472:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065118.292035:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1746065118.292641:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746065118.292781:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5f2 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.292805:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.292813:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a589 expref: 25 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.292843:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.292844:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.292848:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2723840->3145727] (req 2723840->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.292873:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a589 expref: 25 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.292884:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a589 expref: 25 pid: 8851 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065118.292895:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259649280:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.293777:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.293785:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 32 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065118.293794:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259649408:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.293905:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.296626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.297073:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259649280:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.297575:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259649408:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.297600:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2723840->3145727] (req 2723840->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.297614:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f803a00, rc 0) 00000100:00100000:3.0:1746065118.297647:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28788:x1830881260857472:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5629us (7275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.297654:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10278 00000100:00100000:2.0:1746065118.298011:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260857600 00000100:00100000:2.0:1746065118.298019:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260857600 00010000:00010000:2.0:1746065118.298044:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a589 expref: 26 pid: 8851 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746065118.298073:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5105 00000100:00100000:2.0:1746065118.298080:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881260857600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.298090:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.298106:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a589 expref: 26 pid: 8851 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.298114:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a589 expref: 26 pid: 8851 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.298136:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350dfa00/0x14b4f8542d4f1fb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a589 expref: 26 pid: 8851 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.298156:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.298179:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881260857600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 100us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.298185:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5105 00000100:00100000:0.0:1746065118.299764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.300147:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260857728 00000100:00100000:2.0:1746065118.300152:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260857728 00010000:00010000:2.0:1746065118.300171:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 32 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.300186:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5106 00000100:00100000:2.0:1746065118.300191:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260857728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.300199:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.300210:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 32 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.300219:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 32 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.300233:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f75b400/0x14b4f8542d4f1f73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a54a expref: 32 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.300243:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.300245:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.300250:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.300257:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.300284:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.300296:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259649536:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.300371:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.300549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.300612:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260857856 00000100:00100000:3.0:1746065118.300615:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260857856 00000100:00100000:3.0:1746065118.300644:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10279 00000100:00100000:3.0:1746065118.300650:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+25:28791:x1830881260857856:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065118.300661:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.300671:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a5f9 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065118.300689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.300707:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260858112 00000100:00100000:1.0:1746065118.300712:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260858112 00002000:00100000:1.0:1746065118.300736:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ff21f80 x1830881260858112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.300745:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21f80 with x1830881260858112 ext(2097152->3145727) 00002000:00010000:1.0:1746065118.300748:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff21f80 00000100:00100000:1.0:1746065118.300770:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4699 00000100:00100000:1.0:1746065118.300776:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1959:x1830881260858112:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065118.300802:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.300808:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065118.300809:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065118.300812:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3067904->3145727] (req 3067904->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.300850:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.300860:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 31 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065118.300867:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259649664:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.300892:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.302836:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259649664:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.302860:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3067904->3145727] (req 3067904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.302872:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f803600, rc 0) 00000100:00100000:3.0:1746065118.302898:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+26:28791:x1830881260857856:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2247us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.302904:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10279 00000100:00100000:2.0:1746065118.302991:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259649536:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.303003:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.303021:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881260857728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2829us (3259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.303028:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5106 00000100:00100000:0.0:1746065118.305392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.305438:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260858368 00000100:00100000:2.0:1746065118.305445:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260858368 00002000:00100000:2.0:1746065118.305477:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2723840->3145727) req@ffff88009ff22300 x1830881260858368/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.305485:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff22300 with x1830881260858368 ext(2723840->3145727) 00010000:00010000:2.0:1746065118.305492:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 31 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.305504:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 31 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065118.305510:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff22300 00000100:00100000:2.0:1746065118.305535:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1461 00000100:00100000:2.0:1746065118.305543:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881260858368:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065118.307909:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1959:x1830881260858112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7125us (7214us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065118.307919:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4699 00002000:00100000:1.0:1746065118.307929:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ff21f80 x1830881260858112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.307938:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21f80 with x1830881260858112 ext(2097152->3145727) 00002000:00010000:1.0:1746065118.307947:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff21f80 00000100:00100000:2.0:1746065118.310055:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260858368:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4506us (4662us total) trans 21474839947 rc 0/0 00000100:00100000:2.0:1746065118.310069:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1461 00002000:00100000:2.0:1746065118.310078:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2723840->3145727) req@ffff88009ff22300 x1830881260858368/t21474839947(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.310086:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff22300 with x1830881260858368 ext(2723840->3145727) 00010000:00010000:2.0:1746065118.310095:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 33 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.310109:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 33 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065118.310116:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff22300 00000100:00100000:0.0:1746065118.311913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.312158:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260858496 00000100:00100000:0.0:1746065118.312163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.312165:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260858496 00000100:00100000:2.0:1746065118.312209:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260858624 00000100:00100000:2.0:1746065118.312212:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260858624 00000100:00100000:0.0:1746065118.312231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065118.312236:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 34 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.312264:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5107 00000100:00100000:2.0:1746065118.312271:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881260858624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.312281:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065118.312294:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065118 -> 1746065119 00002000:00010000:2.0:1746065118.312297:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065118 -> 1746065119 00000100:00100000:1.0:1746065118.312298:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260858752 00000100:00100000:1.0:1746065118.312301:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260858752 00010000:00010000:2.0:1746065118.312302:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 34 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.312311:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 34 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065118.312322:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10280 00000100:00100000:1.0:1746065118.312326:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:28788:x1830881260858752:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065118.312330:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f803a00/0x14b4f8542d4f206f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2723840->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f2 expref: 34 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.312337:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.312347:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a607 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.312351:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.312353:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.312358:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.312362:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.312365:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.312369:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c8 expref: 42 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065118.312385:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.312385:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.312388:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3260415] (req 3145728->3260415) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 42 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.312398:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.312401:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c8 expref: 42 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065118.312407:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259649792:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065118.312410:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c8 expref: 42 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:1.0:1746065118.312416:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259649920:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.312565:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10281 00000100:00100000:3.0:1746065118.312570:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28786:x1830881260858496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065118.312577:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.312583:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a600 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.312594:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.312598:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065118.312599:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065118.312601:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.312613:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.312619:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 25 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065118.312625:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259650048:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065118.312989:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.312997:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 25 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065118.313005:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259650176:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.313027:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.313155:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.313155:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.315054:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259650048:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.315074:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.315090:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f803400, rc 0) 00000100:00100000:3.0:1746065118.315127:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:28786:x1830881260858496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2555us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.315128:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259649920:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.315134:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10281 00000100:00100000:1.0:1746065118.315136:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259650176:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065118.315152:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3260415] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 42 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.315160:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1c200, rc 0) 00000100:00100000:1.0:1746065118.315174:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:28788:x1830881260858752:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2847us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.315178:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10280 00000100:00100000:2.0:1746065118.315204:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259649792:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.315216:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.315231:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260858624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2961us (3068us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.315237:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5107 00000100:00100000:0.0:1746065118.315865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.316204:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260858880 00000100:00100000:2.0:1746065118.316210:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260858880 00010000:00010000:2.0:1746065118.316263:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c8 expref: 42 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746065118.316295:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5108 00000100:00100000:2.0:1746065118.316302:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1960:x1830881260858880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065118.316385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.316423:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260859136 00000100:00100000:3.0:1746065118.316427:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260859136 00010000:00010000:2.0:1746065118.316437:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746065118.316451:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3067904->3071999) req@ffff880094244700 x1830881260859136/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746065118.316455:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c8 expref: 42 pid: 4544 timeout: 817 lvb_type: 1 00002000:00100000:3.0:1746065118.316459:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244700 with x1830881260859136 ext(3067904->3071999) 00010000:00010000:3.0:1746065118.316464:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 26 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.316464:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c8 expref: 42 pid: 4544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746065118.316472:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 26 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.316476:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094244700 00010000:00010000:2.0:1746065118.316479:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1d400/0x14b4f8542d4f2029 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5c8 expref: 42 pid: 4544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.316489:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065118.316499:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1462 00000100:00100000:3.0:1746065118.316504:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260859136:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065118.316753:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881260858880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 451us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.316759:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5108 00000100:00100000:3.0:1746065118.317042:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260859136:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 537us (656us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065118.317048:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1462 00002000:00100000:3.0:1746065118.317053:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3067904->3071999) req@ffff880094244700 x1830881260859136/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.317064:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244700 with x1830881260859136 ext(3067904->3071999) 00010000:00010000:3.0:1746065118.317069:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 26 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.317076:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 26 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.317082:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094244700 00000100:00100000:0.0:1746065118.318685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.318740:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260859520 00000100:00100000:1.0:1746065118.318745:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260859520 00000100:00100000:1.0:1746065118.318783:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10282 00000100:00100000:1.0:1746065118.318792:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:28791:x1830881260859520:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065118.318808:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.318903:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a60e expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.318924:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.318929:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3260415] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 40 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.318934:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065118.318937:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.318972:0:4544:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3260415] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 40 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.318982:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.318990:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1c800, rc 0) 00000100:00100000:1.0:1746065118.319285:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+27:28791:x1830881260859520:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 491us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.319291:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10282 00000100:00100000:0.0:1746065118.319988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.320021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.320077:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260859392 00000100:00100000:2.0:1746065118.320077:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260859648 00000100:00100000:3.0:1746065118.320081:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260859392 00000100:00100000:2.0:1746065118.320081:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260859648 00010000:00010000:2.0:1746065118.320097:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 27 pid: 4544 timeout: 817 lvb_type: 0 00002000:00100000:3.0:1746065118.320102:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3067904->3145727) req@ffff88009ff23480 x1830881260859392/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.320109:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff23480 with x1830881260859392 ext(3067904->3145727) 00010000:00010000:3.0:1746065118.320115:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 26 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.320124:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 26 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.320125:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5109 00002000:00010000:3.0:1746065118.320129:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff23480 00000100:00100000:2.0:1746065118.320131:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881260859648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.320139:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.320154:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 27 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.320163:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 27 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065118.320210:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1463 00000100:00100000:3.0:1746065118.320215:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881260859392:12345-192.168.202.46@tcp:4:multiop.0 00010000:00010000:2.0:1746065118.320249:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1de00/0x14b4f8542d4f1ff8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5b3 expref: 27 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.320259:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.320260:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.320265:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 40 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.320272:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 40 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.320291:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 40 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.320299:0:7078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 40 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.320308:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259650432:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.320555:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.321776:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260859392:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 1557us (1785us total) trans 21474839948 rc 0/0 00000100:00100000:3.0:1746065118.321787:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1463 00002000:00100000:3.0:1746065118.321793:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3067904->3145727) req@ffff88009ff23480 x1830881260859392/t21474839948(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.321801:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff23480 with x1830881260859392 ext(3067904->3145727) 00010000:00010000:3.0:1746065118.321806:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 28 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.321833:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 28 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.321839:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff23480 00000100:00100000:2.0:1746065118.322293:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259650432:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.322309:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.322367:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260859648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2236us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.322383:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5109 00000100:00100000:0.0:1746065118.322531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.322652:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260859904 00000100:00100000:3.0:1746065118.322657:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260859904 00002000:00100000:3.0:1746065118.322677:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3256320->3260415) req@ffff88009ff23b80 x1830881260859904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.322684:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff23b80 with x1830881260859904 ext(3256320->3260415) 00010000:00010000:3.0:1746065118.322688:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 41 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.322697:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 41 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.322702:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff23b80 00000100:00100000:3.0:1746065118.322786:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1464 00000100:00100000:3.0:1746065118.322792:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881260859904:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065118.323034:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881260859904:12345-192.168.202.46@tcp:3:cat.0 Request processed in 240us (501us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065118.323040:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1464 00002000:00100000:3.0:1746065118.323044:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3256320->3260415) req@ffff88009ff23b80 x1830881260859904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.323051:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff23b80 with x1830881260859904 ext(3256320->3260415) 00010000:00010000:3.0:1746065118.323056:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 41 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.323063:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 41 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.323069:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff23b80 00000100:00100000:2.0:1746065118.323370:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.323428:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260860032 00000100:00100000:0.0:1746065118.323432:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260860032 00010000:00010000:0.0:1746065118.323446:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 28 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.323472:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5110 00000100:00100000:0.0:1746065118.323478:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881260860032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065118.323485:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065118.323498:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 28 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.323507:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 28 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.323523:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f803600/0x14b4f8542d4f2076 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3067904->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5f9 expref: 28 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746065118.323536:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.323537:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.323543:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.323550:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.323569:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065118.323578:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259650560:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065118.323618:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065118.326351:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259650560:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.326367:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.326411:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1959:x1830881260860032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2932us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.326420:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5110 00000100:00100000:0.0:1746065118.327382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.327439:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260860288 00000100:00100000:3.0:1746065118.327444:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260860288 00002000:00100000:3.0:1746065118.327473:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009ff20700 x1830881260860288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.327481:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20700 with x1830881260860288 ext(2097152->3145727) 00002000:00010000:3.0:1746065118.327485:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff20700 00000100:00100000:3.0:1746065118.327510:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4700 00000100:00100000:3.0:1746065118.327516:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260860288:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065118.328219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.328288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.328388:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260860544 00000100:00100000:1.0:1746065118.328393:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260860544 00002000:00100000:1.0:1746065118.328413:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3260415) req@ffff88009ff21500 x1830881260860544/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.328419:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21500 with x1830881260860544 ext(3145728->3260415) 00010000:00010000:1.0:1746065118.328426:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 41 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.328437:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 41 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:1.0:1746065118.328442:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff21500 00000100:00100000:1.0:1746065118.328453:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1465 00000100:00100000:1.0:1746065118.328458:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881260860544:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065118.328646:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260860800 00000100:00100000:2.0:1746065118.328650:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260860800 00000100:00100000:2.0:1746065118.328672:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3626 00000100:00100000:2.0:1746065118.328677:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:28788:x1830881260860800:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065118.328837:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:28788:x1830881260860800:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 159us (548us total) trans 8589942971 rc 0/0 00000100:00100000:2.0:1746065118.328843:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3626 00000100:00100000:1.0:1746065118.335065:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881260860544:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6597us (6838us total) trans 17179872710 rc 0/0 00000100:00100000:1.0:1746065118.335075:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1465 00002000:00100000:1.0:1746065118.335085:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3260415) req@ffff88009ff21500 x1830881260860544/t17179872710(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.335093:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21500 with x1830881260860544 ext(3145728->3260415) 00010000:00010000:1.0:1746065118.335102:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 43 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.335114:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 43 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:1.0:1746065118.335120:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff21500 00000100:00100000:3.0:1746065118.336283:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260860288:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8763us (8910us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065118.336289:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4700 00002000:00100000:3.0:1746065118.336294:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009ff20700 x1830881260860288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.336299:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20700 with x1830881260860288 ext(2097152->3145727) 00002000:00010000:3.0:1746065118.336301:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff20700 00000100:00100000:0.0:1746065118.336871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.336921:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260860928 00000100:00100000:2.0:1746065118.336927:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260860928 00010000:00010000:2.0:1746065118.336950:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 43 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.336968:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5111 00000100:00100000:2.0:1746065118.336974:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260860928:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.336985:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.336998:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 43 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.337011:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 43 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.337028:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f207d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a607 expref: 43 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.337054:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.337056:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.337062:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.337067:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.337089:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.337096:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259650688:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.337147:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.340198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.340238:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260861056 00000100:00100000:1.0:1746065118.340246:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260861056 00000100:00100000:1.0:1746065118.340288:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10283 00000100:00100000:1.0:1746065118.340297:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:28786:x1830881260861056:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065118.340312:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.340330:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a615 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.340354:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.340361:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065118.340363:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065118.340366:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 44 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.340403:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.340414:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 25 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065118.340424:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259650816:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065118.340480:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065118.340485:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259650688:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.340499:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.340517:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881260860928:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3543us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.340525:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5111 00000100:00100000:1.0:1746065118.341530:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259650816:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065118.341546:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 43 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.341556:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1c200, rc 0) 00000100:00100000:1.0:1746065118.341574:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:28786:x1830881260861056:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1279us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.341579:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10283 00000100:00100000:0.0:1746065118.343088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.343142:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260861312 00000100:00100000:3.0:1746065118.343148:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260861312 00002000:00100000:3.0:1746065118.343177:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3416064->3420159) req@ffff880131b08000 x1830881260861312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.343186:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b08000 with x1830881260861312 ext(3416064->3420159) 00010000:00010000:3.0:1746065118.343193:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 26 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.343205:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 26 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.343212:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131b08000 00000100:00100000:3.0:1746065118.343240:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1466 00000100:00100000:3.0:1746065118.343246:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260861312:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065118.343505:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260861312:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 257us (417us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065118.343510:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1466 00002000:00100000:3.0:1746065118.343515:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3416064->3420159) req@ffff880131b08000 x1830881260861312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.343523:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b08000 with x1830881260861312 ext(3416064->3420159) 00010000:00010000:3.0:1746065118.343527:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 26 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.343536:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 26 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.343542:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131b08000 00000100:00100000:0.0:1746065118.345792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.345846:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260861568 00000100:00100000:3.0:1746065118.345863:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260861568 00002000:00100000:3.0:1746065118.345893:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3420159) req@ffff88009a0c9450 x1830881260861568/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.345901:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0c9450 with x1830881260861568 ext(3145728->3420159) 00010000:00010000:3.0:1746065118.345907:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 26 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.345919:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 26 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.345925:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a0c9450 00000100:00100000:3.0:1746065118.345961:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1467 00000100:00100000:3.0:1746065118.345968:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260861568:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065118.350251:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260861568:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 4277us (4457us total) trans 17179872711 rc 0/0 00000100:00100000:3.0:1746065118.350262:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1467 00002000:00100000:3.0:1746065118.350271:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3420159) req@ffff88009a0c9450 x1830881260861568/t17179872711(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.350280:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0c9450 with x1830881260861568 ext(3145728->3420159) 00010000:00010000:3.0:1746065118.350288:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 28 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.350301:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 28 pid: 4544 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.350308:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a0c9450 00000100:00100000:0.0:1746065118.351758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.351810:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260861696 00000100:00100000:2.0:1746065118.351833:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260861696 00010000:00010000:2.0:1746065118.351858:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 28 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.351895:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5112 00000100:00100000:2.0:1746065118.351901:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260861696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.351912:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.351926:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 28 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.351935:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 28 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.351952:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c800/0x14b4f8542d4f208b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a60e expref: 28 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.351977:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.351979:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.351996:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 42 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.352004:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 42 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.352033:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 42 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.352042:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259650944:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.352105:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065118.354178:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259650944:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.354196:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.354236:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881260861696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2334us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.354244:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5112 00000100:00100000:0.0:1746065118.356777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.356835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.356855:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260862080 00000100:00100000:3.0:1746065118.356863:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260862080 00000100:00100000:1.0:1746065118.356906:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260862208 00000100:00100000:1.0:1746065118.356910:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260862208 00002000:00100000:1.0:1746065118.356945:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880131b08a80 x1830881260862208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.356954:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b08a80 with x1830881260862208 ext(3145728->4194303) 00002000:00010000:1.0:1746065118.356959:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b08a80 00000100:00100000:1.0:1746065118.356981:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4701 00000100:00100000:1.0:1746065118.356989:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260862208:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065118.357042:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880131b08700 x1830881260862080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.357052:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b08700 with x1830881260862080 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.357055:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b08700 00000100:00100000:3.0:1746065118.357073:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4702 00000100:00100000:3.0:1746065118.357078:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260862080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.366731:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260862080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9644us (9949us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.366741:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4702 00002000:00100000:2.0:1746065118.366751:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880131b08700 x1830881260862080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.366760:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b08700 with x1830881260862080 ext(3145728->4194303) 00002000:00010000:2.0:1746065118.366765:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b08700 00000100:00100000:1.0:1746065118.366871:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260862208:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9882us (10055us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065118.366878:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4701 00002000:00100000:1.0:1746065118.366884:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880131b08a80 x1830881260862208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.366891:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b08a80 with x1830881260862208 ext(3145728->4194303) 00002000:00010000:1.0:1746065118.366894:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b08a80 00000100:00100000:0.0:1746065118.373699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.373800:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260862464 00000100:00100000:1.0:1746065118.373807:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260862464 00002000:00100000:1.0:1746065118.373868:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880131b08e00 x1830881260862464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.373876:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b08e00 with x1830881260862464 ext(4194304->4976639) 00002000:00010000:1.0:1746065118.373881:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b08e00 00000100:00100000:1.0:1746065118.374173:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4703 00000100:00100000:1.0:1746065118.374181:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1959:x1830881260862464:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065118.387739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.387791:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260862592 00000100:00100000:0.0:1746065118.387799:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260862592 00000100:00100000:1.0:1746065118.387837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.388060:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1959:x1830881260862464:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13878us (14366us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746065118.388069:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4703 00002000:00100000:2.0:1746065118.388078:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880131b08e00 x1830881260862464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.388087:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b08e00 with x1830881260862464 ext(4194304->4976639) 00002000:00010000:2.0:1746065118.388091:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b08e00 00000100:00100000:0.0:1746065118.388192:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260862720 00000100:00100000:0.0:1746065118.388195:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260862720 00000100:00100000:0.0:1746065118.388213:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10284 00000100:00100000:0.0:1746065118.388219:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881260862592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065118.388232:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.388247:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a61c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.388264:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.388266:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.388272:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a61c expref: 28 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065118.388285:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a61c expref: 28 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065118.388293:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00dac00, rc 0) 00000100:00100000:0.0:1746065118.388325:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260862592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 106us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.388330:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10284 00000100:00100000:0.0:1746065118.388345:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10285 00000100:00100000:0.0:1746065118.388499:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881260862720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065118.388507:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.388515:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a623 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.388525:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.388527:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.388531:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a623 expref: 28 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065118.388540:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a623 expref: 28 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065118.388546:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00da800, rc 0) 00000100:00100000:0.0:1746065118.388576:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260862720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 78us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.388581:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10285 00000100:00100000:0.0:1746065118.399606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.399942:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260862976 00000100:00100000:1.0:1746065118.399949:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260862976 00000100:00100000:1.0:1746065118.400000:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3627 00000100:00100000:1.0:1746065118.400007:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:28786:x1830881260862976:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065118.400194:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:28786:x1830881260862976:12345-192.168.202.46@tcp:35:cat.0 Request processed in 187us (596us total) trans 8589942972 rc 0/0 00000100:00100000:1.0:1746065118.400204:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3627 00000100:00100000:2.0:1746065118.404572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.404653:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260863232 00000100:00100000:0.0:1746065118.404662:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260863232 00002000:00100000:0.0:1746065118.404699:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094ad6d80 x1830881260863232/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.404709:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad6d80 with x1830881260863232 ext(1048576->2097151) 00002000:00010000:0.0:1746065118.404714:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad6d80 00000100:00100000:0.0:1746065118.405072:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4704 00000100:00100000:0.0:1746065118.405080:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260863232:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.410710:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881260863232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5623us (6141us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.410721:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4704 00002000:00100000:2.0:1746065118.410730:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094ad6d80 x1830881260863232/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.410739:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad6d80 with x1830881260863232 ext(1048576->2097151) 00002000:00010000:2.0:1746065118.410744:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad6d80 00000100:00100000:0.0:1746065118.425148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.425186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.425216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.425245:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260863744 00000100:00100000:3.0:1746065118.425252:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260863744 00000100:00100000:0.0:1746065118.425264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065118.425287:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880131b09500 x1830881260863744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.425296:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b09500 with x1830881260863744 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.425301:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b09500 00000100:00100000:0.0:1746065118.425301:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260863616 00000100:00100000:0.0:1746065118.425304:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260863616 00000100:00100000:3.0:1746065118.425313:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260864000 00000100:00100000:3.0:1746065118.425315:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260864000 00002000:00100000:0.0:1746065118.425320:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880131b09880 x1830881260863616/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.425325:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880131b09c00 x1830881260864000/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.425328:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b09880 with x1830881260863616 ext(2097152->3145727) 00002000:00100000:3.0:1746065118.425331:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b09c00 with x1830881260864000 ext(2097152->3145727) 00002000:00010000:0.0:1746065118.425331:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b09880 00002000:00010000:3.0:1746065118.425334:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b09c00 00000100:00100000:0.0:1746065118.425341:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260864128 00000100:00100000:0.0:1746065118.425343:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260864128 00000100:00100000:3.0:1746065118.425350:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4705 00002000:00100000:0.0:1746065118.425353:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880131b09f80 x1830881260864128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065118.425356:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+29:1959:x1830881260863744:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:0.0:1746065118.425359:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b09f80 with x1830881260864128 ext(3145728->4194303) 00002000:00010000:0.0:1746065118.425362:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b09f80 00000100:00100000:0.0:1746065118.425385:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4706 00000100:00100000:0.0:1746065118.425391:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+29:1959:x1830881260863616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065118.425451:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4707 00000100:00100000:0.0:1746065118.425456:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+29:1959:x1830881260864000:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.425722:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4708 00000100:00100000:2.0:1746065118.425732:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+29:1959:x1830881260864128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.446555:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260863744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21190us (21407us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.446565:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4705 00002000:00100000:2.0:1746065118.446577:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880131b09500 x1830881260863744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.446586:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b09500 with x1830881260863744 ext(3145728->4194303) 00002000:00010000:2.0:1746065118.446591:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b09500 00000100:00100000:2.0:1746065118.457208:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260864000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31742us (31981us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.457219:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4707 00002000:00100000:2.0:1746065118.457230:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880131b09c00 x1830881260864000/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.457238:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b09c00 with x1830881260864000 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.457243:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b09c00 00000100:00100000:0.0:1746065118.467331:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881260863616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 41933us (42136us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065118.467342:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4706 00002000:00100000:0.0:1746065118.467351:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880131b09880 x1830881260863616/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.467360:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b09880 with x1830881260863616 ext(2097152->3145727) 00002000:00010000:0.0:1746065118.467364:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b09880 00000100:00100000:3.0:1746065118.467431:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881260864128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 41700us (42164us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065118.467438:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4708 00002000:00100000:3.0:1746065118.467443:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880131b09f80 x1830881260864128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.467450:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b09f80 with x1830881260864128 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.467453:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b09f80 00000100:00100000:2.0:1746065118.467604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.467847:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260864512 00000100:00100000:0.0:1746065118.467854:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260864512 00000100:00100000:0.0:1746065118.467884:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8934 00000100:00100000:0.0:1746065118.467890:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:28799:x1830881260864512:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065118.467907:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.467921:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f20a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a62a expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.468000:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468010:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468018:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468028:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468033:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468038:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468115:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dba00/0x14b4f8542d4f20bc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468125:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dba00/0x14b4f8542d4f20bc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468130:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dba00/0x14b4f8542d4f20bc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065118.468136:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:0.0:1746065118.468192:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468198:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468202:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468206:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00dbe00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065118.468209:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468214:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468221:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065118.468223:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065118.468225:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468229:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbe00/0x14b4f8542d4f20ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468252:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468259:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468263:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468266:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00dbc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065118.468268:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468271:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468276:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800938f6200) 00010000:00010000:0.0:1746065118.468277:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065118.468279:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468282:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dbc00/0x14b4f8542d4f20b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065118.468305:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f20a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a62a expref: 278 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.468313:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dba00/0x14b4f8542d4f20bc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a62a expref: 277 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.468317:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065118.468319:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065118.468321:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00dba00, rc 0) 00000100:00100000:0.0:1746065118.468349:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:28799:x1830881260864512:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 460us (749us total) trans 8589942973 rc 0/0 00000100:00100000:0.0:1746065118.468355:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8934 00000100:00100000:0.0:1746065118.475896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.476275:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260864640 00000100:00100000:2.0:1746065118.476284:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260864640 00000100:00100000:2.0:1746065118.476352:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 613 00000100:00100000:2.0:1746065118.476365:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:1959:x1830881260864640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.476392:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.476418:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00dba00/0x14b4f8542d4f20bc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a62a expref: 277 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.477980:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065118.477986:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065118.478600:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:1959:x1830881260864640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2236us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.478611:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 613 00000100:00100000:0.0:1746065118.479894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.479995:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260864896 00000100:00100000:1.0:1746065118.480003:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260864896 00002000:00100000:1.0:1746065118.480043:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880131b0a680 x1830881260864896/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.480053:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0a680 with x1830881260864896 ext(4194304->4976639) 00002000:00010000:1.0:1746065118.480058:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b0a680 00000100:00100000:1.0:1746065118.480630:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4709 00000100:00100000:1.0:1746065118.480641:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260864896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065118.488220:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260864896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7570us (8318us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746065118.488231:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4709 00002000:00100000:1.0:1746065118.488244:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880131b0a680 x1830881260864896/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.488254:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0a680 with x1830881260864896 ext(4194304->4976639) 00002000:00010000:1.0:1746065118.488259:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b0a680 00000100:00100000:0.0:1746065118.532412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.532479:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260865024 00000100:00100000:3.0:1746065118.532487:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260865024 00000100:00100000:3.0:1746065118.532535:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10286 00000100:00100000:3.0:1746065118.532543:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:28799:x1830881260865024:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065118.532557:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.532571:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a631 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.532596:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.532603:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5eb expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.532609:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.532611:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.532614:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.532640:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5eb expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.532657:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5eb expref: 27 pid: 21998 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065118.532667:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651072:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.533318:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.533326:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 44 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065118.533334:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651200:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.533703:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.536077:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651072:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.537515:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651200:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.537790:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.537810:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c5400, rc 0) 00000100:00100000:3.0:1746065118.538126:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:28799:x1830881260865024:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5581us (5719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.538133:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10286 00000100:00100000:3.0:1746065118.538191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.540958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.541100:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260865280 00000100:00100000:1.0:1746065118.541107:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260865280 00000100:00100000:1.0:1746065118.541170:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8935 00000100:00100000:1.0:1746065118.541178:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:28805:x1830881260865280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065118.541950:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.541975:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1de00/0x14b4f8542d4f20d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a638 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.542100:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542110:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542118:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542129:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542134:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542138:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542232:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1dc00/0x14b4f8542d4f20e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542239:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1dc00/0x14b4f8542d4f20e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542244:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1dc00/0x14b4f8542d4f20e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065118.542252:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065118.542313:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542319:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542327:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542331:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb1d400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065118.542334:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542339:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542346:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065118.542348:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065118.542352:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542356:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d400/0x14b4f8542d4f20d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542381:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542386:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542391:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542395:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb1d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065118.542396:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542401:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542409:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f49f500) 00010000:00010000:1.0:1746065118.542411:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065118.542413:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542417:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1d200/0x14b4f8542d4f20df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065118.542459:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1de00/0x14b4f8542d4f20d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a638 expref: 279 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.542468:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1dc00/0x14b4f8542d4f20e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a638 expref: 278 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.542473:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065118.542475:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065118.542477:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb1dc00, rc 0) 00000100:00100000:1.0:1746065118.542518:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:28805:x1830881260865280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1340us (1565us total) trans 8589942974 rc 0/0 00000100:00100000:1.0:1746065118.542524:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8935 00000100:00100000:2.0:1746065118.543209:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260865408 00000100:00100000:2.0:1746065118.543214:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260865408 00010000:00010000:2.0:1746065118.543238:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 44 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.543267:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5113 00000100:00100000:2.0:1746065118.543273:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881260865408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.543281:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.543307:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 44 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.543315:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 44 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.543328:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0x14b4f8542d4f2030 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5cf expref: 44 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.543357:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.543397:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260865408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 124us (5205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.543405:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5113 00000100:00100000:0.0:1746065118.545809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.545933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.545998:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260865536 00000100:00100000:2.0:1746065118.546005:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260865536 00010000:00010000:2.0:1746065118.546032:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5eb expref: 28 pid: 21998 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746065118.546061:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5114 00000100:00100000:2.0:1746065118.546067:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260865536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.546079:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.546094:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5eb expref: 28 pid: 21998 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.546102:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5eb expref: 28 pid: 21998 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.546117:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f2068 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a5eb expref: 28 pid: 21998 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.546128:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.546130:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.546136:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 42 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.546142:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 42 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.546169:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 42 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.546181:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259651328:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.546250:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.546904:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260865664 00000100:00100000:3.0:1746065118.546908:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260865664 00000100:00100000:3.0:1746065118.546931:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10287 00000100:00100000:3.0:1746065118.546936:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260865664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065118.546948:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.546958:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5c00/0x14b4f8542d4f20f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a63f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065118.546983:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651456:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065118.547016:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.548773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.548936:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260865792 00000100:00100000:1.0:1746065118.548942:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260865792 00000100:00100000:1.0:1746065118.548989:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 614 00000100:00100000:1.0:1746065118.548996:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:1960:x1830881260865792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.549133:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065118.549153:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb1dc00/0x14b4f8542d4f20e6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a638 expref: 278 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.549173:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065118.549176:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.549204:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:1960:x1830881260865792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 208us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.549577:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 614 00000100:00100000:2.0:1746065118.553844:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.554019:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651456:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065118.554044:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5c00/0x14b4f8542d4f20f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a63f expref: 44 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.554057:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5c00/0x14b4f8542d4f20f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a63f expref: 44 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.554069:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c5c00, rc 0) 00000100:00100000:3.0:1746065118.554104:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260865664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7167us (8170us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065118.554112:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10287 00000100:00100000:0.0:1746065118.554195:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259651328:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065118.554208:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065118.554225:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881260865536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8158us (8423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.554232:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5114 00000100:00100000:1.0:1746065118.554316:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260866048 00000100:00100000:1.0:1746065118.554322:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260866048 00002000:00100000:1.0:1746065118.554350:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1896448->1900543) req@ffff880094ad4700 x1830881260866048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.554358:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad4700 with x1830881260866048 ext(1896448->1900543) 00002000:00010000:1.0:1746065118.554361:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad4700 00000100:00100000:1.0:1746065118.554386:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4710 00000100:00100000:1.0:1746065118.554392:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881260866048:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065118.554534:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881260866048:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 142us (718us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065118.554540:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4710 00002000:00100000:1.0:1746065118.554544:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1896448->1900543) req@ffff880094ad4700 x1830881260866048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.554552:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad4700 with x1830881260866048 ext(1896448->1900543) 00002000:00010000:1.0:1746065118.554554:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad4700 00000100:00100000:0.0:1746065118.561295:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.561395:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260866176 00000100:00100000:3.0:1746065118.561403:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260866176 00000100:00100000:3.0:1746065118.561440:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10288 00000100:00100000:3.0:1746065118.561447:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:28799:x1830881260866176:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065118.561462:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.561479:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a646 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.561506:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 44 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.561514:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a61c expref: 26 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.561520:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.561521:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.561524:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.561549:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a61c expref: 26 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.561559:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a61c expref: 26 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065118.561570:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651584:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.562248:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 44 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.562257:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 44 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065118.562265:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651712:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.562953:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.565245:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651584:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.565256:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259651712:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.565327:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.565342:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c5a00, rc 0) 00000100:00100000:3.0:1746065118.565734:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:28799:x1830881260866176:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4284us (4444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.565742:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10288 00000100:00100000:0.0:1746065118.573577:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.573837:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260866304 00000100:00100000:2.0:1746065118.573844:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260866304 00010000:00010000:2.0:1746065118.573874:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a61c expref: 27 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746065118.573910:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5115 00000100:00100000:2.0:1746065118.573918:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881260866304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.573929:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065118.574010:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.574884:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260866560 00000100:00100000:3.0:1746065118.574889:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260866560 00002000:00100000:3.0:1746065118.574916:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1896447) req@ffff880131b0b800 x1830881260866560/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.574924:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0b800 with x1830881260866560 ext(1048576->1896447) 00002000:00010000:3.0:1746065118.574928:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b0b800 00000100:00100000:3.0:1746065118.574947:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4711 00000100:00100000:3.0:1746065118.574951:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881260866560:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065118.576707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065118.576909:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a61c expref: 27 pid: 4544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.576928:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a61c expref: 27 pid: 4544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.576946:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00dac00/0x14b4f8542d4f2099 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a61c expref: 27 pid: 4544 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746065118.576963:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.576992:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881260866304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3074us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.577000:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5115 00000100:00100000:2.0:1746065118.577020:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260866688 00000100:00100000:2.0:1746065118.577025:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260866688 00010000:00010000:2.0:1746065118.577042:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 46 pid: 4544 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.577065:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5116 00000100:00100000:2.0:1746065118.577071:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881260866688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.577080:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.577096:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 46 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.577178:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 46 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.577189:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb1c200/0x14b4f8542d4f2092 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a615 expref: 46 pid: 4544 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.577200:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.577201:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.577207:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.577214:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.577242:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.577252:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259651840:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.577301:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.581891:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259651840:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065118.581929:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.581989:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881260866688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4914us (5283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.582008:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5116 00000100:00100000:3.0:1746065118.582712:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881260866560:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7758us (8700us total) trans 0 rc 847872/847872 00000100:00100000:3.0:1746065118.582720:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4711 00002000:00100000:3.0:1746065118.582728:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1896447) req@ffff880131b0b800 x1830881260866560/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 847872/847872 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.582736:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0b800 with x1830881260866560 ext(1048576->1896447) 00002000:00010000:3.0:1746065118.582740:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b0b800 00000100:00100000:1.0:1746065118.583189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.583326:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260866944 00000100:00100000:3.0:1746065118.583332:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260866944 00002000:00100000:3.0:1746065118.583355:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2453504->2457599) req@ffff880094244e00 x1830881260866944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.583543:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244e00 with x1830881260866944 ext(2453504->2457599) 00002000:00010000:3.0:1746065118.583547:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094244e00 00000100:00100000:3.0:1746065118.583560:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4712 00000100:00100000:3.0:1746065118.583566:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260866944:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065118.584737:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260866944:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1000us (1379us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065118.584745:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4712 00002000:00100000:3.0:1746065118.584751:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2453504->2457599) req@ffff880094244e00 x1830881260866944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.584758:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244e00 with x1830881260866944 ext(2453504->2457599) 00002000:00010000:3.0:1746065118.584761:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094244e00 00000100:00100000:0.0:1746065118.588585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.589841:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260867200 00000100:00100000:2.0:1746065118.589851:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260867200 00000100:00100000:2.0:1746065118.589898:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3628 00000100:00100000:2.0:1746065118.589906:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:28799:x1830881260867200:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065118.590204:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:28799:x1830881260867200:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 299us (1625us total) trans 8589942975 rc 0/0 00000100:00100000:2.0:1746065118.590211:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3628 00000100:00100000:0.0:1746065118.595542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.596588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.596661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.596727:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260867840 00000100:00100000:2.0:1746065118.596734:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260867840 00000100:00100000:2.0:1746065118.596773:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10289 00000100:00100000:2.0:1746065118.596780:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+28:28801:x1830881260867840:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065118.596795:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065118.596798:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260867456 00000100:00100000:1.0:1746065118.596802:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260867456 00010000:00010000:2.0:1746065118.596810:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a64d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065118.596839:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2457600->3506175) req@ffff88009fb11500 x1830881260867456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.596848:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881260867456 ext(2457600->3506175) 00010000:00010000:2.0:1746065118.596852:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065118.596852:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11500 00010000:00010000:2.0:1746065118.596860:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a623 expref: 29 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.596867:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.596869:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.596871:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2678784->3145727] (req 2678784->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.596871:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260867712 00000100:00100000:1.0:1746065118.596873:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260867712 00002000:00100000:1.0:1746065118.596885:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3506176->4194303) req@ffff88009fb10700 x1830881260867712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065118.596891:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4713 00002000:00100000:1.0:1746065118.596891:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881260867712 ext(3506176->4194303) 00002000:00010000:1.0:1746065118.596893:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10700 00000100:00100000:2.0:1746065118.596897:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881260867456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065118.596904:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4714 00000100:00100000:1.0:1746065118.596909:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881260867712:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065118.598447:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a623 expref: 29 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.598462:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a623 expref: 29 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065118.598473:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259651968:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.598557:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.598565:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 32 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065118.598573:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259652096:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.598592:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.603845:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259651968:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.603858:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259652096:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.603882:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2678784->3145727] (req 2678784->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.603896:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909d9000, rc 0) 00000100:00100000:3.0:1746065118.603945:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+29:28801:x1830881260867840:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7165us (7282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.603953:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10289 00000100:00100000:0.0:1746065118.606736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.607297:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260867968 00000100:00100000:1.0:1746065118.607305:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260867968 00010000:00010000:1.0:1746065118.607339:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 33 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746065118.607462:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5117 00000100:00100000:1.0:1746065118.607470:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881260867968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.607480:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065118.607499:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 33 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.607510:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 33 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.607529:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f803400/0x14b4f8542d4f2084 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a600 expref: 33 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.607653:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.607809:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881260867968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 339us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.607829:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5117 00000100:00100000:0.0:1746065118.620410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.620453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.620482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.620501:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260868480 00000100:00100000:0.0:1746065118.620501:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260868096 00000100:00100000:3.0:1746065118.620509:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260868224 00000100:00100000:1.0:1746065118.620509:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260868480 00000100:00100000:0.0:1746065118.620509:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260868096 00000100:00100000:3.0:1746065118.620511:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260868224 00010000:00010000:1.0:1746065118.620538:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a623 expref: 29 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065118.620549:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10290 00000100:00100000:0.0:1746065118.620554:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10291 00000100:00100000:3.0:1746065118.620556:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881260868224:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065118.620557:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5118 00000100:00100000:0.0:1746065118.620560:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881260868096:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065118.620561:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881260868480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.620571:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065118.620578:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.620580:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.620588:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a623 expref: 29 pid: 4544 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746065118.620589:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5800/0x14b4f8542d4f2110 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a65b expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.620589:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0094800/0x14b4f8542d4f2109 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a654 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.620598:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a623 expref: 29 pid: 4544 timeout: 817 lvb_type: 1 00010000:00010000:1.0:1746065118.620616:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00da800/0x14b4f8542d4f20a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a623 expref: 29 pid: 4544 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746065118.620623:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259652352:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065118.620623:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259652224:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065118.620630:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.620631:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.620636:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.620643:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.620660:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.620667:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094245180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259652480:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.621432:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.621432:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.621521:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.621541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.621763:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881260867712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24853us (25176us total) trans 0 rc 688128/688128 00000100:00100000:1.0:1746065118.621770:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4714 00002000:00100000:1.0:1746065118.621779:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3506176->4194303) req@ffff88009fb10700 x1830881260867712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 688128/688128 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.621787:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881260867712 ext(3506176->4194303) 00002000:00010000:1.0:1746065118.621790:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10700 00000100:00100000:3.0:1746065118.621894:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260868352 00000100:00100000:3.0:1746065118.621898:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260868352 00000100:00100000:3.0:1746065118.621919:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10292 00000100:00100000:3.0:1746065118.621923:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881260868352:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065118.621931:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.621940:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4800/0x14b4f8542d4f2117 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a662 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065118.621964:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259652608:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065118.621988:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac93c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746065118.622014:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065118 -> 1746065119 00000100:00100000:3.0:1746065118.622022:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259652352:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065118.622036:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5800/0x14b4f8542d4f2110 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a65b expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.622044:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5800/0x14b4f8542d4f2110 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a65b expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.622053:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c5800, rc 0) 00000100:00100000:3.0:1746065118.622069:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260868224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1515us (1587us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065118.622074:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10290 00000100:00100000:1.0:1746065118.622799:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881260867456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25901us (27263us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065118.622806:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4713 00002000:00100000:1.0:1746065118.622811:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2457600->3506175) req@ffff88009fb11500 x1830881260867456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.622836:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881260867456 ext(2457600->3506175) 00002000:00010000:1.0:1746065118.622839:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11500 00000100:00100000:2.0:1746065118.622910:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094245180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259652480:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065118.622913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065118.622920:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.622924:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260868736 00000100:00100000:1.0:1746065118.622927:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260868736 00000100:00100000:2.0:1746065118.622944:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+31:1958:x1830881260868480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2382us (2541us total) trans 0 rc 0/0 00002000:00100000:1.0:1746065118.622945:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2678784->2682879) req@ffff880094245500 x1830881260868736/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065118.622950:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5118 00002000:00100000:1.0:1746065118.622952:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094245500 with x1830881260868736 ext(2678784->2682879) 00002000:00010000:1.0:1746065118.622954:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094245500 00000100:00100000:1.0:1746065118.622965:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4715 00000100:00100000:1.0:1746065118.622970:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260868736:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065118.623032:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259652224:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065118.623046:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0094800/0x14b4f8542d4f2109 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a654 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065118.623055:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0094800/0x14b4f8542d4f2109 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a654 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065118.623065:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0094800, rc 0) 00000100:00100000:1.0:1746065118.623070:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260868736:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 99us (157us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065118.623075:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4715 00002000:00100000:1.0:1746065118.623079:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2678784->2682879) req@ffff880094245500 x1830881260868736/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065118.623080:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881260868096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2522us (2627us total) trans 0 rc 301/301 00002000:00100000:1.0:1746065118.623085:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094245500 with x1830881260868736 ext(2678784->2682879) 00000100:00100000:0.0:1746065118.623086:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10291 00002000:00010000:1.0:1746065118.623087:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094245500 00002000:00010000:3.0:1746065118.624286:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065118 -> 1746065119 00000100:00100000:3.0:1746065118.624298:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259652608:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065118.624310:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4800/0x14b4f8542d4f2117 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a662 expref: 29 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.624317:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4800/0x14b4f8542d4f2117 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a662 expref: 29 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.624322:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c4800, rc 0) 00000100:00100000:3.0:1746065118.624339:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260868352:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2416us (2798us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065118.624343:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10292 00000100:00100000:0.0:1746065118.627281:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.627329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.627355:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260868992 00000100:00100000:3.0:1746065118.627361:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260868992 00000100:00100000:3.0:1746065118.627406:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260868864 00000100:00100000:3.0:1746065118.627408:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260868864 00000100:00100000:3.0:1746065118.627423:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10293 00000100:00100000:3.0:1746065118.627430:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+26:28801:x1830881260868992:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:2.0:1746065118.627438:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10294 00010000:00010000:3.0:1746065118.627445:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065118.627450:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28805:x1830881260868864:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065118.627458:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a670 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.627458:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.627468:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a669 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.627481:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 42 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.627484:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.627491:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.627491:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.627492:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065118.627493:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065118.627495:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->3547135] (req 3145728->3547135) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.627495:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.627519:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 42 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.627519:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.627530:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 42 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.627532:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 27 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746065118.627539:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259652864:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.627539:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259652736:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.627625:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.627627:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.629922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.629964:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259652736:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065118.629999:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.630009:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260869120 00010000:00010000:2.0:1746065118.630015:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909d9800, rc 0) 00000100:00100000:1.0:1746065118.630015:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260869120 00002000:00100000:1.0:1746065118.630297:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2457599) req@ffff88009fb13480 x1830881260869120/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.630305:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13480 with x1830881260869120 ext(2097152->2457599) 00010000:00010000:1.0:1746065118.630312:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 43 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.630322:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 43 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:1.0:1746065118.630327:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb13480 00000100:00100000:1.0:1746065118.630345:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1468 00000100:00100000:1.0:1746065118.630351:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881260869120:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065118.630731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.631040:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259652864:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.631054:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->3547135] (req 3145728->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.631062:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c4600, rc 0) 00000100:00100000:3.0:1746065118.631101:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+27:28801:x1830881260868992:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3671us (3826us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.631107:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10293 00000100:00100000:3.0:1746065118.631127:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260869248 00000100:00100000:3.0:1746065118.631130:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260869248 00002000:00100000:3.0:1746065118.631144:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2678784->3145727) req@ffff88009fb10e00 x1830881260869248/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.631156:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10e00 with x1830881260869248 ext(2678784->3145727) 00010000:00010000:3.0:1746065118.631161:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 28 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.631168:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 28 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.631174:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb10e00 00000100:00100000:3.0:1746065118.631191:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1469 00000100:00100000:3.0:1746065118.631197:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260869248:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065118.631344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.631461:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28805:x1830881260868864:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4014us (4129us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.631466:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10294 00000100:00100000:2.0:1746065118.631479:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260869376 00000100:00100000:2.0:1746065118.631481:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260869376 00000100:00100000:2.0:1746065118.631497:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10295 00000100:00100000:2.0:1746065118.631502:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+27:28810:x1830881260869376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065118.631509:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.631520:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a677 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.631537:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.631547:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.631548:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.631551:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.631569:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.631577:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 44 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.631586:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259652992:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.632470:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.634580:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881260869120:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4220us (4656us total) trans 17179872712 rc 0/0 00000100:00100000:1.0:1746065118.634590:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1468 00002000:00100000:1.0:1746065118.634599:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2457599) req@ffff88009fb13480 x1830881260869120/t17179872712(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.634607:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13480 with x1830881260869120 ext(2097152->2457599) 00010000:00010000:1.0:1746065118.634615:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 45 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.634626:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 45 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:1.0:1746065118.634632:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb13480 00000100:00100000:0.0:1746065118.635230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.636160:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260869504 00000100:00100000:1.0:1746065118.636167:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260869504 00002000:00100000:1.0:1746065118.636199:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1896448->2097151) req@ffff88009fb10000 x1830881260869504/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.636208:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10000 with x1830881260869504 ext(1896448->2097151) 00010000:00010000:1.0:1746065118.636216:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 45 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746065118.636226:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 45 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:1.0:1746065118.636233:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb10000 00000100:00100000:1.0:1746065118.636251:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1470 00000100:00100000:1.0:1746065118.636258:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881260869504:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065118.636897:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259652992:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065118.636921:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.636935:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909d9c00, rc 0) 00000100:00100000:0.0:1746065118.636969:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+28:28810:x1830881260869376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5467us (5626us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.636976:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10295 00000100:00100000:3.0:1746065118.637498:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260869248:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 6298us (6765us total) trans 21474839949 rc 0/0 00000100:00100000:3.0:1746065118.637506:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1469 00002000:00100000:3.0:1746065118.637511:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2678784->3145727) req@ffff88009fb10e00 x1830881260869248/t21474839949(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.637519:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10e00 with x1830881260869248 ext(2678784->3145727) 00010000:00010000:3.0:1746065118.637526:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 30 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.637536:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 30 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746065118.637542:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb10e00 00000100:00100000:2.0:1746065118.639479:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881260869504:12345-192.168.202.46@tcp:4:cat.0 Request processed in 3217us (4245us total) trans 17179872713 rc 0/0 00000100:00100000:2.0:1746065118.639486:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1470 00002000:00100000:2.0:1746065118.639493:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1896448->2097151) req@ffff88009fb10000 x1830881260869504/t17179872713(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.639499:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10000 with x1830881260869504 ext(1896448->2097151) 00010000:00010000:2.0:1746065118.639504:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.639512:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065118.639520:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb10000 00000100:00100000:0.0:1746065118.640018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.640059:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260869632 00000100:00100000:2.0:1746065118.640065:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260869632 00010000:00010000:2.0:1746065118.640088:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.640118:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5119 00000100:00100000:2.0:1746065118.640125:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881260869632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.640135:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.640148:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.640156:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.640174:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5a00/0x14b4f8542d4f20fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a646 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.640200:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.640201:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.640207:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.640218:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.640249:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.640260:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259653120:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.640330:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.642354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.642405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.642431:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260869760 00000100:00100000:2.0:1746065118.642438:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260869760 00000100:00100000:3.0:1746065118.642455:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260869888 00000100:00100000:3.0:1746065118.642458:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260869888 00010000:00010000:2.0:1746065118.642465:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 30 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.642470:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.642488:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5120 00000100:00100000:2.0:1746065118.642495:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881260869760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065118.642498:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5121 00000100:00100000:3.0:1746065118.642502:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1958:x1830881260869888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.642505:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065118.642507:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065118.642522:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.642522:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 30 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.642531:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.642531:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 30 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746065118.642547:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c5400/0x14b4f8542d4f20ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a631 expref: 47 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.642547:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909d9000/0x14b4f8542d4f2102 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2678784->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a64d expref: 30 pid: 21998 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.642558:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.642560:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.642560:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.642561:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.642566:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.642566:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.642573:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.642573:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.642594:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.642594:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065118.642604:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259653376:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.642604:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259653248:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.643398:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065118.643431:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259653120:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.643444:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.643463:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1959:x1830881260869632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3340us (3447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.643470:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5119 00000100:00100000:3.0:1746065118.643774:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.644845:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259653376:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065118.644856:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065118.644879:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1958:x1830881260869888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2375us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.644885:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5121 00000100:00100000:2.0:1746065118.645551:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259653248:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.645563:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.645581:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881260869760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3087us (3234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.645588:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5120 00000100:00100000:0.0:1746065118.646645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.646674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.646732:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260870400 00000100:00100000:2.0:1746065118.646737:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260870400 00002000:00100000:2.0:1746065118.646765:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009fb10380 x1830881260870400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.646774:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881260870400 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.646778:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10380 00000100:00100000:2.0:1746065118.646872:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260870144 00000100:00100000:2.0:1746065118.646875:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260870144 00002000:00100000:2.0:1746065118.646886:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3543040->3547135) req@ffff88009fb11c00 x1830881260870144/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.646892:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881260870144 ext(3543040->3547135) 00002000:00010000:2.0:1746065118.646895:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11c00 00000100:00100000:2.0:1746065118.646902:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4716 00000100:00100000:2.0:1746065118.646907:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260870400:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065118.646908:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4717 00000100:00100000:3.0:1746065118.646916:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260870144:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065118.647093:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881260870144:12345-192.168.202.46@tcp:3:cat.0 Request processed in 178us (417us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065118.647099:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4717 00002000:00100000:3.0:1746065118.647104:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3543040->3547135) req@ffff88009fb11c00 x1830881260870144/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.647111:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881260870144 ext(3543040->3547135) 00002000:00010000:3.0:1746065118.647114:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11c00 00000100:00100000:1.0:1746065118.647286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.647318:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260870656 00000100:00100000:0.0:1746065118.647321:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260870656 00002000:00100000:0.0:1746065118.647333:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094245c00 x1830881260870656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.647340:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094245c00 with x1830881260870656 ext(1048576->2097151) 00002000:00010000:0.0:1746065118.647342:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094245c00 00000100:00100000:0.0:1746065118.647360:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4718 00000100:00100000:0.0:1746065118.647364:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260870656:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.660127:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260870400:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13210us (13474us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.660138:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4716 00002000:00100000:2.0:1746065118.660147:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009fb10380 x1830881260870400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.660154:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881260870400 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.660159:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10380 00000100:00100000:2.0:1746065118.670653:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260870656:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23280us (23359us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.670664:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4718 00002000:00100000:2.0:1746065118.670675:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094245c00 x1830881260870656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.670684:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094245c00 with x1830881260870656 ext(1048576->2097151) 00002000:00010000:2.0:1746065118.670690:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094245c00 00000100:00100000:2.0:1746065118.671388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.671457:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260870784 00000100:00100000:0.0:1746065118.671464:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260870784 00000100:00100000:0.0:1746065118.671505:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10296 00000100:00100000:0.0:1746065118.671512:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:28805:x1830881260870784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065118.671650:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.671666:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a67e expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.671713:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.671720:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065118.671722:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065118.671725:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 46 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.671750:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.671761:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 27 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746065118.671772:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259653504:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065118.672100:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.675290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.675384:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259653504:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.675446:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260870912 00000100:00100000:2.0:1746065118.675453:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260870912 00002000:00100000:2.0:1746065118.675490:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3547135) req@ffff880094245f80 x1830881260870912/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746065118.675494:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 46 pid: 21998 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065118.675503:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094245f80 with x1830881260870912 ext(3145728->3547135) 00010000:00010000:0.0:1746065118.675508:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0095200, rc 0) 00010000:00010000:2.0:1746065118.675510:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 28 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.675524:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 28 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065118.675530:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094245f80 00000100:00100000:0.0:1746065118.675543:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:28805:x1830881260870784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4030us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.675550:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10296 00000100:00100000:2.0:1746065118.675559:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1471 00000100:00100000:2.0:1746065118.675567:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881260870912:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065118.676227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.676266:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260871040 00000100:00100000:2.0:1746065118.676270:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260871040 00000100:00100000:2.0:1746065118.676290:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10297 00000100:00100000:2.0:1746065118.676296:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+30:28810:x1830881260871040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065118.676303:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.676313:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a685 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.676327:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.676329:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.676332:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.676341:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.676348:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00dba00, rc 0) 00000100:00100000:2.0:1746065118.676387:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+31:28810:x1830881260871040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 91us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.676391:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10297 00000100:00100000:2.0:1746065118.679788:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881260870912:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4213us (4495us total) trans 17179872714 rc 0/0 00000100:00100000:2.0:1746065118.679798:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1471 00002000:00100000:2.0:1746065118.679808:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3547135) req@ffff880094245f80 x1830881260870912/t17179872714(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.679830:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094245f80 with x1830881260870912 ext(3145728->3547135) 00010000:00010000:2.0:1746065118.679838:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 31 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.679851:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 31 pid: 8429 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746065118.679857:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094245f80 00000100:00100000:0.0:1746065118.681588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.681640:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260871168 00000100:00100000:2.0:1746065118.681648:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260871168 00010000:00010000:2.0:1746065118.681682:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 31 pid: 8429 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746065118.681983:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5122 00000100:00100000:2.0:1746065118.681992:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+31:1958:x1830881260871168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065118.682006:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065118.682023:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 31 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.682031:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 31 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.682047:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c4600/0x14b4f8542d4f211e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a670 expref: 31 pid: 8429 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746065118.682064:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.682065:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.682070:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.682075:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.682080:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.682081:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.682082:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.682086:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.682108:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.682120:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259653632:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.682176:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.682183:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259653760:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.682198:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065118.683785:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259653632:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065118.684315:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259653760:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065118.684334:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065118.684365:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881260871168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2374us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.684387:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5122 00000100:00100000:0.0:1746065118.687637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.687947:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260871424 00000100:00100000:2.0:1746065118.687956:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260871424 00002000:00100000:2.0:1746065118.687996:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009fb13b80 x1830881260871424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.688004:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881260871424 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.688009:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13b80 00000100:00100000:2.0:1746065118.688040:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4719 00000100:00100000:2.0:1746065118.688048:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881260871424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.689445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.689501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.689554:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260871808 00000100:00100000:3.0:1746065118.689559:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260871808 00002000:00100000:3.0:1746065118.689585:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094ad5c00 x1830881260871808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.689594:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad5c00 with x1830881260871808 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.689597:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad5c00 00000100:00100000:3.0:1746065118.689625:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260871936 00000100:00100000:3.0:1746065118.689628:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260871936 00002000:00100000:3.0:1746065118.689640:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880094ad6680 x1830881260871936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.689652:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad6680 with x1830881260871936 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.689655:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ad6680 00000100:00100000:3.0:1746065118.689665:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4720 00000100:00100000:3.0:1746065118.689671:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881260871808:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065118.689672:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4721 00000100:00100000:1.0:1746065118.689681:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260871936:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.699433:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881260871424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11378us (11796us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.699441:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4719 00002000:00100000:2.0:1746065118.699451:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009fb13b80 x1830881260871424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.699459:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881260871424 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.699464:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13b80 00000100:00100000:3.0:1746065118.703117:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881260871808:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13436us (13666us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065118.703127:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4720 00002000:00100000:3.0:1746065118.703138:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094ad5c00 x1830881260871808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.703146:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad5c00 with x1830881260871808 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.703150:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad5c00 00000100:00100000:2.0:1746065118.705803:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881260871936:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16117us (16295us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.706865:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4721 00002000:00100000:2.0:1746065118.706878:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880094ad6680 x1830881260871936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.706887:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad6680 with x1830881260871936 ext(3145728->4194303) 00002000:00010000:2.0:1746065118.706891:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ad6680 00000100:00100000:2.0:1746065118.709834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.709993:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260872064 00000100:00100000:0.0:1746065118.710001:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260872064 00000100:00100000:0.0:1746065118.710035:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10298 00000100:00100000:0.0:1746065118.710043:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+29:28810:x1830881260872064:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065118.710057:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.710072:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a68c expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.710094:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.710095:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.710101:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a68c expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.710114:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a68c expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.710123:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb74e00, rc 0) 00000100:00100000:0.0:1746065118.710850:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+30:28810:x1830881260872064:12345-192.168.202.46@tcp:101:cat.0 Request processed in 806us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.710857:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10298 00000100:00100000:0.0:1746065118.716251:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.716342:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260872192 00000100:00100000:2.0:1746065118.716351:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260872192 00000100:00100000:2.0:1746065118.716401:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10299 00000100:00100000:2.0:1746065118.716410:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881260872192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065118.716425:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.716440:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a693 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.716459:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.716461:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.716467:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a693 expref: 47 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.716644:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a693 expref: 47 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.716655:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00da200, rc 0) 00000100:00100000:2.0:1746065118.716913:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881260872192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 503us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.716918:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10299 00000100:00100000:0.0:1746065118.719759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.719789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.719839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.720028:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260872448 00000100:00100000:3.0:1746065118.720036:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260872448 00002000:00100000:3.0:1746065118.720072:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880131b0a300 x1830881260872448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.720079:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0a300 with x1830881260872448 ext(2097152->3145727) 00002000:00010000:3.0:1746065118.720083:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b0a300 00000100:00100000:3.0:1746065118.720093:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260872704 00000100:00100000:3.0:1746065118.720095:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260872704 00002000:00100000:3.0:1746065118.720104:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880131b0bb80 x1830881260872704/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.720109:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0bb80 with x1830881260872704 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.720111:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b0bb80 00000100:00100000:3.0:1746065118.720280:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260872960 00000100:00100000:3.0:1746065118.720284:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260872960 00000100:00100000:2.0:1746065118.720284:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4722 00002000:00100000:3.0:1746065118.720298:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880131b0aa00 x1830881260872960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065118.720299:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881260872448:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065118.720305:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0aa00 with x1830881260872960 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.720308:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b0aa00 00000100:00100000:3.0:1746065118.720318:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4723 00000100:00100000:3.0:1746065118.720322:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881260872704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065118.720350:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4724 00000100:00100000:3.0:1746065118.720354:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260872960:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065118.724395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.724553:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260873216 00000100:00100000:2.0:1746065118.724560:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260873216 00002000:00100000:2.0:1746065118.724592:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880094246300 x1830881260873216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.724601:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094246300 with x1830881260873216 ext(4194304->4976639) 00002000:00010000:2.0:1746065118.724606:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094246300 00000100:00100000:2.0:1746065118.724629:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4725 00000100:00100000:2.0:1746065118.724636:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1961:x1830881260873216:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.737263:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+32:1960:x1830881260872448:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16958us (17495us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.738382:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4722 00002000:00100000:2.0:1746065118.738396:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880131b0a300 x1830881260872448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.738410:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0a300 with x1830881260872448 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.738417:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b0a300 00000100:00100000:2.0:1746065118.744524:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1961:x1830881260873216:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19876us (20122us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746065118.744537:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4725 00002000:00100000:2.0:1746065118.744547:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880094246300 x1830881260873216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.744556:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094246300 with x1830881260873216 ext(4194304->4976639) 00002000:00010000:2.0:1746065118.744562:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094246300 00000100:00100000:3.0:1746065118.745089:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260872960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24732us (25248us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065118.745095:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4724 00002000:00100000:3.0:1746065118.745100:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880131b0aa00 x1830881260872960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.745106:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0aa00 with x1830881260872960 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.745109:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b0aa00 00000100:00100000:3.0:1746065118.747543:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260872704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27212us (27745us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065118.747553:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4723 00002000:00100000:3.0:1746065118.747561:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880131b0bb80 x1830881260872704/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.747569:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0bb80 with x1830881260872704 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.747574:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b0bb80 00000100:00100000:0.0:1746065118.752912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.752960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.752990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.753008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.753091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.753110:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260873856 00000100:00100000:0.0:1746065118.753117:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260873856 00000100:00100000:0.0:1746065118.753153:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260873728 00000100:00100000:0.0:1746065118.753155:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260873728 00000100:00100000:0.0:1746065118.753179:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 359 00000100:00100000:0.0:1746065118.753185:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1959:x1830881260873856:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1746065118.753238:0:14641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260873344 00000100:00100000:0.0:1746065118.753239:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1959:x1830881260873856:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 53us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.753242:0:14641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260873344 00000100:00100000:0.0:1746065118.753245:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 359 00000100:00100000:0.0:1746065118.753262:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 360 00000100:00100000:2.0:1746065118.753267:0:14641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 171 00000100:00100000:0.0:1746065118.753267:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881260873728:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1746065118.753272:0:14641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edf50a1e-6d84-485b-9392-04c729e87e94+15:1959:x1830881260873344:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1746065118.753287:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881260873728:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 20us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.753292:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 360 00000100:00100000:2.0:1746065118.753293:0:14641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edf50a1e-6d84-485b-9392-04c729e87e94+15:1959:x1830881260873344:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 21us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.753298:0:14641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 171 00000100:00080000:2.0:1746065118.753316:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065118.753345:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260873600 00000100:00100000:3.0:1746065118.753348:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260873600 00000100:00100000:3.0:1746065118.753384:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260873472 00000100:00100000:3.0:1746065118.753386:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260873472 00000100:00100000:3.0:1746065118.753402:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 158 00000100:00100000:3.0:1746065118.753407:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881260873600:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1746065118.753414:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 159 00000100:00100000:1.0:1746065118.753422:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+33:1959:x1830881260873472:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1746065118.753436:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881260873600:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 29us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.753442:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 158 00000100:00100000:1.0:1746065118.753449:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+33:1959:x1830881260873472:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.753456:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 159 00000100:00080000:2.0:1746065118.754801:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065118.760223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.761399:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260874112 00000100:00100000:3.0:1746065118.761408:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260874112 00002000:00100000:3.0:1746065118.761447:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009ff21180 x1830881260874112/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.761457:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21180 with x1830881260874112 ext(4194304->4976639) 00002000:00010000:3.0:1746065118.761462:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff21180 00000100:00100000:3.0:1746065118.761493:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4726 00000100:00100000:3.0:1746065118.761501:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260874112:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065118.762489:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.762659:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260874368 00000100:00100000:2.0:1746065118.762664:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260874368 00000100:00100000:2.0:1746065118.762764:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3629 00000100:00100000:2.0:1746065118.762771:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:28805:x1830881260874368:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065118.765451:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:28805:x1830881260874368:12345-192.168.202.46@tcp:35:cat.0 Request processed in 2673us (2956us total) trans 8589942976 rc 0/0 00000100:00100000:2.0:1746065118.765463:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3629 00000100:00100000:3.0:1746065118.771727:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260874112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10217us (11503us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746065118.771737:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4726 00002000:00100000:3.0:1746065118.771748:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009ff21180 x1830881260874112/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.771757:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21180 with x1830881260874112 ext(4194304->4976639) 00002000:00010000:3.0:1746065118.771762:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff21180 00010000:00010000:0.0:1746065118.816119:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065118.816269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.818472:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260874624 00000100:00100000:1.0:1746065118.818481:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260874624 00000100:00100000:1.0:1746065118.818521:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8936 00000100:00100000:1.0:1746065118.818528:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:28818:x1830881260874624:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065118.818548:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.818563:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd200/0x14b4f8542d4f214f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a69a expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.818650:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818661:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818668:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818679:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818684:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818689:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818780:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cde00/0x14b4f8542d4f2164 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818788:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cde00/0x14b4f8542d4f2164 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818794:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cde00/0x14b4f8542d4f2164 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065118.818800:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065118.818875:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818881:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818886:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818891:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00cc600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065118.818894:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818900:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818908:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065118.818911:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065118.818914:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818918:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc600/0x14b4f8542d4f2156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818946:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818950:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818959:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818962:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00cd400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065118.818964:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818968:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818974:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f49f500) 00010000:00010000:1.0:1746065118.818976:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065118.818977:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.818982:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd400/0x14b4f8542d4f215d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.819019:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd200/0x14b4f8542d4f214f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a69a expref: 282 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.819029:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cde00/0x14b4f8542d4f2164 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a69a expref: 281 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.819034:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065118.819036:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065118.819038:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cde00, rc 0) 00000100:00100000:1.0:1746065118.819712:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+281:28818:x1830881260874624:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1181us (3445us total) trans 8589942977 rc 0/0 00000100:00100000:1.0:1746065118.819719:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8936 00000100:00100000:2.0:1746065118.826003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.826050:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260874752 00000100:00100000:0.0:1746065118.826058:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260874752 00000100:00100000:0.0:1746065118.826108:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 615 00000100:00100000:0.0:1746065118.826116:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+281:1959:x1830881260874752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065118.826130:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065118.826150:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cde00/0x14b4f8542d4f2164 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a69a expref: 281 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.826177:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065118.826181:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065118.826217:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:1959:x1830881260874752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065118.826223:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 615 00000100:00100000:0.0:1746065118.841511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.841590:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260874880 00000100:00100000:2.0:1746065118.841597:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260874880 00000100:00100000:2.0:1746065118.841631:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10300 00000100:00100000:2.0:1746065118.841637:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:28818:x1830881260874880:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065118.841651:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.841664:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6a1 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.841686:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 48 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.841693:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.841698:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.841700:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.841703:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3264512->3698687] (req 3264512->3698687) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 48 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.841723:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.841731:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 29 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065118.841745:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259653888:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065118.844377:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 48 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.844392:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 48 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065118.844403:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259654016:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.844446:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065118.851013:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259653888:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.851025:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259654016:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065118.851055:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3264512->3698687] (req 3264512->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 48 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.851071:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00da400, rc 0) 00000100:00100000:2.0:1746065118.852160:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:28818:x1830881260874880:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10517us (10649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.852168:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10300 00000100:00100000:3.0:1746065118.852392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.852491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.852566:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260875008 00000100:00100000:1.0:1746065118.852572:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260875008 00010000:00010000:1.0:1746065118.852598:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 30 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065118.852616:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260875136 00000100:00100000:1.0:1746065118.852618:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260875136 00010000:00010000:1.0:1746065118.852627:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 48 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065118.852640:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5123 00000100:00100000:1.0:1746065118.852646:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881260875008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.852656:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065118.852673:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 30 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.852683:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 30 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.852698:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00dba00/0x14b4f8542d4f213a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a685 expref: 30 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.852710:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.852731:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881260875008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.852736:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5123 00000100:00100000:1.0:1746065118.852745:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5124 00000100:00100000:1.0:1746065118.852749:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1958:x1830881260875136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.852754:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065118.852759:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 48 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.852765:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 48 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.852774:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f2133 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a67e expref: 48 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.852780:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.852782:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.852786:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 47 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.852793:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 47 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.852835:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 47 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.852846:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094246a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259654144:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065118.852896:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.854455:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094246a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259654144:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065118.854468:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.854506:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1958:x1830881260875136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1755us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.854515:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5124 00000100:00100000:0.0:1746065118.855079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.856856:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260875392 00000100:00100000:3.0:1746065118.856864:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260875392 00002000:00100000:3.0:1746065118.856898:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3264512->3268607) req@ffff88009ff22680 x1830881260875392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.856907:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff22680 with x1830881260875392 ext(3264512->3268607) 00002000:00010000:3.0:1746065118.856911:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff22680 00000100:00100000:3.0:1746065118.856939:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4727 00000100:00100000:3.0:1746065118.856946:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1961:x1830881260875392:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065118.857099:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1961:x1830881260875392:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 152us (2020us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065118.857105:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4727 00002000:00100000:3.0:1746065118.857110:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3264512->3268607) req@ffff88009ff22680 x1830881260875392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.857117:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff22680 with x1830881260875392 ext(3264512->3268607) 00002000:00010000:3.0:1746065118.857120:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff22680 00000100:00100000:0.0:1746065118.862226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.862478:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260875648 00000100:00100000:2.0:1746065118.862487:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260875648 00002000:00100000:2.0:1746065118.862532:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3694592->3698687) req@ffff88009ff22d80 x1830881260875648/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.862542:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff22d80 with x1830881260875648 ext(3694592->3698687) 00002000:00010000:2.0:1746065118.862547:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff22d80 00000100:00100000:2.0:1746065118.863319:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4728 00000100:00100000:2.0:1746065118.863332:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881260875648:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065118.863555:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881260875648:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 224us (1336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065118.863562:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4728 00002000:00100000:2.0:1746065118.863569:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3694592->3698687) req@ffff88009ff22d80 x1830881260875648/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.863575:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff22d80 with x1830881260875648 ext(3694592->3698687) 00002000:00010000:2.0:1746065118.863579:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff22d80 00000100:00100000:0.0:1746065118.868079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.868242:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260875904 00000100:00100000:2.0:1746065118.868249:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260875904 00000100:00100000:2.0:1746065118.868293:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3630 00000100:00100000:2.0:1746065118.868299:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:28818:x1830881260875904:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065118.868767:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+281:28818:x1830881260875904:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 467us (694us total) trans 8589942978 rc 0/0 00000100:00100000:2.0:1746065118.868773:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3630 00000100:00100000:0.0:1746065118.902637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.902860:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260876160 00000100:00100000:1.0:1746065118.902868:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260876160 00000100:00100000:1.0:1746065118.902927:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8937 00000100:00100000:1.0:1746065118.902936:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+281:28823:x1830881260876160:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065118.902955:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.902971:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc000/0x14b4f8542d4f2179 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6a8 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.903064:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903075:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903084:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903096:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903102:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903107:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903204:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc400/0x14b4f8542d4f218e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903213:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc400/0x14b4f8542d4f218e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903219:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc400/0x14b4f8542d4f218e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065118.903227:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065118.903294:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903300:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903306:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903311:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00cd000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065118.903314:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903319:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903329:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065118.903331:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065118.903335:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903339:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd000/0x14b4f8542d4f2180 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903376:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903381:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903389:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903393:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a00ccc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065118.903395:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903399:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903405:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f49f600) 00010000:00010000:1.0:1746065118.903407:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065118.903409:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903413:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00ccc00/0x14b4f8542d4f2187 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065118.903619:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc000/0x14b4f8542d4f2179 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a8 expref: 284 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.903631:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc400/0x14b4f8542d4f218e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a8 expref: 283 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.903637:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065118.903639:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065118.903640:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cc400, rc 0) 00000100:00100000:1.0:1746065118.903694:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:28823:x1830881260876160:12345-192.168.202.46@tcp:101:cat.0 Request processed in 758us (1065us total) trans 8589942979 rc 0/0 00000100:00100000:1.0:1746065118.903701:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8937 00000100:00100000:0.0:1746065118.912074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.912164:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260876288 00000100:00100000:1.0:1746065118.912171:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260876288 00000100:00100000:1.0:1746065118.912220:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 616 00000100:00100000:1.0:1746065118.912227:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:1959:x1830881260876288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.912239:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065118.912258:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cc400/0x14b4f8542d4f218e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a8 expref: 283 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.912285:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065118.912288:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.912319:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:1959:x1830881260876288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.912324:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 616 00000100:00100000:0.0:1746065118.914889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.914987:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260876416 00000100:00100000:2.0:1746065118.914994:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260876416 00000100:00100000:2.0:1746065118.915031:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10301 00000100:00100000:2.0:1746065118.915038:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+30:28815:x1830881260876416:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065118.915058:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.915073:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6af expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.915099:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134d8f600/0x14b4f8542d4f1bde lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a37c expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.915106:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a45c expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.915113:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a39f expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.915124:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.915125:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065118.915128:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1327104->2097151] (req 1327104->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.915152:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a39f expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.915162:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a39f expref: 32 pid: 21998 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746065118.915171:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259654272:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065118.915333:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a45c expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.915341:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a45c expref: 7 pid: 8428 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746065118.915349:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259654400:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065118.915386:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134d8f600/0x14b4f8542d4f1bde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a37c expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.915393:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134d8f600/0x14b4f8542d4f1bde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a37c expref: 31 pid: 25185 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065118.915400:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259654528:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.916266:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.917721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.917756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.918519:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260876800 00000100:00100000:3.0:1746065118.918526:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260876800 00002000:00100000:3.0:1746065118.918557:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009ff21f80 x1830881260876800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.918566:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21f80 with x1830881260876800 ext(1048576->2097151) 00002000:00010000:3.0:1746065118.918569:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff21f80 00000100:00100000:3.0:1746065118.918585:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4729 00000100:00100000:3.0:1746065118.918591:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881260876800:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065118.919583:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259654272:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.919593:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259654400:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.919652:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260876544 00000100:00100000:2.0:1746065118.919655:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260876544 00000100:00100000:2.0:1746065118.919686:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10302 00000100:00100000:2.0:1746065118.919691:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881260876544:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065118.919700:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.919711:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00da600/0x14b4f8542d4f21a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6b6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.919742:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259654656:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065118.919785:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.921011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.921031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.921069:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260876928 00000100:00100000:1.0:1746065118.921078:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260876928 00000100:00100000:3.0:1746065118.921090:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260877056 00000100:00100000:3.0:1746065118.921092:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260877056 00010000:00010000:1.0:1746065118.921102:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a45c expref: 8 pid: 8428 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065118.921104:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a39f expref: 33 pid: 21998 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065118.921117:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5125 00000100:00100000:3.0:1746065118.921121:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881260877056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065118.921123:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5126 00010000:00010000:3.0:1746065118.921127:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065118.921128:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881260876928:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.921135:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065118.921140:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a39f expref: 33 pid: 21998 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746065118.921143:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a45c expref: 8 pid: 8428 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065118.921148:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a39f expref: 33 pid: 21998 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746065118.921193:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a45c expref: 8 pid: 8428 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065118.921220:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7d800/0x14b4f8542d4f1c2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a39f expref: 33 pid: 21998 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746065118.921228:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe11000/0x14b4f8542d4f1dba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a45c expref: 8 pid: 8428 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065118.921237:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065118.921237:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065118.922310:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260877056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1183us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.922310:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881260876928:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1178us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.922317:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5126 00000100:00100000:2.0:1746065118.922406:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259654528:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065118.922434:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1327104->2097151] (req 1327104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065118.922444:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5125 00010000:00010000:2.0:1746065118.922450:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00db400, rc 0) 00000100:00100000:2.0:1746065118.922486:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+31:28815:x1830881260876416:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7448us (7602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.922492:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10301 00000100:00100000:2.0:1746065118.927976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.928267:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260877184 00000100:00100000:3.0:1746065118.928274:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260877184 00010000:00010000:3.0:1746065118.928301:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134d8f600/0x14b4f8542d4f1bde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a37c expref: 31 pid: 25185 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065118.928306:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881260876800:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9713us (10548us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065118.928315:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4729 00002000:00100000:1.0:1746065118.928323:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009ff21f80 x1830881260876800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.928331:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21f80 with x1830881260876800 ext(1048576->2097151) 00002000:00010000:1.0:1746065118.928334:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff21f80 00000100:00100000:3.0:1746065118.928336:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5127 00000100:00100000:3.0:1746065118.928344:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881260877184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065118.928353:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065118.928378:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134d8f600/0x14b4f8542d4f1bde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a37c expref: 31 pid: 25185 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065118.928388:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134d8f600/0x14b4f8542d4f1bde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a37c expref: 31 pid: 25185 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065118.928400:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259654656:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065118.928406:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134d8f600/0x14b4f8542d4f1bde lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a37c expref: 31 pid: 25185 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065118.928423:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00da600/0x14b4f8542d4f21a3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6b6 expref: 30 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.928433:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00da600/0x14b4f8542d4f21a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6b6 expref: 30 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.928443:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00da600, rc 0) 00000100:00100000:2.0:1746065118.928463:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881260876544:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8771us (10744us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065118.928469:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10302 00010000:00010000:3.0:1746065118.929006:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.929008:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065118.929016:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.929023:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.929051:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065118.929061:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259654784:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065118.929131:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.933706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.933805:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260877440 00000100:00100000:1.0:1746065118.933812:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260877440 00002000:00100000:1.0:1746065118.933875:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1327104->1331199) req@ffff88009ff23480 x1830881260877440/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.933883:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff23480 with x1830881260877440 ext(1327104->1331199) 00002000:00010000:1.0:1746065118.933888:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff23480 00000100:00100000:1.0:1746065118.933908:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4730 00000100:00100000:1.0:1746065118.933914:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881260877440:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065118.934052:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881260877440:12345-192.168.202.46@tcp:3:cat.0 Request processed in 137us (352us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065118.934059:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4730 00002000:00100000:1.0:1746065118.934064:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1327104->1331199) req@ffff88009ff23480 x1830881260877440/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.934070:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff23480 with x1830881260877440 ext(1327104->1331199) 00002000:00010000:1.0:1746065118.934073:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff23480 00000100:00100000:3.0:1746065118.934301:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259654784:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065118.934317:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065118.934338:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881260877184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5995us (6368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.934345:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5127 00000100:00100000:0.0:1746065118.937385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.937485:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260877696 00000100:00100000:2.0:1746065118.937493:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260877696 00002000:00100000:2.0:1746065118.937528:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ff23b80 x1830881260877696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.937536:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff23b80 with x1830881260877696 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.937540:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff23b80 00000100:00100000:2.0:1746065118.937570:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4731 00000100:00100000:2.0:1746065118.937581:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881260877696:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065118.938196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.938288:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260877952 00000100:00100000:1.0:1746065118.938292:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260877952 00002000:00100000:1.0:1746065118.938309:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009ff21500 x1830881260877952/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 504/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.938316:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21500 with x1830881260877952 ext(1048576->2097151) 00002000:00010000:1.0:1746065118.938319:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff21500 00000100:00100000:1.0:1746065118.938345:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4732 00000100:00100000:1.0:1746065118.938349:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260877952:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065118.942632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.943324:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260878208 00000100:00100000:3.0:1746065118.943333:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260878208 00002000:00100000:3.0:1746065118.943382:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009ff20700 x1830881260878208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 504/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.943391:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20700 with x1830881260878208 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.943396:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff20700 00000100:00100000:3.0:1746065118.943429:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4733 00000100:00100000:3.0:1746065118.943437:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1960:x1830881260878208:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065118.948423:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260877952:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10063us (10218us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746065118.948434:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4732 00002000:00100000:1.0:1746065118.948443:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009ff21500 x1830881260877952/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 504/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065118.948452:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21500 with x1830881260877952 ext(1048576->2097151) 00002000:00010000:1.0:1746065118.948457:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff21500 00000100:00100000:2.0:1746065118.950012:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1960:x1830881260877696:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12431us (12640us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.950020:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4731 00002000:00100000:2.0:1746065118.950027:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ff23b80 x1830881260877696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.950035:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff23b80 with x1830881260877696 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.950040:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff23b80 00000100:00100000:3.0:1746065118.954850:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881260878208:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11405us (12217us total) trans 0 rc 614400/614400 00000100:00100000:3.0:1746065118.954860:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4733 00002000:00100000:3.0:1746065118.954870:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009ff20700 x1830881260878208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 504/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.954878:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20700 with x1830881260878208 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.954884:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff20700 00000100:00100000:2.0:1746065118.957507:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.957564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.958559:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260878336 00000100:00100000:0.0:1746065118.958567:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260878336 00000100:00100000:0.0:1746065118.958601:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260878464 00000100:00100000:0.0:1746065118.958603:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260878464 00000100:00100000:0.0:1746065118.958618:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10303 00000100:00100000:0.0:1746065118.958624:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:28815:x1830881260878336:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065118.958640:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065118.958654:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6bd expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.958677:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.958685:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a693 expref: 46 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065118.958690:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.958692:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065118.958695:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.958719:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a693 expref: 46 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065118.958730:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a693 expref: 46 pid: 21998 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746065118.958740:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259654912:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065118.958812:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065118.958833:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065118.958846:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259655040:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065118.958864:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.958980:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10304 00000100:00100000:3.0:1746065118.958988:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+31:28825:x1830881260878464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065118.958995:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.959004:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6c4 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.959023:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 46 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.959029:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065118.959030:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065118.959033:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 32 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.959047:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 46 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.959054:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 46 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065118.959061:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259655168:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065118.959087:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.961527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.961569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.961659:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259654912:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065118.961669:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259655040:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065118.961694:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 32 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.961707:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134d8ec00, rc 0) 00000100:00100000:2.0:1746065118.961738:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+32:28815:x1830881260878336:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3115us (4238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.961746:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10303 00000100:00100000:1.0:1746065118.961829:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260878592 00000100:00100000:1.0:1746065118.961833:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260878592 00010000:00010000:1.0:1746065118.961860:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a693 expref: 47 pid: 21998 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1746065118.961879:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260878720 00000100:00100000:1.0:1746065118.961880:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260878720 00010000:00010000:1.0:1746065118.961886:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 32 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065118.961896:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5128 00000100:00100000:1.0:1746065118.961900:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1958:x1830881260878592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.961909:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065118.961925:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a693 expref: 47 pid: 21998 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746065118.961932:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a693 expref: 47 pid: 21998 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746065118.961949:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00da200/0x14b4f8542d4f2148 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a693 expref: 47 pid: 21998 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746065118.961960:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.961973:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1958:x1830881260878592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.961978:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5128 00000100:00100000:1.0:1746065118.961987:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5129 00000100:00100000:1.0:1746065118.961991:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+32:1958:x1830881260878720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.961996:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065118.962001:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 32 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.962008:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 32 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.962016:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909d9c00/0x14b4f8542d4f212c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a677 expref: 32 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.962023:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.962025:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.962029:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.962036:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.962054:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.962062:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259655296:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065118.962096:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065118.962858:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259655168:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065118.962876:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065118.962886:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f803400, rc 0) 00000100:00100000:3.0:1746065118.962914:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+31:28825:x1830881260878464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3927us (5348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065118.962919:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10304 00000100:00100000:0.0:1746065118.963692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.963765:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260878848 00000100:00100000:3.0:1746065118.963771:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260878848 00002000:00100000:3.0:1746065118.963798:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3264512->3698687) req@ffff88009f9baa00 x1830881260878848/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.963806:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9baa00 with x1830881260878848 ext(3264512->3698687) 00010000:00010000:3.0:1746065118.963811:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 46 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065118.963897:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 46 pid: 4544 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746065118.963903:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9baa00 00000100:00100000:3.0:1746065118.964092:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1472 00000100:00100000:3.0:1746065118.964099:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881260878848:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065118.964953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.965008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.965362:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260878976 00000100:00100000:2.0:1746065118.965375:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260878976 00000100:00100000:2.0:1746065118.965402:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260879104 00000100:00100000:2.0:1746065118.965404:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260879104 00000100:00100000:2.0:1746065118.965428:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10305 00000100:00100000:2.0:1746065118.965434:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881260878976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065118.965445:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.965459:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f21b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6cb expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065118.965495:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259655424:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065118.965545:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.965591:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10306 00000100:00100000:1.0:1746065118.965598:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1959:x1830881260879104:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065118.965604:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065118.965612:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f21bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6d2 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.965638:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094246a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259655552:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065118.965659:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.966093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.966156:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260879232 00000100:00100000:3.0:1746065118.966159:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260879232 00000100:00100000:3.0:1746065118.966174:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10307 00000100:00100000:3.0:1746065118.966178:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:1959:x1830881260879232:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065118.966183:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065118.966191:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f21c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6d9 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065118.966210:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259655680:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065118.966430:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065118.968483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.968609:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094246a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259655552:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065118.968631:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f21bf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6d2 expref: 51 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065118.968642:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cd000/0x14b4f8542d4f21bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6d2 expref: 51 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065118.968651:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00cd000, rc 0) 00000100:00100000:1.0:1746065118.968679:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:1959:x1830881260879104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3082us (3670us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065118.968687:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10306 00000100:00100000:1.0:1746065118.968712:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259655296:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065118.968719:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.968732:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881260878720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6740us (7163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.968738:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5129 00002000:00010000:2.0:1746065118.968849:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime: 1746065117 -> 1746065119 00002000:00010000:2.0:1746065118.968852:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime: 1746065117 -> 1746065119 00002000:00010000:2.0:1746065118.968853:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime: 1746065117 -> 1746065119 00000100:00100000:2.0:1746065118.968863:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259655424:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065118.968877:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f21b8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6cb expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.968885:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f21b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6cb expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065118.968896:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907a9e00, rc 0) 00000100:00100000:2.0:1746065118.968911:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881260878976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3479us (3960us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065118.968915:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10305 00000100:00100000:3.0:1746065118.969107:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259655680:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065118.969121:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f21c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6d9 expref: 49 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.969130:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f21c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6d9 expref: 49 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065118.969139:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8b6e00, rc 0) 00000100:00100000:3.0:1746065118.969154:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1959:x1830881260879232:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2976us (3062us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065118.969158:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10307 00000100:00100000:3.0:1746065118.969176:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260879488 00000100:00100000:3.0:1746065118.969180:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260879488 00002000:00100000:3.0:1746065118.969200:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1159168->1163263) req@ffff88009f9bb480 x1830881260879488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.969207:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb480 with x1830881260879488 ext(1159168->1163263) 00002000:00010000:3.0:1746065118.969210:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb480 00000100:00100000:3.0:1746065118.969221:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4734 00000100:00100000:3.0:1746065118.969226:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260879488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065118.969320:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260879488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 94us (841us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065118.969325:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4734 00002000:00100000:3.0:1746065118.969329:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1159168->1163263) req@ffff88009f9bb480 x1830881260879488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/4536 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.969336:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb480 with x1830881260879488 ext(1159168->1163263) 00002000:00010000:3.0:1746065118.969338:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb480 00000100:00100000:0.0:1746065118.972487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.972557:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260879616 00000100:00100000:2.0:1746065118.972564:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260879616 00000100:00100000:2.0:1746065118.972597:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10308 00000100:00100000:2.0:1746065118.972603:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:28823:x1830881260879616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065118.972616:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065118.972629:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6e0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.972648:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.972650:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065118.972653:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 49 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.972661:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 49 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065118.972669:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907a9400, rc 0) 00000100:00100000:2.0:1746065118.972701:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:28823:x1830881260879616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 98us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065118.972706:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10308 00000100:00100000:3.0:1746065118.973567:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1960:x1830881260878848:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9467us (9874us total) trans 17179872715 rc 0/0 00000100:00100000:3.0:1746065118.973575:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1472 00002000:00100000:3.0:1746065118.973582:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3264512->3698687) req@ffff88009f9baa00 x1830881260878848/t17179872715(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/448 e 0 to 0 dl 1746065129 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.973595:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9baa00 with x1830881260878848 ext(3264512->3698687) 00010000:00010000:3.0:1746065118.973601:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 49 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065118.973611:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 49 pid: 4544 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746065118.973617:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9baa00 00000100:00100000:0.0:1746065118.977548:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065118.978214:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260879744 00000100:00100000:1.0:1746065118.978221:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260879744 00010000:00010000:1.0:1746065118.978249:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 49 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065118.978283:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5130 00000100:00100000:1.0:1746065118.978291:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1958:x1830881260879744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065118.978302:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065118.978319:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 49 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.978329:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 49 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.978347:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00da400/0x14b4f8542d4f2172 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3264512->3698687) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6a1 expref: 49 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065118.978528:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.978530:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.978536:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.978545:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.978552:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.978553:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065118.978555:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 48 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.978560:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 48 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065118.978583:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 48 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.978594:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259655808:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065118.978665:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065118.978671:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094246a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259655936:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065118.978689:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065118.981007:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094246a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259655936:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065118.982297:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259655808:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065118.982313:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065118.982355:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1958:x1830881260879744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4064us (4813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065118.982364:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5130 00000100:00100000:0.0:1746065118.984644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065118.984959:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260880128 00000100:00100000:3.0:1746065118.984967:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260880128 00002000:00100000:3.0:1746065118.985002:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009f9b9180 x1830881260880128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.985012:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9180 with x1830881260880128 ext(4194304->4976639) 00002000:00010000:3.0:1746065118.985016:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b9180 00000100:00100000:3.0:1746065118.985039:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4735 00000100:00100000:3.0:1746065118.985046:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1960:x1830881260880128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.985522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065118.985547:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065118.985703:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260880384 00000100:00100000:0.0:1746065118.985707:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260880384 00002000:00100000:0.0:1746065118.985724:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094ad7480 x1830881260880384/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065118.985731:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad7480 with x1830881260880384 ext(3145728->4194303) 00002000:00010000:0.0:1746065118.985733:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad7480 00000100:00100000:3.0:1746065118.985907:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260880256 00000100:00100000:3.0:1746065118.985911:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260880256 00002000:00100000:3.0:1746065118.985925:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880094ad5180 x1830881260880256/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/0 e 0 to 0 dl 1746065129 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.985931:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad5180 with x1830881260880256 ext(2097152->3145727) 00002000:00010000:3.0:1746065118.985934:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad5180 00000100:00100000:3.0:1746065118.985946:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4736 00000100:00100000:3.0:1746065118.985951:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881260880384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065118.986025:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4737 00000100:00100000:2.0:1746065118.986034:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881260880256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065118.996997:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+32:1960:x1830881260880384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11037us (11467us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065118.997007:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4736 00002000:00100000:3.0:1746065118.997016:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094ad7480 x1830881260880384/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065118.997025:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad7480 with x1830881260880384 ext(3145728->4194303) 00002000:00010000:3.0:1746065118.997030:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad7480 00000100:00100000:2.0:1746065118.997427:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1960:x1830881260880128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12380us (12786us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746065118.997434:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4735 00002000:00100000:2.0:1746065118.997439:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009f9b9180 x1830881260880128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.997445:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9180 with x1830881260880128 ext(4194304->4976639) 00002000:00010000:2.0:1746065118.997448:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b9180 00000100:00100000:2.0:1746065118.999324:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260880256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13288us (13770us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065118.999333:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4737 00002000:00100000:2.0:1746065118.999340:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880094ad5180 x1830881260880256/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:34/0 lens 488/440 e 0 to 0 dl 1746065129 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065118.999348:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad5180 with x1830881260880256 ext(2097152->3145727) 00002000:00010000:2.0:1746065118.999352:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad5180 00000100:00100000:0.0:1746065119.001704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.001754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.002840:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260880640 00000100:00100000:0.0:1746065119.002848:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260880640 00000100:00100000:2.0:1746065119.002902:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260880768 00000100:00100000:2.0:1746065119.002906:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260880768 00000100:00100000:2.0:1746065119.002951:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10309 00000100:00100000:2.0:1746065119.002958:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1959:x1830881260880768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.002972:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.002986:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800907a9600/0x14b4f8542d4f21d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6ee expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.003029:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259656064:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065119.003093:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.003738:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10310 00000100:00100000:0.0:1746065119.003746:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881260880640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065119.003754:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.003765:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c5800/0x14b4f8542d4f21db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6e7 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.003791:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259656192:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065119.003842:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.006038:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259656064:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065119.006064:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800907a9600/0x14b4f8542d4f21d4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6ee expref: 49 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.006075:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800907a9600/0x14b4f8542d4f21d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6ee expref: 49 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.006137:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907a9600, rc 0) 00000100:00100000:2.0:1746065119.006171:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1959:x1830881260880768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3213us (4416us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.006177:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10309 00000100:00100000:1.0:1746065119.007153:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259656192:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065119.007171:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c5800/0x14b4f8542d4f21db lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e7 expref: 33 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.007179:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c5800/0x14b4f8542d4f21db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e7 expref: 33 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.007190:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c5800, rc 0) 00000100:00100000:1.0:1746065119.007223:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881260880640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3478us (5526us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065119.007228:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10310 00000100:00100000:0.0:1746065119.008898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.009042:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260881024 00000100:00100000:0.0:1746065119.009045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.009049:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260881024 00000100:00100000:0.0:1746065119.009085:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:3.0:1746065119.009144:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065119.009161:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260881152 00002000:00100000:2.0:1746065119.009162:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009f9b8380 x1830881260881024/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065119.009164:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260881152 00002000:00100000:2.0:1746065119.009170:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8380 with x1830881260881024 ext(4194304->4976639) 00002000:00010000:2.0:1746065119.009174:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b8380 00000100:00100000:3.0:1746065119.009182:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260881280 00000100:00100000:3.0:1746065119.009183:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260881280 00000100:00100000:2.0:1746065119.009184:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4738 00000100:00100000:2.0:1746065119.009194:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260881024:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065119.009241:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10311 00000100:00100000:3.0:1746065119.009246:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881260881152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.009254:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.009267:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350df000/0x14b4f8542d4f21e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6f5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.009301:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259656320:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.009354:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.009437:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10312 00000100:00100000:3.0:1746065119.009442:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1958:x1830881260881280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.009449:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.009457:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f21e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a6fc expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.009475:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259656448:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.009504:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.011886:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259656448:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065119.011913:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f21e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6fc expref: 49 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.011926:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f21e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6fc expref: 49 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.011939:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25c200, rc 0) 00000100:00100000:3.0:1746065119.011973:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1958:x1830881260881280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2528us (2885us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065119.011979:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10312 00000100:00100000:2.0:1746065119.012115:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259656320:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065119.012131:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801350df000/0x14b4f8542d4f21e2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6f5 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.012139:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350df000/0x14b4f8542d4f21e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6f5 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.012146:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350df000, rc 0) 00000100:00100000:2.0:1746065119.012180:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881260881152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2933us (3135us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.012185:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10311 00000100:00100000:2.0:1746065119.015292:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260881024:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6095us (6390us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746065119.015302:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4738 00002000:00100000:2.0:1746065119.015312:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009f9b8380 x1830881260881024/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.015320:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8380 with x1830881260881024 ext(4194304->4976639) 00002000:00010000:2.0:1746065119.015325:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b8380 00000100:00100000:0.0:1746065119.016932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.017017:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260881536 00000100:00100000:2.0:1746065119.017023:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260881536 00000100:00100000:2.0:1746065119.017530:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3631 00000100:00100000:2.0:1746065119.017541:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b879850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:28823:x1830881260881536:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065119.017719:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b879850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:28823:x1830881260881536:12345-192.168.202.46@tcp:35:cat.0 Request processed in 181us (792us total) trans 8589942980 rc 0/0 00000100:00100000:2.0:1746065119.017725:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3631 00000100:00080000:3.0:1746065119.017950:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065119.027654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.027743:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260881664 00000100:00100000:1.0:1746065119.027751:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260881664 00000100:00100000:1.0:1746065119.027841:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8938 00000100:00100000:1.0:1746065119.027849:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28829:x1830881260881664:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065119.027865:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065119.027878:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094a00/0x14b4f8542d4f21f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a703 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.027923:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.027933:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.027942:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.027953:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.027958:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.027962:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.028048:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.028058:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a52e expref: 32 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.028063:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.028088:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a52e expref: 32 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.028098:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a52e expref: 32 pid: 14643 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.028108:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259656576:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065119.028169:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ec00 going to sleep for 11 seconds 00000100:00080000:3.0:1746065119.028226:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065119.029937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.030035:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259656576:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065119.030053:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065119.030137:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260881920 00000100:00100000:2.0:1746065119.030143:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260881920 00000100:00100000:2.0:1746065119.030187:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3632 00000100:00100000:2.0:1746065119.030193:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+33:19663:x1830881260881920:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065119.030343:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+34:19663:x1830881260881920:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 150us (409us total) trans 8589942981 rc 0/0 00000100:00100000:2.0:1746065119.030349:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3632 00000100:00100000:0.0:1746065119.031784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.032106:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260882048 00000100:00100000:1.0:1746065119.032112:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260882048 00010000:00010000:1.0:1746065119.032134:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a52e expref: 34 pid: 14643 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.032159:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5131 00000100:00100000:1.0:1746065119.032165:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+34:1960:x1830881260882048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.032174:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.032182:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a52e expref: 34 pid: 14643 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.032191:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a52e expref: 34 pid: 14643 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.032208:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cd600/0x14b4f8542d4f1f34 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a52e expref: 34 pid: 14643 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.032226:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065119.032231:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.032238:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.032243:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.032268:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065119.032293:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+33:1960:x1830881260882048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 128us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.032298:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5131 00010000:00010000:0.0:1746065119.032351:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032357:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065119.032396:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:0.0:1746065119.032399:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065119.032409:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032417:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032424:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032429:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032438:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032442:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0094c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065119.032445:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032450:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032458:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065119.032460:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065119.032463:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032467:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f21f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032507:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032513:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032518:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032522:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0094e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065119.032524:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032528:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032538:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f49f600) 00010000:00010000:0.0:1746065119.032540:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065119.032542:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032546:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f21fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.032573:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094a00/0x14b4f8542d4f21f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a703 expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.032581:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a703 expref: 15 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.032586:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.032588:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065119.032590:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0095000, rc 0) 00000100:00100000:0.0:1746065119.032609:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:28829:x1830881260881664:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4762us (4963us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.032615:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8938 00000100:00100000:0.0:1746065119.034484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.034511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.034785:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260882176 00000100:00100000:3.0:1746065119.034789:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260882432 00000100:00100000:2.0:1746065119.034791:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260882176 00000100:00100000:3.0:1746065119.034793:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260882432 00000100:00080000:3.0:1746065119.034830:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065119.034842:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10313 00000100:00100000:2.0:1746065119.034848:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260882176:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.034860:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.034873:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800907a8e00/0x14b4f8542d4f220c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a70a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.034891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.034905:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260882304 00000100:00100000:0.0:1746065119.034912:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260882304 00000100:00100000:2.0:1746065119.034916:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259656704:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065119.034967:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.034999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.035087:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260882560 00000100:00100000:1.0:1746065119.035090:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260882560 00000100:00100000:2.0:1746065119.035122:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10314 00000100:00100000:2.0:1746065119.035128:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260882432:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.035136:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.035143:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a718 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.035153:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.035155:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.035162:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a718 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.035174:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a718 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.035182:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907a8800, rc 0) 00000100:00100000:2.0:1746065119.035199:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260882432:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 72us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.035205:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10314 00000100:00100000:2.0:1746065119.035216:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10315 00000100:00100000:2.0:1746065119.035220:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260882304:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.035226:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.035231:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800907a8600/0x14b4f8542d4f221a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a711 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.035250:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259656832:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065119.035269:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065119.035434:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10316 00000100:00100000:1.0:1746065119.035440:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260882560:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065119.035447:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065119.035453:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a71f expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.035463:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.035465:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.035469:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a71f expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.035479:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a71f expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.035485:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0095400, rc 0) 00000100:00100000:1.0:1746065119.035514:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260882560:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 74us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.035520:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10316 00000100:00100000:2.0:1746065119.036975:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259656832:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065119.036975:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259656704:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065119.036997:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800907a8600/0x14b4f8542d4f221a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a711 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.036997:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800907a8e00/0x14b4f8542d4f220c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a70a expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.037007:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800907a8600/0x14b4f8542d4f221a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a711 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.037007:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800907a8e00/0x14b4f8542d4f220c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a70a expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.037015:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907a8e00, rc 0) 00010000:00010000:2.0:1746065119.037017:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907a8600, rc 0) 00000100:00100000:1.0:1746065119.037105:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260882176:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2256us (2624us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065119.037111:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10313 00000100:00100000:2.0:1746065119.037184:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260882304:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1961us (2291us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.037188:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10315 00000100:00100000:0.0:1746065119.040102:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.040298:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260882816 00000100:00100000:2.0:1746065119.040305:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260882816 00000100:00100000:2.0:1746065119.040524:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8939 00000100:00100000:2.0:1746065119.040533:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:28829:x1830881260882816:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.040549:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.040564:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a8200/0x14b4f8542d4f2228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a726 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.040641:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.040653:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a703 expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.040660:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.040685:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a703 expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.040694:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a703 expref: 16 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.040704:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259656960:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.040894:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.043253:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259656960:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.043275:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065119.043779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.043837:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260882944 00000100:00100000:1.0:1746065119.043845:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260882944 00010000:00010000:1.0:1746065119.043876:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a703 expref: 17 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.043907:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5132 00000100:00100000:1.0:1746065119.043915:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1961:x1830881260882944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.043926:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.043931:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a703 expref: 17 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.043942:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a703 expref: 17 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.043960:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095000/0x14b4f8542d4f2205 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a703 expref: 17 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.043971:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065119.043976:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.044118:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.044125:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.044152:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065119.044184:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1961:x1830881260882944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 269us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.044190:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5132 00010000:00010000:3.0:1746065119.044499:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.044506:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065119.044522:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065119.044629:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a8200/0x14b4f8542d4f2228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a726 expref: 17 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.045216:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a726 expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.045225:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.045227:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065119.045229:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907a9000, rc 0) 00000100:00100000:3.0:1746065119.045268:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:28829:x1830881260882816:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4736us (5172us total) trans 8589942982 rc 0/0 00000100:00100000:3.0:1746065119.045274:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8939 00000100:00100000:0.0:1746065119.047798:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.048162:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260883072 00000100:00100000:3.0:1746065119.048170:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260883072 00000100:00100000:3.0:1746065119.048213:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8940 00000100:00100000:3.0:1746065119.048220:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:28829:x1830881260883072:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065119.048239:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.048254:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094362a00/0x14b4f8542d4f223d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a72d expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.048315:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.048327:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a726 expref: 17 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.048335:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.048359:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a726 expref: 17 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.048381:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a726 expref: 17 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.048391:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259657088:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.048456:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.049535:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259657088:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.049752:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065119.049796:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065119.050386:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260883200 00000100:00100000:1.0:1746065119.050392:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260883200 00010000:00010000:1.0:1746065119.050411:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a726 expref: 18 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.050443:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5133 00000100:00100000:1.0:1746065119.050601:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1961:x1830881260883200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.050611:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.050618:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a726 expref: 18 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.050626:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a726 expref: 18 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.050644:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800907a9000/0x14b4f8542d4f222f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a726 expref: 18 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.050655:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065119.050659:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.050667:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.050673:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.050697:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065119.050772:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.050778:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065119.050860:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:3.0:1746065119.050864:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065119.050876:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.050900:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094362a00/0x14b4f8542d4f223d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a72d expref: 18 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.051102:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1961:x1830881260883200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 503us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.051109:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5133 00010000:00010000:3.0:1746065119.051898:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a72d expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.051906:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.051909:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065119.051911:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094362c00, rc 0) 00000100:00100000:3.0:1746065119.051941:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:28829:x1830881260883072:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3722us (4149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.051948:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8940 00000100:00100000:0.0:1746065119.054698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.055418:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260883328 00000100:00100000:2.0:1746065119.055426:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260883328 00000100:00100000:2.0:1746065119.055471:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10317 00000100:00100000:2.0:1746065119.055479:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260883328:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.055497:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.055510:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800907a8000/0x14b4f8542d4f224b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a734 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.055555:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259657216:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065119.055629:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.055805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.055916:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260883456 00000100:00100000:1.0:1746065119.055921:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260883456 00000100:00100000:1.0:1746065119.055942:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10318 00000100:00100000:1.0:1746065119.055953:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260883456:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065119.055960:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065119.055971:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0095800/0x14b4f8542d4f2252 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a73b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.056010:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259657344:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065119.058084:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.058541:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259657216:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065119.058568:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800907a8000/0x14b4f8542d4f224b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a734 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.058581:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800907a8000/0x14b4f8542d4f224b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a734 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.058590:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800907a8000, rc 0) 00000100:00100000:3.0:1746065119.058616:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260883328:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3137us (3925us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065119.058623:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10317 00000100:00100000:1.0:1746065119.060712:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259657344:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065119.060736:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0095800/0x14b4f8542d4f2252 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a73b expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.060747:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0095800/0x14b4f8542d4f2252 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a73b expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.060756:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0095800, rc 0) 00000100:00100000:1.0:1746065119.060787:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260883456:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4840us (4982us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065119.060794:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10318 00000100:00100000:0.0:1746065119.064199:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.064286:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260883712 00000100:00100000:3.0:1746065119.064293:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260883712 00000100:00100000:3.0:1746065119.064329:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8941 00000100:00100000:3.0:1746065119.064336:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:28829:x1830881260883712:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065119.064350:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.064365:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094362e00/0x14b4f8542d4f2259 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a742 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.064928:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094363000/0x14b4f8542d4f2260 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.064940:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094363000/0x14b4f8542d4f2260 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.064950:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094363000/0x14b4f8542d4f2260 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065119.064960:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065119.065050:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094362e00/0x14b4f8542d4f2259 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a742 expref: 19 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.065061:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094363000/0x14b4f8542d4f2260 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a742 expref: 18 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.065068:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.065070:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065119.065073:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094363000, rc 0) 00000100:00100000:3.0:1746065119.065115:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:28829:x1830881260883712:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 779us (922us total) trans 8589942983 rc 0/0 00000100:00100000:3.0:1746065119.065121:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8941 00000100:00100000:0.0:1746065119.066785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.067545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.067572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.067597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.067615:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260883840 00000100:00100000:0.0:1746065119.067620:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260883840 00000100:00100000:0.0:1746065119.067653:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260884096 00000100:00100000:0.0:1746065119.067655:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260884096 00000100:00100000:0.0:1746065119.067665:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260884352 00000100:00100000:0.0:1746065119.067667:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260884352 00000100:00100000:0.0:1746065119.068184:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260883968 00000100:00100000:0.0:1746065119.068187:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260883968 00000100:00100000:3.0:1746065119.068226:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10319 00000100:00100000:3.0:1746065119.068235:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260883840:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065119.068268:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068290:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 47 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068297:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a48d expref: 29 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068304:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a44e expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068309:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.068311:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.068313:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068336:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a44e expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068345:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a44e expref: 8 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.068355:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259657472:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.068419:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a48d expref: 29 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068426:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a48d expref: 29 pid: 8851 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.068438:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259657600:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.068456:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 47 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068463:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 47 pid: 25185 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.068469:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259657728:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.068480:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.068494:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10320 00000100:00100000:3.0:1746065119.068499:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260884096:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065119.068514:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068523:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068528:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065119.068529:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065119.068531:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068542:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068553:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 29 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.068560:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259657856:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.068572:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.068592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.068642:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.068654:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260884224 00000100:00100000:3.0:1746065119.068656:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260884224 00000100:00100000:3.0:1746065119.068667:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260884480 00000100:00100000:3.0:1746065119.068668:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260884480 00000100:00100000:3.0:1746065119.068676:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10321 00000100:00100000:3.0:1746065119.068680:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260884352:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065119.068692:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068700:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068706:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a718 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068712:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 47 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068720:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.068721:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.068723:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068734:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 47 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068740:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 47 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.068747:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259657984:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.068771:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a718 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068778:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a718 expref: 9 pid: 9716 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.068784:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259658112:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.068809:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068830:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 29 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.068841:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259658240:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.068854:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.068867:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10322 00000100:00100000:3.0:1746065119.068871:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260883968:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065119.068884:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068893:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068899:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a9 expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068905:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a494 expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068910:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.068911:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.068913:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.068925:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a494 expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068932:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a494 expref: 29 pid: 21998 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.068940:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259658368:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.068963:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a9 expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.068970:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a9 expref: 10 pid: 4544 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.068976:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259658496:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.068995:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.069002:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 31 pid: 25185 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.069008:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259658624:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.069019:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.069613:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10323 00000100:00100000:2.0:1746065119.069625:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10324 00000100:00100000:2.0:1746065119.069632:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260884480:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065119.069648:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069656:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069662:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a71f expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.069668:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a68c expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069673:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.069674:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.069676:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069688:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a68c expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069694:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a68c expref: 29 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.069700:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259658752:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.069721:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a71f expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.069727:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a71f expref: 10 pid: 4544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746065119.069738:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259658880:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.069752:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069758:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.069765:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259659008:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.069778:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.069787:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260884224:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065119.069800:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069809:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069834:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.069836:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.069838:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069851:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.069858:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 29 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.069866:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259659136:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.069885:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.083552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.083610:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260884736 00000100:00100000:0.0:1746065119.083612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.083617:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260884736 00000100:00100000:0.0:1746065119.083645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065119.083646:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a48d expref: 30 pid: 8851 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1746065119.083675:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260885248 00000100:00100000:1.0:1746065119.083677:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260885248 00010000:00010000:1.0:1746065119.083687:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 48 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.083702:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5134 00000100:00100000:1.0:1746065119.083708:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881260884736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.083719:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.083741:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a48d expref: 30 pid: 8851 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746065119.083749:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a48d expref: 30 pid: 8851 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746065119.083773:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.083782:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259657472:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.083794:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb73600/0x14b4f8542d4f1e23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a48d expref: 30 pid: 8851 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1746065119.083803:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881260884736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.083807:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259657600:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065119.083809:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5134 00000100:00100000:3.0:1746065119.083837:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259657728:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065119.083844:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5135 00000100:00100000:1.0:1746065119.083848:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1958:x1830881260885248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.083854:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.083857:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.083861:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 48 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.083868:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 48 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.083878:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259658368:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065119.083878:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.083885:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259658496:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065119.083890:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1958:x1830881260885248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 42us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.083891:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259658624:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065119.083895:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5135 00010000:00010000:3.0:1746065119.083903:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.083919:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800907a9400/0x14b4f8542d4f21cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6e0 expref: 47 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.084010:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.084019:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260885504 00000100:00100000:1.0:1746065119.084022:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260885504 00010000:00010000:1.0:1746065119.084032:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 32 pid: 25185 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.084045:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5136 00000100:00100000:1.0:1746065119.084048:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881260885504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.084054:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065119.084060:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259658752:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065119.084065:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 32 pid: 25185 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.084072:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 32 pid: 25185 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.084072:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259658880:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.084079:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259659008:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065119.084084:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb07000/0x14b4f8542d4f1d90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a440 expref: 32 pid: 25185 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.084095:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065119.084098:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.084108:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881260885504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.084112:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5136 00000100:00100000:1.0:1746065119.084132:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259659136:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.084142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.084181:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260885376 00000100:00100000:2.0:1746065119.084184:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260885376 00010000:00010000:2.0:1746065119.084197:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a9 expref: 11 pid: 4544 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746065119.084216:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5137 00000100:00100000:3.0:1746065119.084221:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259657984:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.084221:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881260885376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065119.084227:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065119.084231:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259658112:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.084234:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a9 expref: 11 pid: 4544 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.084238:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259658240:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.084241:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a9 expref: 11 pid: 4544 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.084249:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.084251:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00cdc00/0x14b4f8542d4f1e4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a4a9 expref: 11 pid: 4544 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746065119.084261:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.084276:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260885376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.084280:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5137 00000100:00100000:3.0:1746065119.084285:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260884992 00000100:00100000:3.0:1746065119.084288:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260884992 00000100:00100000:2.0:1746065119.084299:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259657856:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.084309:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065119.084317:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1327104->2097151) req@ffff88009a4e9880 x1830881260884992/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.084326:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9880 with x1830881260884992 ext(1327104->2097151) 00010000:00010000:3.0:1746065119.084331:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00000100:00080000:2.0:1746065119.084332:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746065119.084338:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746065119.084344:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e9880 00000100:00100000:3.0:1746065119.084354:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1473 00000100:00100000:3.0:1746065119.084359:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881260884992:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065119.084801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.084840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.084850:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260885632 00000100:00100000:0.0:1746065119.084853:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260885632 00010000:00010000:0.0:1746065119.084864:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a71f expref: 10 pid: 4544 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746065119.084876:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260884864 00000100:00100000:0.0:1746065119.084877:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260884864 00010000:00010000:0.0:1746065119.084884:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 47 pid: 25185 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.084894:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5138 00000100:00100000:0.0:1746065119.084898:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260885632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.084903:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.084912:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a71f expref: 10 pid: 4544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746065119.084918:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a71f expref: 10 pid: 4544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746065119.084928:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095400/0x14b4f8542d4f2221 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a71f expref: 10 pid: 4544 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746065119.084939:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065119.084973:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.084990:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5139 00000100:00100000:1.0:1746065119.084996:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881260884864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.085005:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.085014:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 47 pid: 25185 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.085021:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 47 pid: 25185 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.085031:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb07e00/0x14b4f8542d4f1d58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a42b expref: 47 pid: 25185 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.085038:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.085176:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260885632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 57us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.085181:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5138 00000100:00100000:3.0:1746065119.085913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.086005:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260885760 00000100:00100000:2.0:1746065119.086009:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260885760 00002000:00100000:2.0:1746065119.086025:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1163263) req@ffff88013026bb80 x1830881260885760/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.086033:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026bb80 with x1830881260885760 ext(1048576->1163263) 00010000:00010000:2.0:1746065119.086037:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 29 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.086046:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 29 pid: 8429 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746065119.086052:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013026bb80 00000100:00100000:2.0:1746065119.086063:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1474 00000100:00100000:2.0:1746065119.086068:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881260885760:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065119.086313:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881260884864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1316us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.086319:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5139 00000100:00100000:3.0:1746065119.086590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.086605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.086617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.086628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.086641:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260884608 00000100:00100000:3.0:1746065119.086644:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260884608 00010000:00010000:3.0:1746065119.086657:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a44e expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.086679:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260885120 00000100:00100000:3.0:1746065119.086681:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260885120 00010000:00010000:3.0:1746065119.086689:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a718 expref: 11 pid: 9716 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.086701:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260885888 00000100:00100000:3.0:1746065119.086703:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260885888 00010000:00010000:3.0:1746065119.086711:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a494 expref: 32 pid: 21998 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.086723:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260886016 00000100:00100000:3.0:1746065119.086725:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260886016 00010000:00010000:3.0:1746065119.086731:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.086740:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5140 00000100:00100000:3.0:1746065119.086744:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260884608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.086751:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.086762:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a44e expref: 11 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.086770:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a44e expref: 11 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.086782:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb72200/0x14b4f8542d4f1db3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a44e expref: 11 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.086791:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.086792:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.086795:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.086802:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.086833:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.086851:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260884608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.086856:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5140 00000100:00100000:3.0:1746065119.086865:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5141 00000100:00100000:3.0:1746065119.086869:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260885120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.086875:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.086882:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a718 expref: 9 pid: 9716 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.086890:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a718 expref: 9 pid: 9716 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.086899:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800907a8800/0x14b4f8542d4f2213 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a718 expref: 9 pid: 9716 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.086907:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.086919:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260885120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.086923:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5141 00000100:00100000:3.0:1746065119.086932:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5142 00000100:00100000:3.0:1746065119.086936:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+32:1960:x1830881260885888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.086941:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.086950:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a494 expref: 32 pid: 21998 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.086957:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a494 expref: 32 pid: 21998 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.086968:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb72a00/0x14b4f8542d4f1e31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a494 expref: 32 pid: 21998 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.086975:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.086977:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.086979:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.086984:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.086996:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.087008:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881260885888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.087012:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5142 00000100:00100000:3.0:1746065119.087021:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5143 00000100:00100000:3.0:1746065119.087026:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260886016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.087031:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.087037:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.087044:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.087053:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f803400/0x14b4f8542d4f21b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6c4 expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.087066:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.087067:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.087069:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087074:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087085:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.087097:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881260886016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.087102:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5143 00010000:00010000:3.0:1746065119.087115:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087122:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087136:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087143:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087148:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087158:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01b4600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065119.087161:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087166:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087175:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087180:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4600/0x14b4f8542d4f2283 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.087210:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260883968:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 18338us (19613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.087217:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10322 00010000:00010000:3.0:1746065119.087236:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087242:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087253:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087259:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087265:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087270:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f803800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065119.087272:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087277:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087284:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087290:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f803800/0x14b4f8542d4f227c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.087316:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881260884352:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 18636us (19743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.087321:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10321 00010000:00010000:3.0:1746065119.087334:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087340:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087352:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087358:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087363:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087382:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094362800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065119.087384:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087390:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087398:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.087403:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094362800/0x14b4f8542d4f226e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.087428:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1958:x1830881260883840:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 19195us (20649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.087433:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10319 00000100:00100000:3.0:1746065119.087468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.087480:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260886144 00000100:00100000:3.0:1746065119.087482:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260886144 00010000:00010000:3.0:1746065119.087493:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.087503:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5144 00000100:00100000:3.0:1746065119.087507:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881260886144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.087512:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.087519:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.087525:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.087535:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909d9800/0x14b4f8542d4f2125 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a669 expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.087543:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.087555:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881260886144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 48us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.087560:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5144 00000100:00100000:2.0:1746065119.088227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.088236:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260886272 00000100:00100000:0.0:1746065119.088241:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260886272 00010000:00010000:0.0:1746065119.088256:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a68c expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.088271:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5145 00000100:00100000:0.0:1746065119.088277:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881260886272:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.088283:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.088293:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a68c expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.088301:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a68c expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.088312:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb74e00/0x14b4f8542d4f2141 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a68c expref: 31 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.088321:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.088322:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.088325:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088332:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088346:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.088361:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260886272:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.088377:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5145 00010000:00010000:0.0:1746065119.088395:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088402:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088414:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088420:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088425:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088430:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800907a9e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065119.088433:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088438:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088445:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.088450:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800907a9e00/0x14b4f8542d4f228a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.088494:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881260884480:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 18864us (19850us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.088502:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10324 00000100:00100000:2.0:1746065119.095246:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260885760:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9167us (9323us total) trans 17179872716 rc 0/0 00000100:00100000:2.0:1746065119.095257:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1474 00002000:00100000:2.0:1746065119.095267:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1163263) req@ffff88013026bb80 x1830881260885760/t17179872716(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.095277:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026bb80 with x1830881260885760 ext(1048576->1163263) 00010000:00010000:2.0:1746065119.095287:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 30 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.095298:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 30 pid: 8429 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746065119.095305:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013026bb80 00000100:00100000:3.0:1746065119.095341:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881260884992:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10981us (11727us total) trans 21474839950 rc 0/0 00000100:00100000:3.0:1746065119.095348:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1473 00002000:00100000:3.0:1746065119.095354:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1327104->2097151) req@ffff88009a4e9880 x1830881260884992/t21474839950(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.095360:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9880 with x1830881260884992 ext(1327104->2097151) 00010000:00010000:3.0:1746065119.095377:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.095391:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746065119.095397:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e9880 00000100:00100000:0.0:1746065119.097640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.097732:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260886400 00000100:00100000:1.0:1746065119.097740:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260886400 00010000:00010000:1.0:1746065119.097766:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 30 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.097800:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5146 00000100:00100000:1.0:1746065119.097807:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881260886400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.097841:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.097858:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 30 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.097868:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 30 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.097887:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f21aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6bd expref: 30 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.097899:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.097901:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.097905:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.097912:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.097931:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065119.097959:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881260886400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 152us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.097965:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5146 00000100:00100000:0.0:1746065119.098250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.098397:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260886528 00000100:00100000:3.0:1746065119.098401:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260886528 00010000:00010000:3.0:1746065119.098415:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.098441:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5147 00000100:00100000:3.0:1746065119.098446:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881260886528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.098453:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.098651:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.098660:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.098682:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.098691:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.098698:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.098710:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.098746:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.098759:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800907a9200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065119.098762:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.098770:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.098780:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.098790:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800907a9200/0x14b4f8542d4f2291 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.098849:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1958:x1830881260884224:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 29227us (30255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.098855:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10323 00010000:00010000:3.0:1746065119.098911:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00db400/0x14b4f8542d4f219c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a6af expref: 30 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.098932:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.098934:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.098936:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.098946:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.098957:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.098972:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+29:1959:x1830881260886528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 526us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.098977:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5147 00010000:00010000:0.0:1746065119.099352:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.099359:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.099379:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.099384:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.099390:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.099394:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094363e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065119.099396:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.099401:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.099410:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.099415:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f2275 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.099456:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1958:x1830881260884096:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 30956us (31911us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.099461:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10320 00000100:00100000:0.0:1746065119.100890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.100943:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260886784 00000100:00100000:3.0:1746065119.100949:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260886784 00000100:00100000:3.0:1746065119.100974:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8942 00000100:00100000:3.0:1746065119.100980:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:28829:x1830881260886784:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:3.0:1746065119.101017:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.101033:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094362c00/0x14b4f8542d4f2244 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a72d expref: 18 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.101045:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.101048:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065119.101069:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.101078:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f195a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a202 expref: 32 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.101084:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4f1961 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a209 expref: 32 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.101089:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2600/0x14b4f8542d4f1968 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a210 expref: 282 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.101095:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157800/0x14b4f8542d4f1c16 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a391 expref: 282 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.101100:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3bb expref: 32 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.101280:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.101351:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3bb expref: 32 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.101362:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3bb expref: 32 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.101384:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659264:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.101842:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157800/0x14b4f8542d4f1c16 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a391 expref: 282 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.101850:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157800/0x14b4f8542d4f1c16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a391 expref: 282 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.101857:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659392:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.102212:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2600/0x14b4f8542d4f1968 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a210 expref: 282 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.102220:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2600/0x14b4f8542d4f1968 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a210 expref: 282 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.102228:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659520:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.102263:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4f1961 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a209 expref: 32 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.102270:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4f1961 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a209 expref: 32 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.102277:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659648:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.102296:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f195a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a202 expref: 32 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.102303:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f195a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a202 expref: 32 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.102309:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659776:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.102490:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.104204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.104235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.104254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.104270:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260886912 00000100:00100000:0.0:1746065119.104275:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260886912 00000100:00100000:2.0:1746065119.104279:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260887168 00000100:00100000:2.0:1746065119.104284:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260887168 00010000:00010000:0.0:1746065119.104296:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3bb expref: 33 pid: 20754 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.104300:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2600/0x14b4f8542d4f1968 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a210 expref: 283 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.104305:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260887040 00000100:00100000:1.0:1746065119.104308:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260887040 00000100:00100000:0.0:1746065119.104315:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5148 00000100:00100000:2.0:1746065119.104319:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5149 00010000:00010000:1.0:1746065119.104319:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157800/0x14b4f8542d4f1c16 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a391 expref: 284 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.104320:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+33:1961:x1830881260886912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065119.104325:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:1961:x1830881260887168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.104329:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065119.104331:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065119.104331:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5150 00010000:00010000:0.0:1746065119.104333:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3bb expref: 33 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.104334:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:1961:x1830881260887040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065119.104335:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2600/0x14b4f8542d4f1968 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a210 expref: 284 pid: 20754 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.104339:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.104341:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157800/0x14b4f8542d4f1c16 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a391 expref: 284 pid: 20754 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.104342:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3bb expref: 33 pid: 20754 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.104596:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2600/0x14b4f8542d4f1968 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a210 expref: 284 pid: 20754 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.104608:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157800/0x14b4f8542d4f1c16 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a391 expref: 284 pid: 20754 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.104622:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065119.104625:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.104633:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065119.104656:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00000100:00100000:1.0:1746065119.104657:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:1961:x1830881260887040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 322us (403us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065119.104659:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065119.104661:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5150 00010000:00010000:2.0:1746065119.104665:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.104684:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:1961:x1830881260887168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 359us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.104692:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5149 00000100:00100000:3.0:1746065119.105250:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659264:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.105259:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0157800/0x14b4f8542d4f1c16 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a391 expref: 282 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.105269:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659392:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.105275:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2600/0x14b4f8542d4f1968 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a210 expref: 281 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.105282:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659520:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065119.105377:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb07600/0x14b4f8542d4f1c78 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a3bb expref: 33 pid: 20754 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.105386:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.105389:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.105394:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.105419:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+32:1961:x1830881260886912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1098us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.105424:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5148 00000100:00100000:0.0:1746065119.106957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.107014:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260887296 00000100:00100000:1.0:1746065119.107020:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260887296 00010000:00010000:1.0:1746065119.107045:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4f1961 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a209 expref: 32 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.107073:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5151 00000100:00100000:1.0:1746065119.107080:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+32:1960:x1830881260887296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.107090:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.107095:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4f1961 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a209 expref: 32 pid: 20754 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.107104:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4f1961 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a209 expref: 32 pid: 20754 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.107122:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065119.107125:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065119.107134:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065119.107167:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4f1961 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a209 expref: 32 pid: 20754 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.107168:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+32:1960:x1830881260887296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.107172:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5151 00000100:00100000:3.0:1746065119.107181:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659648:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.107190:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259659776:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.107229:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065119.107375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.107398:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260887424 00000100:00100000:0.0:1746065119.107401:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260887424 00010000:00010000:0.0:1746065119.107413:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f195a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a202 expref: 31 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.107436:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5152 00000100:00100000:0.0:1746065119.107440:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881260887424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.107446:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.107449:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f195a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a202 expref: 31 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.107456:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f195a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a202 expref: 31 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.107470:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0156800/0x14b4f8542d4f195a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a202 expref: 31 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.107479:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.107481:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.107487:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.107493:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.107506:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.107522:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881260887424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.107527:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5152 00010000:00010000:3.0:1746065119.107659:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065119.107665:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000040:00080000:3.0:1746065119.109220:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2457, 88 off206032 00000004:00080000:3.0:1746065119.109230:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718400413733ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.109281:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2405, 88 off201272 00000004:00080000:3.0:1746065119.109285:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718400470099ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.110272:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2406, 88 off201360 00000004:00080000:3.0:1746065119.110278:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718401462215ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.110299:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2458, 88 off206120 00000004:00080000:3.0:1746065119.110302:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718401486614ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.110318:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2459, 88 off206208 00000004:00080000:3.0:1746065119.110320:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718401505064ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.110327:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2407, 88 off201448 00000004:00080000:3.0:1746065119.110330:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718401514277ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.110341:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2408, 88 off201536 00000004:00080000:3.0:1746065119.110343:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718401528189ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.110351:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2409, 88 off201624 00000004:00080000:3.0:1746065119.110353:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718401537862ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.110360:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2460, 88 off206296 00000004:00080000:3.0:1746065119.110362:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718401546765ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.110377:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2410, 88 off201712 00000004:00080000:3.0:1746065119.110380:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718401564345ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.110386:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2461, 88 off206384 00000004:00080000:3.0:1746065119.110389:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718401573345ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.110394:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2411, 88 off201800 00000004:00080000:3.0:1746065119.110399:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718401583627ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.110404:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2462, 88 off206472 00000004:00080000:3.0:1746065119.110407:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718401591605ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.110412:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2463, 88 off206560 00000004:00080000:3.0:1746065119.110415:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718401599374ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.110421:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2464, 88 off206648 00000004:00080000:3.0:1746065119.110423:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718401607777ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.110428:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2465, 88 off206736 00000004:00080000:3.0:1746065119.110431:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718401615415ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.110436:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2412, 88 off201888 00000004:00080000:3.0:1746065119.110438:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718401622541ns, next at 666938887344ns, rc = 0 00000001:00080000:3.0:1746065119.128527:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942973 is committed 00000001:00080000:3.0:1746065119.128545:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942979 is committed 00000001:00080000:3.0:1746065119.128558:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942963 is committed 00000001:00080000:3.0:1746065119.128561:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942957 is committed 00000001:00080000:3.0:1746065119.128581:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942981 is committed 00000001:00080000:3.0:1746065119.128585:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942980 is committed 00000001:00080000:3.0:1746065119.128594:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942962 is committed 00000004:00010000:2.0:1746065119.128611:0:24350:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a4ead80 reply state ffff880090abc400 transno 8589942984 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000001:00080000:3.0:1746065119.128621:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942984 is committed 00000100:00100000:2.0:1746065119.128622:0:24350:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1746065119.128624:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1706 committed 00000004:00080000:3.0:1746065119.128630:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1759 committed 00000004:00080000:3.0:1746065119.128634:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1758 committed 00000004:00080000:3.0:1746065119.128636:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1757 committed 00000004:00080000:3.0:1746065119.128637:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1756 committed 00000004:00080000:3.0:1746065119.128639:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1705 committed 00000004:00080000:3.0:1746065119.128641:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1755 committed 00000004:00080000:3.0:1746065119.128642:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1704 committed 00000004:00080000:3.0:1746065119.128644:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1754 committed 00000004:00080000:3.0:1746065119.128645:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1703 committed 00000004:00080000:3.0:1746065119.128647:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1702 committed 00000004:00080000:3.0:1746065119.128648:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1701 committed 00000004:00080000:3.0:1746065119.128649:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1753 committed 00000004:00080000:3.0:1746065119.128651:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1752 committed 00000004:00080000:3.0:1746065119.128652:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1700 committed 00000004:00080000:3.0:1746065119.128653:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1699 committed 00000004:00080000:3.0:1746065119.128655:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1751 committed 00010000:00080000:2.0:1746065119.128708:0:24350:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065119.128722:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28829:x1830881260886784:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 27738us (27831us total) trans 8589942984 rc 0/0 00000100:00100000:2.0:1746065119.128730:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8942 00000100:00100000:0.0:1746065119.128866:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259660160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.128905:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.128945:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259659904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.128964:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.128977:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065119.128981:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259660032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.128994:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.129012:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259660160 00000100:00100000:0.0:1746065119.129018:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259660160 00000100:00100000:0.0:1746065119.129050:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259659904 00000100:00100000:0.0:1746065119.129052:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259659904 00000100:00100000:0.0:1746065119.129063:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259660032 00000100:00100000:0.0:1746065119.129065:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259660032 00000100:00100000:0.0:1746065119.129075:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10325 00000100:00100000:0.0:1746065119.129081:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881259660160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.129262:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3295:x1830881259660160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (356us total) trans 21474839951 rc 0/0 00000100:00100000:0.0:1746065119.129267:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10325 00000100:00100000:0.0:1746065119.129279:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10326 00000100:00100000:0.0:1746065119.129282:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259659904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.129357:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3297:x1830881259659904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (393us total) trans 21474839952 rc 0/0 00000100:00100000:0.0:1746065119.129361:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10326 00000100:00100000:0.0:1746065119.129380:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10327 00000100:00100000:0.0:1746065119.129384:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259660032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.129455:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3297:x1830881259660032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (460us total) trans 21474839953 rc 0/0 00000100:00100000:0.0:1746065119.129459:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10327 00000004:00080000:0.0:1746065119.129494:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131b09180/2, rc 0, transno 21474839953 00000100:00100000:0.0:1746065119.129497:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259660032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065119.129503:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131b08000/2, rc 0, transno 21474839952 00000100:00100000:0.0:1746065119.129505:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259659904:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065119.129514:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff22300/2, rc 0, transno 21474839951 00000100:00100000:0.0:1746065119.129516:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259660160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.129519:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065119.129523:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259660288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.129537:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.129550:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259660288 00000100:00100000:0.0:1746065119.129552:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259660288 00000100:00100000:0.0:1746065119.129565:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10328 00000100:00100000:0.0:1746065119.129568:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881259660288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.129655:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3295:x1830881259660288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (117us total) trans 17179872717 rc 0/0 00000100:00100000:0.0:1746065119.129660:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10328 00000004:00080000:0.0:1746065119.129681:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094245880/2, rc 0, transno 17179872717 00000100:00100000:0.0:1746065119.129684:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259660288:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746065119.130620:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.130629:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.130635:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.130641:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01b5000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065119.130645:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.130651:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065119.130652:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259660800:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065119.130664:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.130667:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065119.130670:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.130675:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01b5000/0x14b4f8542d4f2298 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065119.130679:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.130702:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065119.130706:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259660672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.130719:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.130735:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259660416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.130748:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.130757:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259660928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.130770:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.130779:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065119.130783:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259660544:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1746065119.130834:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065119.130838:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065119.130951:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.130975:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259660800 00000100:00100000:0.0:1746065119.130979:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259660800 00000100:00100000:0.0:1746065119.130995:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259660672 00000100:00100000:0.0:1746065119.130997:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259660672 00000100:00100000:0.0:1746065119.131006:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259660416 00000100:00100000:0.0:1746065119.131008:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259660416 00000100:00100000:0.0:1746065119.131017:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259660928 00000100:00100000:0.0:1746065119.131019:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259660928 00000100:00100000:0.0:1746065119.131026:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259660544 00000100:00100000:0.0:1746065119.131028:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259660544 00000100:00100000:0.0:1746065119.131037:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10329 00000100:00100000:0.0:1746065119.131042:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3296:x1830881259660800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065119.131151:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065119.131153:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.131155:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.131156:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.131158:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065119.131179:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3296:x1830881259660800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (500us total) trans 21474839954 rc 0/0 00000100:00100000:0.0:1746065119.131184:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10329 00000100:00100000:0.0:1746065119.131196:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10330 00000100:00100000:0.0:1746065119.131200:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3296:x1830881259660672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065119.131220:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10331 00000100:00100000:1.0:1746065119.131226:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3297:x1830881259660416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065119.131254:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10332 00000100:00100000:1.0:1746065119.131259:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830881259660928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065119.131279:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065119.131281:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.131282:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.131284:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.131285:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065119.131303:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3296:x1830881259660672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (582us total) trans 21474839955 rc 0/0 00000100:00100000:0.0:1746065119.131307:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10330 00000100:00100000:0.0:1746065119.131317:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10333 00000100:00100000:0.0:1746065119.131321:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259660544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065119.131342:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259660928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (571us total) trans 21474839956 rc 0/0 00000100:00100000:1.0:1746065119.131347:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10332 00000100:00100000:1.0:1746065119.131382:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259661184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.131401:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065119.131418:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259661696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.131430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065119.131438:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065119.131442:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259661312:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065119.131443:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065119.131446:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065119.131447:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.131449:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065119.131450:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:1.0:1746065119.131452:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065119.131457:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259661824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.131469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.131471:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259660544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (520us total) trans 21474839957 rc 0/0 00000100:00100000:0.0:1746065119.131476:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10333 00000100:00100000:1.0:1746065119.131480:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259661184 00000100:00100000:1.0:1746065119.131482:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259661184 00000100:00100000:0.0:1746065119.131485:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259661696 00000100:00100000:0.0:1746065119.131487:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259661696 00000100:00100000:1.0:1746065119.131492:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259661312 00000100:00100000:1.0:1746065119.131493:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259661312 00000100:00100000:0.0:1746065119.131496:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259661824 00000100:00100000:0.0:1746065119.131497:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259661824 00000100:00100000:1.0:1746065119.131501:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10334 00000100:00100000:1.0:1746065119.131505:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3295:x1830881259661184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.131506:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10335 00000100:00100000:1.0:1746065119.131600:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881259661184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (198us total) trans 17179872718 rc 0/0 00000100:00100000:1.0:1746065119.131605:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10334 00000100:00100000:1.0:1746065119.131614:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10336 00000100:00100000:0.0:1746065119.131721:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3295:x1830881259661696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.131812:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881259661696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 295us (374us total) trans 17179872719 rc 0/0 00000100:00100000:0.0:1746065119.131833:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10335 00000100:00100000:0.0:1746065119.131847:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10337 00000100:00100000:0.0:1746065119.131852:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3295:x1830881259661824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.131926:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881259661824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (455us total) trans 17179872720 rc 0/0 00000100:00100000:0.0:1746065119.131930:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10337 00000004:00080000:0.0:1746065119.132898:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff23800/2, rc 0, transno 21474839955 00000100:00100000:0.0:1746065119.132905:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259660672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065119.132913:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d137b80/2, rc 0, transno 21474839954 00000100:00100000:0.0:1746065119.132916:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259660800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065119.133655:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3295:x1830881259661312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065119.133780:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065119.133783:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.133784:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.133786:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.133787:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065119.133834:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881259661312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2214us (2380us total) trans 17179872721 rc 0/0 00000100:00100000:1.0:1746065119.133840:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10336 00000100:00100000:0.0:1746065119.133997:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259661440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.134207:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259661056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.134230:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065119.134257:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259661952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.134269:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065119.134290:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff23100/2, rc 0, transno 21474839957 00000100:00100000:0.0:1746065119.134294:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259660544:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065119.134302:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d136300/2, rc 0, transno 21474839956 00000100:00100000:0.0:1746065119.134304:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259660928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065119.134335:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259660416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3109us (3584us total) trans 21474839958 rc 0/0 00000100:00100000:1.0:1746065119.134340:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10331 00000100:00100000:0.0:1746065119.134426:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.134444:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259661440 00000100:00100000:0.0:1746065119.134449:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259661440 00000100:00100000:1.0:1746065119.134456:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259661952 00000100:00100000:1.0:1746065119.134459:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259661952 00000100:00100000:0.0:1746065119.134471:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10338 00000100:00100000:1.0:1746065119.134475:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10339 00000100:00100000:0.0:1746065119.134476:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259661440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.134479:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259661952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.134551:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3297:x1830881259661952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (280us total) trans 17179872722 rc 0/0 00000100:00100000:0.0:1746065119.134554:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260887552 00000100:00100000:1.0:1746065119.134555:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10339 00000100:00100000:0.0:1746065119.134557:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260887552 00000100:00100000:0.0:1746065119.134577:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8943 00000100:00100000:0.0:1746065119.134581:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28829:x1830881260887552:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.134593:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1746065119.134594:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094247100/2, rc 0, transno 17179872721 00000100:00100000:1.0:1746065119.134598:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259661312:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065119.134605:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094246680/2, rc 0, transno 17179872720 00010000:00010000:0.0:1746065119.134606:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a749 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.134608:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259661824:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065119.134615:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094246d80/2, rc 0, transno 17179872718 00000100:00100000:1.0:1746065119.134618:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259661184:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065119.134624:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094247b80/2, rc 0, transno 17179872719 00000100:00100000:1.0:1746065119.134626:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259661696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.134640:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065119.134643:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a749 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.134652:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259661568:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746065119.134654:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a749 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.134664:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065119.134672:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.134675:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065119.134678:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094363a00, rc 0) 00000100:00100000:1.0:1746065119.134679:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259661056 00000100:00100000:1.0:1746065119.134681:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259661056 00000100:00100000:1.0:1746065119.134690:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259661568 00000100:00100000:1.0:1746065119.134692:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259661568 00000100:00100000:1.0:1746065119.134700:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10340 00000100:00100000:1.0:1746065119.134704:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259661056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.134706:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28829:x1830881260887552:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 123us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.134711:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8943 00000100:00100000:0.0:1746065119.134730:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10341 00000100:00100000:0.0:1746065119.134735:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259661568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.134778:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3298:x1830881259661056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (136us total) trans 17179872723 rc 0/0 00000100:00100000:1.0:1746065119.134782:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10340 00000004:00080000:1.0:1746065119.134848:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094246a00/2, rc 0, transno 17179872723 00000100:00100000:1.0:1746065119.134851:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259661056:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065119.135781:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065119.135785:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.135786:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.135788:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.135790:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065119.135843:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3297:x1830881259661440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1366us (1612us total) trans 17179872724 rc 0/0 00000100:00100000:1.0:1746065119.135852:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10338 00002000:00010000:0.0:1746065119.136030:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065119.136420:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.136422:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.136423:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.136424:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065119.136453:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3298:x1830881259661568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1718us (1787us total) trans 17179872725 rc 0/0 00000100:00100000:0.0:1746065119.136459:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10341 00000004:00080000:0.0:1746065119.136534:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094247480/2, rc 0, transno 17179872724 00000100:00100000:0.0:1746065119.136538:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259661440:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065119.136595:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094247800/2, rc 0, transno 17179872725 00000004:00080000:0.0:1746065119.136596:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094244000/2, rc 0, transno 17179872722 00000100:00100000:1.0:1746065119.136600:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259661568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.136600:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259661952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065119.136610:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff21880/2, rc 0, transno 21474839958 00000100:00100000:0.0:1746065119.136613:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259660416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065119.137019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.137839:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260887680 00000100:00100000:1.0:1746065119.137846:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260887680 00000100:00100000:1.0:1746065119.137876:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8944 00000100:00100000:1.0:1746065119.137882:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28829:x1830881260887680:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065119.137893:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065119.137907:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c4600/0x14b4f8542d4f22a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a750 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.137966:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c4200/0x14b4f8542d4f22ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065119.137976:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c4200/0x14b4f8542d4f22ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065119.137985:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c4200/0x14b4f8542d4f22ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065119.138005:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:1.0:1746065119.138009:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065119.138020:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c4200/0x14b4f8542d4f22ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065119.138040:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c4600/0x14b4f8542d4f22a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a750 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.138053:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c4200/0x14b4f8542d4f22ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a750 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.138060:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065119.138063:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065119.138065:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c4200, rc 0) 00000100:00100000:1.0:1746065119.138096:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260887680:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 214us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.138101:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8944 00000100:00100000:0.0:1746065119.145673:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.146037:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260887936 00000100:00100000:0.0:1746065119.146045:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260887936 00000100:00100000:0.0:1746065119.146082:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10342 00000100:00100000:0.0:1746065119.146090:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881260887936:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.146105:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.146123:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a75e expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065119.146141:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6de, atime: 0x6812d6de, ctime: 0x6812d6de, blocks: 0x821 00010000:00010000:0.0:1746065119.146155:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146157:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146164:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a75e expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146175:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a75e expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146184:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094363800, rc 0) 00000100:00100000:0.0:1746065119.146216:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260887936:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 128us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.146221:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10342 00000100:00100000:0.0:1746065119.146251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.146309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.146318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.146330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.146350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.146373:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260888192 00000100:00100000:0.0:1746065119.146377:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260888192 00000100:00100000:0.0:1746065119.146393:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260888448 00000100:00100000:0.0:1746065119.146394:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260888448 00000100:00100000:0.0:1746065119.146403:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260887808 00000100:00100000:0.0:1746065119.146405:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260887808 00000100:00100000:0.0:1746065119.146412:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260888064 00000100:00100000:0.0:1746065119.146413:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260888064 00000100:00100000:0.0:1746065119.146420:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260888320 00000100:00100000:0.0:1746065119.146421:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260888320 00000100:00100000:0.0:1746065119.146429:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10343 00000100:00100000:0.0:1746065119.146433:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260888192:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.146440:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.146449:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a76c expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065119.146462:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6df, atime: 0x6812d6df, ctime: 0x6812d6df, blocks: 0x821 00010000:00010000:0.0:1746065119.146469:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146471:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146474:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a76c expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146483:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a76c expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146490:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094362600, rc 0) 00000100:00100000:0.0:1746065119.146508:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260888192:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 74us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.146513:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10343 00000100:00100000:0.0:1746065119.146523:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10344 00000100:00100000:0.0:1746065119.146528:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260888448:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.146533:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.146540:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a77a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065119.146548:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6df, atime: 0x6812d6df, ctime: 0x6812d6df, blocks: 0x1029 00010000:00010000:0.0:1746065119.146555:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146556:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146560:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a77a expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146567:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a77a expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146573:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094363e00, rc 0) 00000100:00100000:0.0:1746065119.146588:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260888448:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 60us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.146591:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10344 00000100:00100000:0.0:1746065119.146601:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10345 00000100:00100000:0.0:1746065119.146605:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260887808:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.146610:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.146617:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a757 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065119.146626:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6de, atime: 0x6812d6de, ctime: 0x6812d6de, blocks: 0x7ed 00010000:00010000:0.0:1746065119.146632:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146634:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146638:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a757 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146645:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a757 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146651:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094363200, rc 0) 00000100:00100000:0.0:1746065119.146676:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260887808:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.146681:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10345 00000100:00100000:0.0:1746065119.146692:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10346 00000100:00100000:0.0:1746065119.146696:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260888064:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.146702:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.146708:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a765 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065119.146717:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6df, atime: 0x6812d6df, ctime: 0x6812d6df, blocks: 0x821 00010000:00010000:0.0:1746065119.146724:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146725:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.146728:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a765 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146735:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a765 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.146741:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094363400, rc 0) 00000100:00100000:0.0:1746065119.146755:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260888064:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 59us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.146759:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10346 00000100:00100000:0.0:1746065119.146770:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10347 00000100:00100000:0.0:1746065119.147208:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260888320:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.147332:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.147340:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a773 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065119.147350:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 4974112, mtime: 0x6812d6df, atime: 0x6812d6df, ctime: 0x6812d6df, blocks: 0x14af 00010000:00010000:0.0:1746065119.147357:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.147359:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.147363:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a773 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.147383:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a773 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.147390:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094362c00, rc 0) 00000100:00100000:0.0:1746065119.147408:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260888320:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 633us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.147412:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10347 00000100:00100000:0.0:1746065119.157847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.157864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.157876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.157893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.157911:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260888704 00000100:00100000:0.0:1746065119.157920:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260888704 00000100:00100000:0.0:1746065119.157955:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260888960 00000100:00100000:0.0:1746065119.157957:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260888960 00000100:00100000:0.0:1746065119.157968:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260889344 00000100:00100000:0.0:1746065119.157969:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260889344 00000100:00100000:0.0:1746065119.157977:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260889472 00000100:00100000:0.0:1746065119.157978:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260889472 00000100:00100000:0.0:1746065119.157989:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4739 00000100:00100000:0.0:1746065119.157995:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260888704:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065119.158021:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.158032:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.158034:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.158038:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.158048:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.160363:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4740 00000100:00100000:0.0:1746065119.160384:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260888960:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065119.160414:0:21488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.160424:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.160426:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.160429:0:21488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.160443:0:21488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.160836:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4741 00000100:00100000:0.0:1746065119.160841:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881260889344:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065119.160858:0:21483:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.160865:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.160866:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.160868:0:21483:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.160875:0:21483:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.161545:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4742 00000100:00100000:3.0:1746065119.161553:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260889472:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065119.161568:0:21482:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.161574:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.161575:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.161578:0:21482:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.161585:0:21482:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.166121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.168885:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260889728 00000100:00100000:0.0:1746065119.168895:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260889728 00000100:00100000:0.0:1746065119.168943:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4743 00000100:00100000:0.0:1746065119.168950:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881260889728:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065119.168976:0:21486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.168988:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.168989:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065119.169727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.169747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.169771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.169788:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260889984 00000100:00100000:3.0:1746065119.169792:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260889984 00000100:00100000:3.0:1746065119.169831:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260890240 00000100:00100000:3.0:1746065119.169833:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260890240 00000100:00100000:3.0:1746065119.169847:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260890496 00000100:00100000:3.0:1746065119.169849:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260890496 00000100:00100000:3.0:1746065119.169861:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4744 00000100:00100000:3.0:1746065119.169867:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1959:x1830881260889984:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065119.169883:0:350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.169891:0:350:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.169892:0:350:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.169896:0:350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.169907:0:350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.170636:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4745 00000100:00100000:2.0:1746065119.170644:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1958:x1830881260890240:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065119.170663:0:8433:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.170738:0:21486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.170754:0:21486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.170779:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4746 00000100:00100000:0.0:1746065119.170785:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1958:x1830881260890496:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065119.170797:0:21485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.170804:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.170805:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.170808:0:21485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.171386:0:21485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.171889:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.171892:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.171896:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.171906:0:8433:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.184088:0:21482:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.184101:0:21482:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.184109:0:21482:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.184115:0:21482:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01b5600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065119.184118:0:21482:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.184130:0:21482:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.184144:0:21482:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.184149:0:21482:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01b5600/0x14b4f8542d4f22f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.184198:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1959:x1830881260889472:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 22642us (26299us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.184207:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4742 00010000:00010000:2.0:1746065119.186376:0:350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.186389:0:350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.186395:0:350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.186400:0:350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009485a000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065119.186403:0:350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.186409:0:350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.186424:0:350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.186429:0:350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009485a000/0x14b4f8542d4f2301 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.186473:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1959:x1830881260889984:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 16602us (16744us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.186480:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4744 00010000:00010000:2.0:1746065119.193169:0:8433:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.193182:0:8433:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.193189:0:8433:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.193195:0:8433:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800907a8400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065119.193198:0:8433:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.193204:0:8433:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.193219:0:8433:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.193230:0:8433:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800907a8400/0x14b4f8542d4f2308 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.193280:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1958:x1830881260890240:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 22634us (23528us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.193288:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4745 00010000:00010000:2.0:1746065119.201931:0:21488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.201944:0:21488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.201952:0:21488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.201958:0:21488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094371a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065119.201962:0:21488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.201969:0:21488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.201986:0:21488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.201991:0:21488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4f22e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.202056:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881260888960:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 41671us (44186us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.202065:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4740 00010000:00010000:0.0:1746065119.202388:0:21483:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.202397:0:21483:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.202403:0:21483:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.202408:0:21483:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8b6e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065119.202410:0:21483:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.202416:0:21483:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.202424:0:21483:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.202429:0:21483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8b6e00/0x14b4f8542d4f22ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.202475:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881260889344:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 41633us (44597us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065119.202481:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4741 00010000:00010000:0.0:1746065119.214711:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.214724:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.214731:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.214737:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800900c8000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065119.214740:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.214747:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.214768:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.214774:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900c8000/0x14b4f8542d4f22de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.214875:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260888704:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 56876us (57029us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065119.214885:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4739 00010000:00010000:1.0:1746065119.216165:0:21486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.216175:0:21486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.216181:0:21486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.216186:0:21486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134d8ec00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065119.216189:0:21486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.216196:0:21486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.216206:0:21486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.216212:0:21486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134d8ec00/0x14b4f8542d4f22fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.216254:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881260889728:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 47303us (50141us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065119.216261:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4743 00010000:00010000:0.0:1746065119.216344:0:21485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.216352:0:21485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.216357:0:21485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.216361:0:21485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134d8e400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065119.216363:0:21485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.216378:0:21485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.216387:0:21485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.216396:0:21485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134d8e400/0x14b4f8542d4f230f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.216432:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260890496:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 45647us (46660us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065119.216438:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4746 00000100:00100000:1.0:1746065119.225223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.225246:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260890752 00000100:00100000:0.0:1746065119.225255:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260890752 00000100:00100000:0.0:1746065119.225294:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8945 00000100:00100000:0.0:1746065119.225301:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260890752:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:0.0:1746065119.225341:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.225363:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c4200/0x14b4f8542d4f22ad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a750 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.225388:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.225393:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065119.225422:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.225432:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.225439:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00010000:0.0:1746065119.225589:0:24350:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ff20a80 reply state ffff880094299000 transno 8589942985 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065119.225598:0:24350:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065119.225664:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28829:x1830881260890752:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 363us (447us total) trans 8589942985 rc 0/0 00000100:00100000:0.0:1746065119.225670:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8945 00010000:00010000:2.0:1746065119.228545:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.228555:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.228561:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.228566:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935dcc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065119.228569:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.228575:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.228587:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.228589:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065119.228592:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.228597:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dcc00/0x14b4f8542d4f2316 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065119.228658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.228763:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260890880 00000100:00100000:0.0:1746065119.228771:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260890880 00000100:00100000:0.0:1746065119.228802:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10348 00000100:00100000:0.0:1746065119.228809:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28829:x1830881260890880:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.228839:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.228851:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a781 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.228879:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a757 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.228886:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.228887:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.228890:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.228914:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a757 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.228924:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a757 expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746065119.228935:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259662080:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.229005:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.231802:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259662080:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.231845:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065119.231849:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.231864:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b48f8400, rc 0) 00000100:00100000:0.0:1746065119.231901:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260890880:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3092us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.231909:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10348 00000100:00100000:3.0:1746065119.232177:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260891008 00000100:00100000:3.0:1746065119.232183:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260891008 00010000:00010000:3.0:1746065119.232204:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a757 expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.232227:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5153 00000100:00100000:3.0:1746065119.232233:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260891008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.232243:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.232261:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a757 expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.232270:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a757 expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.232287:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094363200/0x14b4f8542d4f22c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a757 expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.232295:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.232297:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.232302:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.232309:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.232334:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.232343:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259662208:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065119.232402:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.235747:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.235923:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260891136 00000100:00100000:1.0:1746065119.235934:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260891136 00000100:00100000:1.0:1746065119.235968:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10349 00000100:00100000:1.0:1746065119.235975:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260891136:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065119.235992:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065119.236007:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a788 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.236030:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a75e expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.236038:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.236040:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.236043:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.236067:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a75e expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.236077:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a75e expref: 10 pid: 9716 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1746065119.236093:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259662336:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065119.236159:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b402d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.237012:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259662208:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065119.237027:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.237052:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260891008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4819us (5209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.237066:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5153 00000100:00100000:1.0:1746065119.239512:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259662336:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065119.239535:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.239551:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c4000, rc 0) 00000100:00100000:1.0:1746065119.239595:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28829:x1830881260891136:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3619us (3854us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.239601:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10349 00000100:00100000:2.0:1746065119.239880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.243356:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260891264 00000100:00100000:0.0:1746065119.243375:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260891264 00010000:00010000:0.0:1746065119.243404:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a75e expref: 10 pid: 9716 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746065119.243430:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5154 00000100:00100000:0.0:1746065119.243437:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260891264:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.243450:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.243470:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a75e expref: 10 pid: 9716 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746065119.243486:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a75e expref: 10 pid: 9716 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746065119.243506:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094363800/0x14b4f8542d4f22b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a75e expref: 10 pid: 9716 timeout: 818 lvb_type: 1 00010000:00010000:0.0:1746065119.243515:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.243517:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.243523:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.243530:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.243557:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.243567:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259662464:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065119.243664:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.251326:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259662464:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065119.251345:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.251395:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260891264:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7958us (11515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.251404:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5154 00000100:00100000:1.0:1746065119.251955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.251998:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260891392 00000100:00100000:0.0:1746065119.252004:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260891392 00000100:00100000:0.0:1746065119.252029:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10350 00000100:00100000:0.0:1746065119.252034:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260891392:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.252047:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.252059:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a78f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.252080:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a765 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.252086:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.252088:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.252090:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.252112:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a765 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.252122:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a765 expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746065119.252132:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259662592:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.252172:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3000 going to sleep for 11 seconds 00000001:00080000:0.0:1746065119.253027:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839940 is committed 00000001:00080000:0.0:1746065119.253043:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839941 is committed 00000001:00080000:0.0:1746065119.253053:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839916 is committed 00000001:00080000:0.0:1746065119.253061:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839947 is committed 00000001:00080000:0.0:1746065119.253067:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839945 is committed 00000001:00080000:0.0:1746065119.253103:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839950 is committed 00000100:00100000:2.0:1746065119.254537:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259662592:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.254560:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.254573:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935dda00, rc 0) 00000100:00100000:2.0:1746065119.254721:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28829:x1830881260891392:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2685us (2765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.254729:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10350 00000100:00100000:0.0:1746065119.256382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.256452:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260891520 00000100:00100000:2.0:1746065119.256459:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260891520 00010000:00010000:2.0:1746065119.256485:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a765 expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746065119.256676:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5155 00000100:00100000:2.0:1746065119.256683:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260891520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065119.256695:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065119.256717:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a765 expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746065119.256728:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a765 expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746065119.256751:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094363400/0x14b4f8542d4f22d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a765 expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746065119.256763:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.256764:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.256770:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.256777:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.256803:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.256838:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259662720:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065119.256906:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304b4000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.259088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.259109:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259662720:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065119.259373:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.259416:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260891520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2733us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.259426:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5155 00000100:00100000:3.0:1746065119.259518:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260891648 00000100:00100000:3.0:1746065119.259523:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260891648 00000100:00100000:3.0:1746065119.259563:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10351 00000100:00100000:3.0:1746065119.259569:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28829:x1830881260891648:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065119.259584:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.259596:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a796 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.259618:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a76c expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.259624:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.259625:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.259629:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.259649:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a76c expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.259660:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a76c expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.259670:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259662848:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.259724:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.260927:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259662848:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.260944:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.260954:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b0800, rc 0) 00000100:00100000:3.0:1746065119.260975:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260891648:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1407us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.260981:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10351 00000100:00100000:0.0:1746065119.263635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.264127:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260891776 00000100:00100000:2.0:1746065119.264135:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260891776 00010000:00010000:2.0:1746065119.264165:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a76c expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746065119.264856:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5156 00000100:00100000:2.0:1746065119.264864:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260891776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065119.264875:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065119.264891:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a76c expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746065119.264901:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a76c expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746065119.264920:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094362600/0x14b4f8542d4f22bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a76c expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746065119.264933:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.265149:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.265157:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.265165:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.265193:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.265203:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259662976:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065119.265277:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.266791:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259662976:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065119.266806:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.266853:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260891776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1989us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.266862:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5156 00000100:00100000:3.0:1746065119.271299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.271668:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260891904 00000100:00100000:0.0:1746065119.271677:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260891904 00000100:00100000:0.0:1746065119.271734:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10352 00000100:00100000:0.0:1746065119.271741:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28829:x1830881260891904:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.271760:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.271774:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a79d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.271797:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a773 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.271805:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.271807:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.271810:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.271852:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a773 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.271862:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a773 expref: 9 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746065119.271873:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259663104:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.272082:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.275460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.275528:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260892032 00000100:00100000:3.0:1746065119.275536:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260892032 00010000:00010000:3.0:1746065119.275606:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a773 expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746065119.275629:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5157 00000100:00100000:3.0:1746065119.275636:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260892032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.275644:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.275663:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a773 expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.275674:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a773 expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.275695:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.275697:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.275702:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.275710:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.275736:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.275746:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259663232:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065119.275804:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084480 going to sleep for 11 seconds 00010000:00010000:2.0:1746065119.275855:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094362c00/0x14b4f8542d4f22d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a773 expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746065119.275869:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259663104:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.275887:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.275895:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f716a00, rc 0) 00000100:00100000:2.0:1746065119.275919:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260891904:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4178us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.275925:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10352 00000100:00100000:0.0:1746065119.278980:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.279039:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260892160 00000100:00100000:2.0:1746065119.279047:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260892160 00000100:00100000:3.0:1746065119.279065:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259663232:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065119.279079:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10353 00010000:00010000:3.0:1746065119.279081:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.279085:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260892160:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.279099:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065119.279112:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260892032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3476us (3662us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065119.279118:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7a4 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.279119:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5157 00010000:00010000:2.0:1746065119.279140:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a77a expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.279152:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.279153:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.279156:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.279178:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a77a expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.279189:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a77a expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746065119.279198:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259663360:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.279234:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304b4000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.280747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.280879:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260892288 00000100:00100000:3.0:1746065119.280883:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260892288 00010000:00010000:3.0:1746065119.280902:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a77a expref: 11 pid: 8429 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746065119.280970:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259663360:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.280987:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.280997:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093036e00, rc 0) 00000100:00100000:2.0:1746065119.281032:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28829:x1830881260892160:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1946us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.281038:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10353 00000100:00100000:3.0:1746065119.281498:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5158 00000100:00100000:3.0:1746065119.281504:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260892288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.281513:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065119.281526:0:15963:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4137 -> 4139 00010000:00010000:3.0:1746065119.281532:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a77a expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.281541:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a77a expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.281563:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094363e00/0x14b4f8542d4f22c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a77a expref: 10 pid: 8429 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746065119.281585:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.281586:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.281591:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.281598:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.281617:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.281626:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259663488:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065119.281664:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9084480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.282653:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259663488:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065119.282662:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.282904:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260892288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1400us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.282912:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5158 00000100:00100000:0.0:1746065119.283361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.283419:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260892544 00000100:00100000:2.0:1746065119.283423:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260892544 00000100:00100000:0.0:1746065119.283441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.283504:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260892416 00000100:00100000:2.0:1746065119.283507:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260892416 00000100:00100000:0.0:1746065119.283524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.283525:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10354 00000100:00100000:2.0:1746065119.283530:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260892544:12345-192.168.202.46@tcp:2:lfs.0 00000100:00100000:0.0:1746065119.283539:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260892800 00000100:00100000:0.0:1746065119.283542:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260892800 00000100:00100000:0.0:1746065119.283558:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10355 00000100:00100000:0.0:1746065119.283563:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260892416:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:2.0:1746065119.283667:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065119.283667:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065119.283670:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065118 -> 1746065119 00002000:00010000:0.0:1746065119.283670:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065118 -> 1746065119 00002000:00010000:2.0:1746065119.283672:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065118 -> 1746065119 00002000:00010000:0.0:1746065119.283672:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065118 -> 1746065119 00002000:00010000:2.0:1746065119.283674:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065118 -> 1746065120 00002000:00010000:0.0:1746065119.283674:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065118 -> 1746065120 00002000:00010000:2.0:1746065119.283676:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2077 00002000:00010000:0.0:1746065119.283676:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2029 -> 2029 00000100:00100000:2.0:1746065119.283696:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260892544:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 166us (336us total) trans 21474839959 rc 0/0 00000100:00100000:0.0:1746065119.283696:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260892416:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 132us (254us total) trans 17179872726 rc 0/0 00000100:00100000:2.0:1746065119.283701:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10354 00000100:00100000:0.0:1746065119.284252:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10355 00000100:00100000:0.0:1746065119.284265:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10356 00000100:00100000:0.0:1746065119.284271:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260892800:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065119.284333:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065119.284335:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:0.0:1746065119.284337:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:0.0:1746065119.284339:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065119 -> 1746065120 00002000:00010000:0.0:1746065119.284341:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065119.284357:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260892800:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 86us (833us total) trans 17179872727 rc 0/0 00000100:00100000:0.0:1746065119.284362:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10356 00000100:00100000:0.0:1746065119.284415:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.284440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.284464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.284477:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260893056 00000100:00100000:0.0:1746065119.284480:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260893056 00000100:00100000:0.0:1746065119.284494:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260892672 00000100:00100000:0.0:1746065119.284496:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260892672 00000100:00100000:0.0:1746065119.284504:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260892928 00000100:00100000:0.0:1746065119.284505:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260892928 00000100:00100000:0.0:1746065119.284515:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10357 00000100:00100000:0.0:1746065119.284519:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260893056:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065119.284585:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065119.284587:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:0.0:1746065119.284589:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:0.0:1746065119.284590:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065119 -> 1746065120 00002000:00010000:0.0:1746065119.284592:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746065119.284607:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260893056:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 87us (191us total) trans 21474839960 rc 0/0 00000100:00100000:0.0:1746065119.284612:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10357 00000100:00100000:0.0:1746065119.284622:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10358 00000100:00100000:0.0:1746065119.284627:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260892672:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065119.284683:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065119.284685:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:0.0:1746065119.284687:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:0.0:1746065119.284688:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065119 -> 1746065120 00002000:00010000:0.0:1746065119.284690:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065119.284704:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260892672:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 77us (263us total) trans 21474839961 rc 0/0 00000100:00100000:0.0:1746065119.284712:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10358 00000100:00100000:0.0:1746065119.284722:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10359 00000100:00100000:0.0:1746065119.284726:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260892928:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065119.284779:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 4974112 -> 4974112 00002000:00010000:0.0:1746065119.284781:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:0.0:1746065119.284783:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:0.0:1746065119.284784:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065119 -> 1746065120 00002000:00010000:0.0:1746065119.284785:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5295 -> 5295 00000100:00100000:0.0:1746065119.284800:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260892928:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 73us (335us total) trans 17179872728 rc 0/0 00000100:00100000:0.0:1746065119.284805:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10359 00000100:00100000:0.0:1746065119.287045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.287066:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260893312 00000100:00100000:0.0:1746065119.287072:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260893312 00000100:00100000:0.0:1746065119.287100:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3633 00000100:00100000:0.0:1746065119.287107:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260893312:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:0.0:1746065119.287146:0:16801:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x309:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094363000/0x14b4f8542d4f2260 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a742 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.287179:0:16801:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16801 initiator: MDT0 00010000:00010000:0.0:1746065119.287189:0:16801:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a749 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.287195:0:16801:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16801 initiator: MDT0 00010000:00010000:0.0:1746065119.287218:0:16801:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a749 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.287228:0:16801:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a749 expref: 9 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.287238:0:16801:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16801:1830881259663616:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.287284:0:16801:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.295519:0:16801:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16801:1830881259663616:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065119.295541:0:16801:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00000100:00100000:0.0:1746065119.297217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.299379:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260893440 00000100:00100000:2.0:1746065119.299388:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260893440 00010000:00010000:2.0:1746065119.299418:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a749 expref: 10 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.299443:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5159 00000100:00100000:2.0:1746065119.299450:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260893440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065119.299462:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065119.299467:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a749 expref: 10 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.299478:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a749 expref: 10 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.299497:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094363a00/0x14b4f8542d4f229f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a749 expref: 10 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.299516:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.299520:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00010000:00010000:2.0:1746065119.299529:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16801 initiator: MDT0 00010000:00010000:2.0:1746065119.299534:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16801 initiator: MDT0 00010000:00010000:2.0:1746065119.299550:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.299593:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260893440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 143us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.299599:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5159 00010000:00010000:0.0:1746065119.301415:0:16801:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00010000:00010000:0.0:1746065119.301425:0:16801:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00000040:00080000:0.0:1746065119.302271:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2466, 88 off206824 00000004:00080000:0.0:1746065119.302278:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718593462132ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065119.302692:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2413, 88 off201976 00000004:00080000:0.0:1746065119.302696:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718593880992ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065119.302719:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2414, 88 off202064 00000004:00080000:0.0:1746065119.302722:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718593906669ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065119.302729:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2467, 88 off206912 00000004:00080000:0.0:1746065119.302732:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718593916542ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065119.302738:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2468, 88 off207000 00000004:00080000:0.0:1746065119.302741:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718593925772ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.302922:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2415, 88 off202152 00000004:00080000:3.0:1746065119.302927:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718594111897ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.302945:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2416, 88 off202240 00000004:00080000:3.0:1746065119.302948:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718594133018ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.302954:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2417, 88 off202328 00000004:00080000:3.0:1746065119.302956:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718594140965ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.302963:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2469, 88 off207088 00000004:00080000:3.0:1746065119.302965:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718594149885ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.302971:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2418, 88 off202416 00000004:00080000:3.0:1746065119.302973:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718594157432ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.302978:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2470, 88 off207176 00000004:00080000:3.0:1746065119.302980:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718594164663ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.302985:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2419, 88 off202504 00000004:00080000:3.0:1746065119.302987:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718594171817ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065119.302992:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2471, 88 off207264 00000004:00080000:3.0:1746065119.302994:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718594178397ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.302999:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2472, 88 off207352 00000004:00080000:3.0:1746065119.303001:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718594185529ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.303006:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2473, 88 off207440 00000004:00080000:3.0:1746065119.303008:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718594192332ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.303012:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2474, 88 off207528 00000004:00080000:3.0:1746065119.303014:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718594198817ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065119.303019:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2420, 88 off202592 00000004:00080000:3.0:1746065119.303021:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718594205759ns, next at 666938887344ns, rc = 0 00000004:00010000:3.0:1746065119.355426:0:16801:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c3faa00 reply state ffff88009bff0000 transno 8589942986 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00000100:00100000:3.0:1746065119.355440:0:16801:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065119.355447:0:16801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.355450:0:16801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065119.355457:0:16801:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094363000/0x14b4f8542d4f2260 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a742 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.355562:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28829:x1830881260893312:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 68454us (68521us total) trans 8589942986 rc 0/0 00000100:00100000:3.0:1746065119.355571:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3633 00000001:00080000:3.0:1746065119.355607:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942986 is committed 00000004:00080000:3.0:1746065119.355611:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1714 committed 00000004:00080000:3.0:1746065119.355617:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1768 committed 00000004:00080000:3.0:1746065119.355621:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1767 committed 00000004:00080000:3.0:1746065119.355623:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1766 committed 00000004:00080000:3.0:1746065119.355624:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1765 committed 00000004:00080000:3.0:1746065119.355627:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1713 committed 00000004:00080000:3.0:1746065119.355628:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1764 committed 00000004:00080000:3.0:1746065119.355630:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1712 committed 00000004:00080000:3.0:1746065119.355631:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1763 committed 00000004:00080000:3.0:1746065119.355633:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1711 committed 00000004:00080000:3.0:1746065119.355634:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1710 committed 00000004:00080000:3.0:1746065119.355636:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1709 committed 00000004:00080000:3.0:1746065119.355637:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1762 committed 00000004:00080000:3.0:1746065119.355641:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1761 committed 00000004:00080000:3.0:1746065119.355643:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1708 committed 00000004:00080000:3.0:1746065119.355644:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1707 committed 00000004:00080000:3.0:1746065119.355645:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1760 committed 00010000:00010000:3.0:1746065119.355742:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065119.355749:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065119.355756:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065119.355763:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f717e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065119.355766:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065119.355772:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065119.355783:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.355785:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065119.355787:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065119.355792:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f717e00/0x14b4f8542d4f2347 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16801 initiator: MDT0 00000100:00100000:3.0:1746065119.355893:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259663744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.355926:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.355954:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259664256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.355966:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.355978:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065119.355982:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259664128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.355994:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.356002:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259664640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.356013:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.356028:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259663872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.356039:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.356048:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259664384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.356060:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.356068:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065119.356072:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259664000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.356082:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.356091:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259664512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.356101:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.356120:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259663744 00000100:00100000:3.0:1746065119.356126:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259663744 00000100:00100000:3.0:1746065119.356148:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259664256 00000100:00100000:3.0:1746065119.356150:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259664256 00000100:00100000:3.0:1746065119.356159:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259664128 00000100:00100000:3.0:1746065119.356160:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259664128 00000100:00100000:3.0:1746065119.356165:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259664640 00000100:00100000:3.0:1746065119.356167:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259664640 00000100:00100000:3.0:1746065119.356171:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259663872 00000100:00100000:3.0:1746065119.356173:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259663872 00000100:00100000:3.0:1746065119.356177:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259664384 00000100:00100000:3.0:1746065119.356179:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259664384 00000100:00100000:3.0:1746065119.356183:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259664000 00000100:00100000:3.0:1746065119.356184:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259664000 00000100:00100000:3.0:1746065119.356189:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259664512 00000100:00100000:3.0:1746065119.356190:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259664512 00000100:00100000:3.0:1746065119.356196:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10360 00000100:00100000:3.0:1746065119.356202:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3298:x1830881259663744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065119.356404:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065119.356407:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.356409:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.356411:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:3.0:1746065119.356413:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2029 -> 2033 00000100:00100000:3.0:1746065119.356434:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881259663744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (507us total) trans 17179872729 rc 0/0 00000100:00100000:3.0:1746065119.356439:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10360 00000100:00100000:3.0:1746065119.356449:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10361 00000100:00100000:3.0:1746065119.356454:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3298:x1830881259664256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065119.356516:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356518:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356520:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356521:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356523:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065119.356538:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881259664256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (571us total) trans 17179872730 rc 0/0 00000100:00100000:3.0:1746065119.356543:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10361 00000100:00100000:3.0:1746065119.356551:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10362 00000100:00100000:3.0:1746065119.356554:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3298:x1830881259664128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065119.356607:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356609:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356611:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356613:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356614:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065119.356628:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881259664128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (634us total) trans 17179872731 rc 0/0 00000100:00100000:3.0:1746065119.356632:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10362 00000100:00100000:3.0:1746065119.356640:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10363 00000100:00100000:3.0:1746065119.356644:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3298:x1830881259664640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.356708:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881259664640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (694us total) trans 17179872732 rc 0/0 00000100:00100000:3.0:1746065119.356713:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10363 00000100:00100000:3.0:1746065119.356720:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10364 00000100:00100000:3.0:1746065119.356724:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3295:x1830881259663872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065119.356783:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065119.356785:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.356787:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.356789:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:3.0:1746065119.356791:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065119.356809:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881259663872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (768us total) trans 17179872733 rc 0/0 00000100:00100000:3.0:1746065119.356829:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10364 00000100:00100000:3.0:1746065119.356843:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10365 00000100:00100000:3.0:1746065119.356847:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3295:x1830881259664384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065119.356903:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356905:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356906:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356908:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.356909:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065119.356925:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881259664384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (864us total) trans 17179872734 rc 0/0 00000100:00100000:3.0:1746065119.356929:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10365 00000100:00100000:3.0:1746065119.356937:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10366 00000100:00100000:3.0:1746065119.356941:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3295:x1830881259664000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065119.357003:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 4974112 -> 4974112 00002000:00010000:3.0:1746065119.357005:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.357007:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.357009:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:3.0:1746065119.357011:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5295 -> 5295 00000100:00100000:3.0:1746065119.357025:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881259664000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (942us total) trans 17179872735 rc 0/0 00000100:00100000:3.0:1746065119.357029:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10366 00000100:00100000:3.0:1746065119.357037:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10367 00000100:00100000:3.0:1746065119.357041:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3295:x1830881259664512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.357114:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881259664512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1012us total) trans 17179872736 rc 0/0 00000100:00100000:3.0:1746065119.357118:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10367 00000004:00080000:3.0:1746065119.357176:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130269500/2, rc 0, transno 17179872735 00000100:00100000:3.0:1746065119.357183:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259664000:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.357188:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130268000/2, rc 0, transno 17179872736 00000100:00100000:3.0:1746065119.357191:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259664512:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.357196:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013026ad80/2, rc 0, transno 17179872733 00000100:00100000:3.0:1746065119.357198:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259663872:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.357203:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130268700/2, rc 0, transno 17179872734 00000100:00100000:3.0:1746065119.357205:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259664384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.357230:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065119.357235:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259664768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.357252:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.357267:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259664768 00000100:00100000:3.0:1746065119.357271:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259664768 00000100:00100000:3.0:1746065119.357284:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10368 00000100:00100000:3.0:1746065119.357288:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881259664768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.357358:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881259664768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (105us total) trans 17179872737 rc 0/0 00000100:00100000:3.0:1746065119.357375:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10368 00000004:00080000:3.0:1746065119.357393:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90ace00/2, rc 0, transno 17179872737 00000100:00100000:3.0:1746065119.357396:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259664768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.357406:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013026a680/2, rc 0, transno 17179872731 00000100:00100000:3.0:1746065119.357408:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259664128:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.357413:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013026aa00/2, rc 0, transno 17179872732 00000100:00100000:3.0:1746065119.357415:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259664640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.357420:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130268a80/2, rc 0, transno 17179872729 00000100:00100000:3.0:1746065119.357422:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259663744:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.357427:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013026b480/2, rc 0, transno 17179872730 00000100:00100000:3.0:1746065119.357429:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259664256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065119.361531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.361551:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260893568 00000100:00100000:0.0:1746065119.361556:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260893568 00000100:00100000:0.0:1746065119.361584:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8946 00000100:00100000:0.0:1746065119.361591:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:28829:x1830881260893568:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.361606:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.361619:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7ab expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.361660:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ab expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.361671:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ab expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.361684:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.361687:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065119.361690:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0f9200, rc 0) 00000100:00100000:0.0:1746065119.361722:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28829:x1830881260893568:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 132us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.361728:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8946 00000100:00100000:3.0:1746065119.364014:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259665024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.364065:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065119.364089:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259665024 00000100:00100000:2.0:1746065119.364096:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259665024 00000100:00100000:3.0:1746065119.364097:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259665536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.364110:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065119.364121:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259665536 00000100:00100000:3.0:1746065119.364122:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746065119.364123:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259665536 00000100:00100000:3.0:1746065119.364126:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259664896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065119.364135:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10369 00000100:00100000:3.0:1746065119.364136:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065119.364141:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881259665024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.364145:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259665408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.364154:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.364168:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259664896 00000100:00100000:3.0:1746065119.364170:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259664896 00000100:00100000:3.0:1746065119.364182:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259665408 00000100:00100000:3.0:1746065119.364183:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259665408 00000100:00100000:3.0:1746065119.364191:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10370 00000100:00100000:3.0:1746065119.364195:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3296:x1830881259665536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.364254:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10371 00000100:00100000:3.0:1746065119.364258:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881259664896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065119.364276:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065119.364279:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:2.0:1746065119.364281:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:2.0:1746065119.364282:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:2.0:1746065119.364284:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065119.364310:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881259665024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (245us total) trans 21474839962 rc 0/0 00000100:00100000:2.0:1746065119.364315:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10369 00000100:00100000:2.0:1746065119.364326:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10372 00002000:00010000:3.0:1746065119.364327:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065119.364329:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00000100:00100000:2.0:1746065119.364330:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881259665408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065119.364331:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.364333:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:3.0:1746065119.364334:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065119.364353:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881259664896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (215us total) trans 21474839964 rc 0/0 00000100:00100000:3.0:1746065119.364358:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10371 00000100:00100000:3.0:1746065119.364391:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259665152:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065119.364404:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:2.0:1746065119.364407:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00000100:00100000:3.0:1746065119.364408:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746065119.364408:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065119.364410:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065119.364412:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:3.0:1746065119.364419:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259665664:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065119.364429:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881259665408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (274us total) trans 21474839965 rc 0/0 00000100:00100000:3.0:1746065119.364432:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065119.364434:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10372 00000100:00100000:2.0:1746065119.364442:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259665152 00000100:00100000:3.0:1746065119.364443:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065119.364444:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259665152 00000100:00100000:3.0:1746065119.364448:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259665280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.364459:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.365527:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259665792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.365551:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065119.365636:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259665664 00000100:00100000:2.0:1746065119.365641:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259665664 00000100:00100000:2.0:1746065119.365658:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259665280 00000100:00100000:2.0:1746065119.365660:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259665280 00000100:00100000:3.0:1746065119.365663:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259665792 00000100:00100000:3.0:1746065119.365667:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259665792 00000100:00100000:2.0:1746065119.365667:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10373 00000100:00100000:2.0:1746065119.365672:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259665152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.365684:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10374 00000100:00100000:3.0:1746065119.365689:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259665664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065119.365747:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065119.365749:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:2.0:1746065119.365751:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:2.0:1746065119.365753:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:2.0:1746065119.365754:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00002000:00010000:3.0:1746065119.365774:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065119.365777:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:2.0:1746065119.365777:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259665152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (1369us total) trans 21474839966 rc 0/0 00002000:00010000:3.0:1746065119.365779:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.365781:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.365782:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065119.365783:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10373 00000100:00100000:2.0:1746065119.365793:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10375 00000100:00100000:2.0:1746065119.365797:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259665280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.365804:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259665664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (1370us total) trans 21474839967 rc 0/0 00000100:00100000:3.0:1746065119.365810:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10374 00000100:00100000:3.0:1746065119.365841:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10376 00000100:00100000:3.0:1746065119.365846:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259665792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065119.365889:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259665280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (1428us total) trans 21474839968 rc 0/0 00000100:00100000:2.0:1746065119.365894:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10375 00000100:00100000:3.0:1746065119.365934:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259665792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (382us total) trans 21474839969 rc 0/0 00000100:00100000:3.0:1746065119.365939:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10376 00002000:00010000:2.0:1746065119.365966:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065119.365968:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065119.365970:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065119.365972:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065119.365973:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065119.365990:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259665536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1794us (1879us total) trans 21474839963 rc 0/0 00000100:00100000:2.0:1746065119.365995:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10370 00000100:00100000:3.0:1746065119.366035:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839940 gen 2 00000004:00080000:3.0:1746065119.366040:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a13100, transno 21474839925 00000004:00080000:3.0:1746065119.366047:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a11500, transno 21474839926 00000004:00080000:3.0:1746065119.366049:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a13480, transno 21474839927 00000004:00080000:3.0:1746065119.366051:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd05c00, transno 21474839928 00000004:00080000:3.0:1746065119.366053:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a12d80, transno 21474839929 00000004:00080000:3.0:1746065119.366055:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a11180, transno 21474839930 00000004:00080000:3.0:1746065119.366057:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a13b80, transno 21474839931 00000004:00080000:3.0:1746065119.366059:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026b800, transno 21474839932 00000004:00080000:3.0:1746065119.366061:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb14700, transno 21474839933 00000004:00080000:3.0:1746065119.366063:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45e680, transno 21474839934 00000004:00080000:3.0:1746065119.366066:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb15c00, transno 21474839935 00000004:00080000:3.0:1746065119.366068:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4b3b80, transno 21474839936 00000004:00080000:3.0:1746065119.366070:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb17800, transno 21474839937 00000004:00080000:3.0:1746065119.366072:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb16680, transno 21474839938 00000004:00080000:3.0:1746065119.366074:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb17b80, transno 21474839939 00000004:00080000:3.0:1746065119.366075:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba3b80, transno 21474839940 00000100:00100000:3.0:1746065119.366081:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009ff22300 x1830881259660160/t21474839951(21474839951) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065135 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746065119.366089:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d134700/2, rc 0, transno 21474839964 00000100:00100000:3.0:1746065119.366093:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259664896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.366102:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d136d80/2, rc 0, transno 21474839965 00000100:00100000:3.0:1746065119.366105:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259665408:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.366112:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d137800/2, rc 0, transno 21474839962 00000100:00100000:3.0:1746065119.366115:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259665024:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.366135:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d135880/2, rc 0, transno 21474839963 00000100:00100000:3.0:1746065119.366139:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259665536:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.366164:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d135c00/2, rc 0, transno 21474839968 00000100:00100000:3.0:1746065119.366167:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259665280:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.366174:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d134e00/2, rc 0, transno 21474839969 00000100:00100000:3.0:1746065119.366177:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259665792:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.366183:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d135500/2, rc 0, transno 21474839966 00000100:00100000:3.0:1746065119.366185:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259665152:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.366191:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d137480/2, rc 0, transno 21474839967 00000100:00100000:3.0:1746065119.366193:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259665664:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065119.366290:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 16 in progress, 0 in flight, 16 done 00000100:00100000:0.0:1746065119.368322:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.369659:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260893824 00000100:00100000:3.0:1746065119.369667:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260893824 00000100:00100000:3.0:1746065119.369698:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3634 00000100:00100000:3.0:1746065119.369705:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28829:x1830881260893824:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1746065119.369887:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28829:x1830881260893824:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 181us (1569us total) trans 8589942987 rc 0/0 00000100:00100000:3.0:1746065119.369893:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3634 00000001:00080000:3.0:1746065119.410417:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872728 is committed 00000001:00080000:3.0:1746065119.410490:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872725 is committed 00000001:00080000:3.0:1746065119.410500:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872702 is committed 00000001:00080000:3.0:1746065119.410520:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872712 is committed 00000001:00080000:3.0:1746065119.410528:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872709 is committed 00000001:00080000:3.0:1746065119.410558:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872716 is committed 00000001:00080000:3.0:1746065119.410568:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872713 is committed 00000001:00080000:3.0:1746065119.410612:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872715 is committed 00000100:00100000:0.0:1746065119.412811:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.413071:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260894080 00000100:00100000:2.0:1746065119.413079:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260894080 00000100:00100000:2.0:1746065119.413116:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8947 00000100:00100000:2.0:1746065119.413124:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:28837:x1830881260894080:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065119.413145:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.413160:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f2355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7b2 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.413302:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.413312:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065119.413405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065119.413460:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.413479:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.413485:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.413490:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065119.413680:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260894336 00000100:00100000:0.0:1746065119.413684:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260894336 00000100:00100000:0.0:1746065119.413722:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8948 00000100:00100000:0.0:1746065119.413728:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+7:28840:x1830881260894336:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065119.413738:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.413745:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4f236a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7b9 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.413782:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.413788:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.413795:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.413801:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.413807:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.413812:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.414062:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1400/0x14b4f8542d4f237f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414070:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1400/0x14b4f8542d4f237f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414076:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1400/0x14b4f8542d4f237f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065119.414084:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065119.414147:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414153:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414158:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414163:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdd0400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065119.414166:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414172:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414181:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065119.414184:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065119.414187:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414190:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f235c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414201:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414205:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414209:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414212:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdd0e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065119.414214:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414219:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414223:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205a00) 00010000:00010000:2.0:1746065119.414225:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065119.414227:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414231:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f2363 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065119.414257:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f2355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b2 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.414268:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1400/0x14b4f8542d4f237f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b2 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.414273:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.414275:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065119.414277:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd1400, rc 0) 00000100:00100000:2.0:1746065119.414327:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28837:x1830881260894080:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1203us (1523us total) trans 8589942988 rc 0/0 00000100:00100000:2.0:1746065119.414333:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8947 00010000:00010000:0.0:1746065119.414511:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414517:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414522:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065119.414527:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:0.0:1746065119.414560:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414568:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414572:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414575:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfca00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065119.414577:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414581:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414587:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065119.414589:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065119.414591:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414594:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4f2371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414602:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414606:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414611:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414614:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfc600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065119.414616:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414623:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414628:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205a00) 00010000:00010000:0.0:1746065119.414630:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065119.414632:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414636:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4f2378 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065119.414655:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4f236a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b9 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.414662:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b9 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.414667:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.414669:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065119.414670:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfce00, rc 0) 00000100:00100000:0.0:1746065119.414703:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:28840:x1830881260894336:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 975us (1298us total) trans 8589942989 rc 0/0 00000100:00100000:0.0:1746065119.414709:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8948 00000100:00100000:0.0:1746065119.422060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.422148:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260894592 00000100:00100000:2.0:1746065119.422155:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260894592 00000100:00100000:2.0:1746065119.422935:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8949 00000100:00100000:2.0:1746065119.422943:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28841:x1830881260894592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.422964:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.422978:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1a00/0x14b4f8542d4f239b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7c0 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.423054:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0200/0x14b4f8542d4f23a2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.423066:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0200/0x14b4f8542d4f23a2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065119.423075:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0200/0x14b4f8542d4f23a2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065119.423085:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065119.423176:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1a00/0x14b4f8542d4f239b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c0 expref: 252 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.423190:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0200/0x14b4f8542d4f23a2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c0 expref: 251 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.423197:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.423200:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065119.423202:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd0200, rc 0) 00000100:00100000:2.0:1746065119.423239:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28841:x1830881260894592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 297us (1188us total) trans 8589942990 rc 0/0 00000100:00100000:2.0:1746065119.423245:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8949 00000100:00100000:0.0:1746065119.425751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.426799:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260894720 00000100:00100000:2.0:1746065119.426808:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260894720 00000100:00100000:2.0:1746065119.426869:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10377 00000100:00100000:2.0:1746065119.426876:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+5:28842:x1830881260894720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.426890:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.426905:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7c7 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.426927:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.426933:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.426934:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.426937:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 6 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.426962:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.426971:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 7 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.426981:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259665920:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.427057:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304b4840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.433163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.433315:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260894848 00000100:00100000:2.0:1746065119.433323:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260894848 00000100:00100000:2.0:1746065119.433374:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10378 00000100:00100000:2.0:1746065119.433382:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:28841:x1830881260894848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.433399:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.433415:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7ce expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.433436:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.433444:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.433455:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.433463:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd0e00, rc 0) 00000100:00100000:2.0:1746065119.433622:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:28841:x1830881260894848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 240us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.433628:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10378 00000100:00100000:2.0:1746065119.434039:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259665920:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.434057:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 6 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.434065:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd1c00, rc 0) 00000100:00100000:2.0:1746065119.434081:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+6:28842:x1830881260894720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7206us (8337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.434087:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10377 00000100:00100000:0.0:1746065119.434618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.434832:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260894976 00000100:00100000:1.0:1746065119.434837:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260894976 00010000:00010000:1.0:1746065119.434855:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 8 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.434880:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5160 00000100:00100000:1.0:1746065119.434885:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260894976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.434892:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.434909:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 8 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.434919:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 8 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.434935:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b48f8400/0x14b4f8542d4f231d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a781 expref: 8 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.434950:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.434951:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.434956:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 5 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.434963:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 5 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.434969:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.434971:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.434973:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.434979:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.435000:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.435008:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259666048:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065119.435067:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 5 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.435074:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff22a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259666176:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065119.435088:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065119.438269:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259666048:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065119.438279:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff22a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259666176:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065119.438296:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065119.439001:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260894976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4112us (4380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.439012:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5160 00000100:00100000:0.0:1746065119.453578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.453627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.453793:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260895232 00000100:00100000:2.0:1746065119.453795:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260895488 00000100:00100000:2.0:1746065119.453802:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260895488 00000100:00100000:1.0:1746065119.453802:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260895232 00002000:00100000:2.0:1746065119.453859:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009c3f8000 x1830881260895488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.453859:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009c3f9880 x1830881260895232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.453869:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8000 with x1830881260895488 ext(0->1048575) 00002000:00100000:1.0:1746065119.453869:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830881260895232 ext(0->1048575) 00002000:00010000:2.0:1746065119.453873:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f8000 00002000:00010000:1.0:1746065119.453873:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00000100:00100000:1.0:1746065119.453890:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4747 00000100:00100000:2.0:1746065119.453893:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4748 00000100:00100000:1.0:1746065119.453896:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260895232:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065119.453897:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+6:1961:x1830881260895488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065119.474947:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260895232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21041us (21368us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065119.474957:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4747 00002000:00100000:1.0:1746065119.474966:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009c3f9880 x1830881260895232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.474975:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830881260895232 ext(0->1048575) 00002000:00010000:1.0:1746065119.474980:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00000100:00100000:2.0:1746065119.476700:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+6:1961:x1830881260895488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22798us (23068us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.476708:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4748 00002000:00100000:2.0:1746065119.476714:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009c3f8000 x1830881260895488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.476721:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8000 with x1830881260895488 ext(0->1048575) 00002000:00010000:2.0:1746065119.476725:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f8000 00000100:00100000:0.0:1746065119.488889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.488932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.489487:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260895616 00000100:00100000:2.0:1746065119.489495:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260895616 00000100:00100000:2.0:1746065119.489536:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260895744 00000100:00100000:2.0:1746065119.489539:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260895744 00000100:00100000:2.0:1746065119.489556:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10379 00000100:00100000:2.0:1746065119.489563:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+12:28841:x1830881260895616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.489578:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.489593:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7d5 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.489618:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.489625:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.489626:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.489630:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 13 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.489654:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.489665:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 11 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.489676:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259666304:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.489753:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.489768:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10380 00000100:00100000:2.0:1746065119.489773:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+5:28842:x1830881260895744:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.489779:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.489784:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7dc expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.489795:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.489798:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 6 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.489806:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 6 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.489828:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd0a00, rc 0) 00000100:00100000:2.0:1746065119.491963:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+6:28842:x1830881260895744:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2179us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.491972:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10380 00000100:00100000:2.0:1746065119.493702:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259666304:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.493731:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 13 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.493749:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd0c00, rc 0) 00000100:00100000:2.0:1746065119.493810:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:28841:x1830881260895616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4244us (4926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.493842:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10379 00000100:00100000:0.0:1746065119.496237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.496350:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260895872 00000100:00100000:1.0:1746065119.496358:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260895872 00010000:00010000:1.0:1746065119.496398:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 12 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.496436:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5161 00000100:00100000:1.0:1746065119.496443:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260895872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.496455:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.496474:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 12 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.496485:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 12 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.496504:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c4000/0x14b4f8542d4f2324 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a788 expref: 12 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.497264:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.497267:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.497275:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 12 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.497283:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 12 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.497291:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.497292:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.497295:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 5 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.497307:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 5 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.497332:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 5 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.497342:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff22a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259666432:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065119.501001:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 12 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.501018:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259666560:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065119.501092:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065119.502030:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff22a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259666432:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065119.502926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.503097:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260896128 00000100:00100000:2.0:1746065119.503104:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260896128 00002000:00100000:2.0:1746065119.503138:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009ba3c380 x1830881260896128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.503147:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c380 with x1830881260896128 ext(1048576->2097151) 00002000:00010000:2.0:1746065119.503152:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3c380 00000100:00100000:2.0:1746065119.503224:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4749 00000100:00100000:2.0:1746065119.503232:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+6:1958:x1830881260896128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065119.504725:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259666560:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065119.504744:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065119.504776:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260895872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8333us (8547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.504784:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5161 00000100:00100000:3.0:1746065119.516177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.516389:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260896384 00000100:00100000:1.0:1746065119.516396:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260896384 00002000:00100000:1.0:1746065119.516433:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880095355c00 x1830881260896384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.516443:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355c00 with x1830881260896384 ext(1048576->2097151) 00002000:00010000:1.0:1746065119.516449:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355c00 00000100:00100000:1.0:1746065119.516475:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4750 00000100:00100000:1.0:1746065119.516482:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1960:x1830881260896384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065119.529205:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+6:1958:x1830881260896128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25965us (26274us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.529215:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4749 00002000:00100000:2.0:1746065119.529226:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009ba3c380 x1830881260896128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.529234:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c380 with x1830881260896128 ext(1048576->2097151) 00002000:00010000:2.0:1746065119.529238:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3c380 00000100:00100000:1.0:1746065119.530965:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1960:x1830881260896384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14478us (14792us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065119.530975:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4750 00002000:00100000:1.0:1746065119.530988:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880095355c00 x1830881260896384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.530996:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355c00 with x1830881260896384 ext(1048576->2097151) 00002000:00010000:1.0:1746065119.531000:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355c00 00000100:00100000:0.0:1746065119.533385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.535140:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.535242:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260896512 00000100:00100000:3.0:1746065119.535249:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260896512 00000100:00100000:3.0:1746065119.535290:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260896640 00000100:00100000:3.0:1746065119.535292:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260896640 00000100:00100000:3.0:1746065119.535315:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10381 00000100:00100000:0.0:1746065119.535321:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10382 00000100:00100000:3.0:1746065119.535322:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:28841:x1830881260896512:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065119.535329:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+6:28842:x1830881260896640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.535337:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.535337:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.535351:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7e3 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.535351:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7ea expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.535379:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.535390:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065119.535392:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065119.535395:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 14 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.535402:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065119.535407:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 7 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.535469:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 7 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.535479:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.535491:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 10 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.535499:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5ec00, rc 0) 00000100:00100000:3.0:1746065119.535502:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259666688:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.535532:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+7:28842:x1830881260896640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 204us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.535538:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10382 00000100:00100000:3.0:1746065119.535549:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.539728:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259666688:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.539757:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 14 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.539771:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d537600, rc 0) 00000100:00100000:3.0:1746065119.539811:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:28841:x1830881260896512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4487us (6429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.539833:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10381 00000100:00100000:0.0:1746065119.539987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.540078:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260896768 00000100:00100000:2.0:1746065119.540083:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260896768 00010000:00010000:2.0:1746065119.540106:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 11 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.540125:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5162 00000100:00100000:2.0:1746065119.540130:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260896768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065119.540139:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065119.540157:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 11 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.540166:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 11 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.540183:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f232b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a78f expref: 11 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.540200:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.540202:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.540208:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 13 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.540215:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 13 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.540221:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.540222:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.540226:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 6 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.540231:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 6 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.540252:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 6 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.540863:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094244a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259666816:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065119.541298:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 13 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.541307:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094245180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259666944:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065119.541502:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.549227:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094244a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259666816:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065119.549238:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094245180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259666944:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065119.549252:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.549303:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260896768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 9172us (9316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.549313:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5162 00000100:00100000:0.0:1746065119.549574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.549778:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260897024 00000100:00100000:2.0:1746065119.549784:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260897024 00002000:00100000:2.0:1746065119.549844:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009ba3f100 x1830881260897024/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.549853:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f100 with x1830881260897024 ext(1048576->2097151) 00002000:00010000:2.0:1746065119.549857:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3f100 00000100:00100000:2.0:1746065119.549873:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4751 00000100:00100000:2.0:1746065119.549879:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+7:1959:x1830881260897024:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065119.558922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.562969:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260897280 00000100:00100000:2.0:1746065119.562981:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260897280 00002000:00100000:2.0:1746065119.563022:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009ba3ce00 x1830881260897280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.563032:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3ce00 with x1830881260897280 ext(1048576->2097151) 00002000:00010000:2.0:1746065119.563037:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3ce00 00000100:00100000:0.0:1746065119.564178:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4752 00000100:00100000:0.0:1746065119.564189:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881260897280:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065119.574948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.575250:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260897536 00000100:00100000:3.0:1746065119.575259:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260897536 00000100:00100000:3.0:1746065119.575308:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8950 00000100:00100000:3.0:1746065119.575315:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28837:x1830881260897536:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065119.575335:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.575338:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746065119.575360:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0200/0x14b4f8542d4f23a2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c0 expref: 251 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.575399:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1400/0x14b4f8542d4f237f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b2 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.575407:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+7:1959:x1830881260897024:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25526us (25833us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746065119.575409:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.575413:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.575415:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4751 00010000:00010000:3.0:1746065119.575422:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536e00/0x14b4f8542d4f23da lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7f1 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065119.575422:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009ba3f100 x1830881260897024/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.575437:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f100 with x1830881260897024 ext(1048576->2097151) 00002000:00010000:2.0:1746065119.575441:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3f100 00010000:00010000:3.0:1746065119.575463:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065119.575474:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ab expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.575482:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b9 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.575487:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065119.575509:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b9 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.575519:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b9 expref: 8 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.575534:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259667072:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.575615:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ab expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.575624:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ab expref: 7 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.575631:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259667200:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.575654:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.575837:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881260897280:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11649us (16921us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065119.575843:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4752 00002000:00100000:0.0:1746065119.575848:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009ba3ce00 x1830881260897280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.575855:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3ce00 with x1830881260897280 ext(1048576->2097151) 00002000:00010000:0.0:1746065119.575858:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3ce00 00000100:00100000:0.0:1746065119.580333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.580377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.580406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.580523:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260897664 00000100:00100000:2.0:1746065119.580530:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260897664 00000100:00100000:2.0:1746065119.580566:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10383 00000100:00100000:2.0:1746065119.580573:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+6:28842:x1830881260897664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.580589:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.580605:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7f8 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.580628:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.580635:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.580636:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.580639:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 7 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.580669:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.580683:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 6 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.580694:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094245180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259667328:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.580745:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259667072:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.580754:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259667200:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.580772:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065119.580790:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260897792 00000100:00100000:3.0:1746065119.580792:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260897792 00010000:00010000:3.0:1746065119.580805:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b9 expref: 9 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.580846:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260897920 00000100:00100000:3.0:1746065119.580848:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260897920 00010000:00010000:3.0:1746065119.580856:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ab expref: 8 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.580867:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5163 00000100:00100000:3.0:1746065119.580871:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881260897792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.580879:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.580883:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b9 expref: 9 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.580890:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b9 expref: 9 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.580903:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4f238d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7b9 expref: 9 pid: 24350 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.580943:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5164 00000100:00100000:0.0:1746065119.580948:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260897920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.580953:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.580957:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ab expref: 8 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.580963:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ab expref: 8 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.580971:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9200/0x14b4f8542d4f234e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ab expref: 8 pid: 24350 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.580981:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.580985:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.580992:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.580997:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.581008:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065119.581953:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.581957:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.582000:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260897920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1050us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.582007:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5164 00000100:00100000:2.0:1746065119.582009:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304b4840 going to sleep for 11 seconds 00010000:00010000:0.0:1746065119.582025:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.582031:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:02000000:0.0:1746065119.582068:0:16767:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:3.0:1746065119.582233:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881260897792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1359us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.582238:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5163 00000100:00100000:2.0:1746065119.589306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000040:00080000:2.0:1746065119.590009:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2475, 88 off207616 00000004:00080000:2.0:1746065119.590015:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718881199472ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065119.590040:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2421, 88 off202680 00000004:00080000:2.0:1746065119.590043:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718881227884ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065119.590053:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2422, 88 off202768 00000004:00080000:2.0:1746065119.590056:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718881240454ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065119.590061:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2476, 88 off207704 00000004:00080000:2.0:1746065119.590064:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718881248595ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065119.590069:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2477, 88 off207792 00000004:00080000:2.0:1746065119.590071:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718881255899ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065119.590076:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2423, 88 off202856 00000004:00080000:2.0:1746065119.590079:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718881263467ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065119.590084:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2424, 88 off202944 00000004:00080000:2.0:1746065119.590087:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718881271475ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065119.590092:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2425, 88 off203032 00000004:00080000:2.0:1746065119.590094:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718881278399ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065119.590099:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2478, 88 off207880 00000004:00080000:2.0:1746065119.590102:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718881286372ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065119.590107:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2426, 88 off203120 00000004:00080000:2.0:1746065119.590110:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718881295027ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065119.590116:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2479, 88 off207968 00000004:00080000:2.0:1746065119.590119:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718881303507ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065119.590125:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2427, 88 off203208 00000004:00080000:2.0:1746065119.590127:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718881311836ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065119.590133:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2480, 88 off208056 00000004:00080000:2.0:1746065119.590135:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718881319652ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065119.590142:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2481, 88 off208144 00000004:00080000:2.0:1746065119.590144:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718881328831ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065119.590150:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2482, 88 off208232 00000004:00080000:2.0:1746065119.590152:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718881336835ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065119.590158:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2483, 88 off208320 00000004:00080000:2.0:1746065119.590160:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718881345015ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065119.590166:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2428, 88 off203296 00000004:00080000:2.0:1746065119.590167:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718881352256ns, next at 666938887344ns, rc = 0 00000100:00100000:3.0:1746065119.590592:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094245180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259667328:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.590616:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 7 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.590630:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00e7800, rc 0) 00000100:00100000:3.0:1746065119.590670:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+7:28842:x1830881260897664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10097us (10344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.590677:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10383 00000100:00100000:3.0:1746065119.590698:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260898048 00000100:00100000:3.0:1746065119.590703:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260898048 00000100:00100000:3.0:1746065119.590730:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10384 00000100:00100000:3.0:1746065119.590736:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:28841:x1830881260898048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.590747:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.590758:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a7ff expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.590775:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065119.590779:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.590786:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.590792:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d536a00, rc 0) 00000100:00100000:3.0:1746065119.590807:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:28841:x1830881260898048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 71us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.590811:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10384 00000100:00100000:1.0:1746065119.591352:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.593168:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260898176 00000100:00100000:3.0:1746065119.593179:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260898176 00010000:00010000:3.0:1746065119.593214:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 7 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.593237:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5165 00000100:00100000:3.0:1746065119.593243:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260898176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.593252:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.593269:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 7 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.593279:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 7 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.593298:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0800/0x14b4f8542d4f2332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a796 expref: 7 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.593308:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.593310:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.593315:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 6 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.593322:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 6 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.593329:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.593330:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.593333:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.593339:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.593372:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.593383:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259667456:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065119.593445:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 6 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.593455:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259667584:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065119.593467:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.598063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.598090:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260898304 00000100:00100000:2.0:1746065119.598093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.598098:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260898304 00000100:00100000:2.0:1746065119.598107:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260898432 00000100:00100000:2.0:1746065119.598111:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260898432 00000100:00100000:0.0:1746065119.598131:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8951 00000100:00100000:3.0:1746065119.598249:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259667456:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065119.598249:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8952 00000100:00100000:0.0:1746065119.598249:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:28841:x1830881260898304:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065119.598255:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:28842:x1830881260898432:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065119.598258:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259667584:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065119.598266:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.598266:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.598273:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065119.598280:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a80d expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.598280:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a806 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.598316:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260898176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5072us (6964us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065119.598320:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065119.598323:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5165 00010000:00010000:2.0:1746065119.598328:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.598631:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.598641:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.598655:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.598658:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065119.598660:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.598665:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd0800, rc 0) 00000100:00100000:0.0:1746065119.598683:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:28841:x1830881260898304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 546us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.598688:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8951 00010000:00010000:2.0:1746065119.598857:0:14643:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.598867:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.598880:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.598882:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065119.598884:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.598890:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00e7600, rc 0) 00000100:00100000:2.0:1746065119.598910:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:28842:x1830881260898432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 656us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.598915:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8952 00010000:00010000:3.0:1746065119.625866:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 253 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.625878:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.625880:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065119.625885:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.625893:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.625899:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.625904:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.625913:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.625918:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.625953:0:16767:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.625965:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259667712:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065119.626063:0:16767:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.626070:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259667840:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065119.626092:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f600 going to sleep for 11 seconds 00000001:00080000:3.0:1746065119.626108:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942989 is committed 00000001:00080000:3.0:1746065119.626116:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942991 is committed 00000004:00080000:3.0:1746065119.626119:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1722 committed 00000004:00080000:3.0:1746065119.626124:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1777 committed 00000004:00080000:3.0:1746065119.626128:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1776 committed 00000004:00080000:3.0:1746065119.626130:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1775 committed 00000004:00080000:3.0:1746065119.626131:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1774 committed 00000004:00080000:3.0:1746065119.626132:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1721 committed 00000004:00080000:3.0:1746065119.626134:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1773 committed 00000004:00080000:3.0:1746065119.626135:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1720 committed 00000004:00080000:3.0:1746065119.626136:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1772 committed 00000004:00080000:3.0:1746065119.626138:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1719 committed 00000004:00080000:3.0:1746065119.626140:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1718 committed 00000004:00080000:3.0:1746065119.626142:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1717 committed 00000004:00080000:3.0:1746065119.626143:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1771 committed 00000004:00080000:3.0:1746065119.626144:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1770 committed 00000004:00080000:3.0:1746065119.626151:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1716 committed 00000004:00080000:3.0:1746065119.626152:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1715 committed 00000004:00080000:3.0:1746065119.626154:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1769 committed 00000001:00080000:3.0:1746065119.626164:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942987 is committed 00000100:00100000:3.0:1746065119.626238:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259667968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.626269:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626283:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259668480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.626294:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626308:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065119.626313:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259668992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.626326:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626335:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259668096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.626344:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626374:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259668608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.626388:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626401:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259669504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.626414:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626425:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065119.626428:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259669120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.626440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626450:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259669632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.626460:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626479:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259668224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.626493:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626503:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259668736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.626515:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626524:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259669248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.626533:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626539:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259669760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.626548:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626556:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746065119.626559:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259668352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.626570:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626577:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259668864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.626587:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626593:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259669376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.626603:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065119.626609:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259669888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065119.626612:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259667968 00000100:00100000:3.0:1746065119.626619:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065119.626619:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259667968 00000100:00100000:2.0:1746065119.626628:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259668480 00000100:00100000:2.0:1746065119.626632:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259668480 00000100:00100000:3.0:1746065119.626635:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259668992 00000100:00100000:3.0:1746065119.626638:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259668992 00000100:00100000:1.0:1746065119.626642:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259668096 00000100:00100000:2.0:1746065119.626645:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259668608 00000100:00100000:1.0:1746065119.626645:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259668096 00000100:00100000:2.0:1746065119.626646:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259668608 00000100:00100000:1.0:1746065119.626651:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259669504 00000100:00100000:2.0:1746065119.626654:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259669120 00000100:00100000:1.0:1746065119.626654:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259669504 00000100:00100000:2.0:1746065119.626656:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259669120 00000100:00100000:3.0:1746065119.626658:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259669632 00000100:00100000:3.0:1746065119.626660:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259669632 00000100:00100000:1.0:1746065119.626660:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259668224 00000100:00100000:1.0:1746065119.626661:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259668224 00000100:00100000:2.0:1746065119.626663:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259668736 00000100:00100000:2.0:1746065119.626665:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259668736 00000100:00100000:3.0:1746065119.626667:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259669248 00000100:00100000:1.0:1746065119.626668:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259669760 00000100:00100000:3.0:1746065119.626669:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259669248 00000100:00100000:1.0:1746065119.626670:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259669760 00000100:00100000:2.0:1746065119.626672:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259668352 00000100:00100000:2.0:1746065119.626673:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259668352 00000100:00100000:3.0:1746065119.626674:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259668864 00000100:00100000:3.0:1746065119.626676:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259668864 00000100:00100000:1.0:1746065119.626677:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259669376 00000100:00100000:1.0:1746065119.626678:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259669376 00000100:00100000:2.0:1746065119.626679:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259669888 00000100:00100000:2.0:1746065119.626681:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259669888 00000100:00100000:3.0:1746065119.626685:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10385 00000100:00100000:3.0:1746065119.626691:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259667968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.626694:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10386 00000100:00100000:2.0:1746065119.626699:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10387 00000100:00100000:1.0:1746065119.626699:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259668480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065119.626704:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259668096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065119.626738:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10388 00000100:00100000:2.0:1746065119.626742:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259668608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065119.626769:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10389 00000100:00100000:2.0:1746065119.626773:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881259668992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.626777:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10390 00000100:00100000:3.0:1746065119.626782:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881259669504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065119.626901:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:1.0:1746065119.626901:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065119.626903:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:1.0:1746065119.626903:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.626905:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.626905:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.626907:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:1.0:1746065119.626907:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.626908:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00002000:00010000:1.0:1746065119.626908:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065119.626935:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881259669504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (519us total) trans 21474839970 rc 0/0 00000100:00100000:1.0:1746065119.626937:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830881259668480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (641us total) trans 17179872738 rc 0/0 00000100:00100000:3.0:1746065119.626941:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10390 00000100:00100000:1.0:1746065119.626944:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10386 00000100:00100000:3.0:1746065119.626955:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10391 00000100:00100000:3.0:1746065119.626959:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881259669120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065119.627022:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065119.627024:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.627026:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.627028:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:3.0:1746065119.627030:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065119.627047:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881259669120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (606us total) trans 21474839971 rc 0/0 00000100:00100000:1.0:1746065119.627116:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10392 00000100:00100000:3.0:1746065119.627120:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10391 00000100:00100000:1.0:1746065119.627123:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881259669632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.627131:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10393 00000100:00100000:3.0:1746065119.627136:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259668224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065119.627189:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065119.627191:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.627193:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.627195:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.627196:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1746065119.627202:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 4974112 -> 4974112 00002000:00010000:3.0:1746065119.627204:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.627207:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.627208:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:3.0:1746065119.627210:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5295 -> 5699 00000100:00100000:1.0:1746065119.627214:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881259669632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (752us total) trans 21474839972 rc 0/0 00000100:00100000:1.0:1746065119.627219:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10392 00000100:00100000:3.0:1746065119.627230:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259668224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (737us total) trans 17179872739 rc 0/0 00000100:00100000:1.0:1746065119.627230:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10394 00000100:00100000:3.0:1746065119.627235:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10393 00000100:00100000:1.0:1746065119.627235:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259668736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.627245:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10395 00000100:00100000:3.0:1746065119.627249:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3297:x1830881259669248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065119.627305:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259668736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (788us total) trans 17179872740 rc 0/0 00000100:00100000:1.0:1746065119.627308:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10394 00002000:00010000:3.0:1746065119.627309:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065119.627311:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.627313:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:3.0:1746065119.627314:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00000100:00100000:1.0:1746065119.627315:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10396 00002000:00010000:3.0:1746065119.627316:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746065119.627318:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259669760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.627336:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259669248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (800us total) trans 21474839973 rc 0/0 00000100:00100000:3.0:1746065119.627340:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10395 00000100:00100000:3.0:1746065119.627349:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10397 00000100:00100000:3.0:1746065119.627353:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259668352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065119.627359:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065119.627376:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.627378:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.627380:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065119.627381:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065119.627399:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259669760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (850us total) trans 21474839974 rc 0/0 00000100:00100000:1.0:1746065119.627403:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10396 00000100:00100000:1.0:1746065119.627412:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10398 00000100:00100000:1.0:1746065119.627416:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259668864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065119.627426:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065119.627429:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.627430:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.627432:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065119.627434:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065119.627450:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259668352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (878us total) trans 17179872741 rc 0/0 00000100:00100000:3.0:1746065119.627455:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10397 00002000:00010000:2.0:1746065119.627457:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065119.627460:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:2.0:1746065119.627461:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00000100:00100000:3.0:1746065119.627463:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10399 00002000:00010000:2.0:1746065119.627463:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:2.0:1746065119.627463:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065119.627466:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259669376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065119.627482:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881259668992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 709us (1155us total) trans 21474839975 rc 0/0 00000100:00100000:2.0:1746065119.627486:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10389 00000100:00100000:1.0:1746065119.627487:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259668864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (899us total) trans 17179872742 rc 0/0 00000100:00100000:1.0:1746065119.627492:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10398 00000100:00100000:2.0:1746065119.627494:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10400 00000100:00100000:2.0:1746065119.627497:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3297:x1830881259669888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065119.627538:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3297:x1830881259669376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (933us total) trans 21474839976 rc 0/0 00000100:00100000:3.0:1746065119.627542:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10399 00000100:00100000:2.0:1746065119.627548:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3297:x1830881259669888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (928us total) trans 21474839977 rc 0/0 00000100:00100000:2.0:1746065119.627552:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10400 00000100:00100000:3.0:1746065119.627582:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872725 gen 2 00000004:00080000:3.0:1746065119.627586:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130446a00, transno 17179872680 00000004:00080000:3.0:1746065119.627592:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130447480, transno 17179872681 00000004:00080000:3.0:1746065119.627594:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130447100, transno 17179872682 00000004:00080000:3.0:1746065119.627596:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130446d80, transno 17179872683 00000004:00080000:3.0:1746065119.627597:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49df80, transno 17179872684 00000004:00080000:3.0:1746065119.627600:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130445c00, transno 17179872685 00000004:00080000:3.0:1746065119.627602:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130445880, transno 17179872686 00000004:00080000:3.0:1746065119.627604:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130444380, transno 17179872687 00000004:00080000:3.0:1746065119.627606:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4b0e00, transno 17179872688 00002000:00010000:2.0:1746065119.627619:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065119.627622:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00002000:00010000:2.0:1746065119.627624:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00002000:00010000:2.0:1746065119.627625:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:2.0:1746065119.627627:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065119.627644:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881259668096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 939us (1298us total) trans 17179872743 rc 0/0 00000100:00100000:2.0:1746065119.627648:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10387 00002000:00010000:0.0:1746065119.627650:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065119.627653:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.627654:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.627656:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065119.627657:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065119.627676:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3295:x1830881259668608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 933us (1287us total) trans 17179872744 rc 0/0 00000100:00100000:0.0:1746065119.627681:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10388 00000004:00080000:3.0:1746065119.627764:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d1500, transno 17179872689 00000004:00080000:3.0:1746065119.627769:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f9500, transno 17179872690 00002000:00010000:1.0:1746065119.627770:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00000004:00080000:3.0:1746065119.627771:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d2a00, transno 17179872691 00002000:00010000:1.0:1746065119.627772:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065119 -> 1746065119 00000004:00080000:3.0:1746065119.627773:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d2300, transno 17179872692 00002000:00010000:1.0:1746065119.627774:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065119 -> 1746065119 00000004:00080000:3.0:1746065119.627775:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d1880, transno 17179872693 00002000:00010000:1.0:1746065119.627775:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065120 -> 1746065120 00002000:00010000:1.0:1746065119.627776:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000004:00080000:3.0:1746065119.627777:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d3800, transno 17179872694 00000004:00080000:3.0:1746065119.627779:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d1f80, transno 17179872695 00000004:00080000:3.0:1746065119.627781:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d2680, transno 17179872696 00000004:00080000:3.0:1746065119.627783:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095354380, transno 17179872697 00000004:00080000:3.0:1746065119.627785:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094245880, transno 17179872717 00000004:00080000:3.0:1746065119.627787:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094246d80, transno 17179872718 00000004:00080000:3.0:1746065119.627789:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094247b80, transno 17179872719 00000004:00080000:3.0:1746065119.627791:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094246680, transno 17179872720 00000100:00100000:1.0:1746065119.627793:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830881259667968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1102us (1524us total) trans 17179872745 rc 0/0 00000004:00080000:3.0:1746065119.627794:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094247100, transno 17179872721 00000004:00080000:3.0:1746065119.627796:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094244000, transno 17179872722 00000100:00100000:1.0:1746065119.627797:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10385 00000004:00080000:3.0:1746065119.627798:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094246a00, transno 17179872723 00000004:00080000:3.0:1746065119.627800:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094247480, transno 17179872724 00000004:00080000:3.0:1746065119.627802:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094247800, transno 17179872725 00000100:00100000:3.0:1746065119.627808:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880130268a80 x1830881259663744/t17179872729(17179872729) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065135 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:3.0:1746065119.627832:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130445f80/2, rc 0, transno 17179872741 00000100:00100000:3.0:1746065119.627835:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259668352:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.627844:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d0e00/2, rc 0, transno 17179872742 00000100:00100000:3.0:1746065119.627846:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259668864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.627851:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095353b80/2, rc 0, transno 21474839976 00000100:00100000:3.0:1746065119.627853:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259669376:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.627856:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095353480/2, rc 0, transno 21474839977 00000100:00100000:3.0:1746065119.627858:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259669888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.627861:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130446300/2, rc 0, transno 17179872739 00000100:00100000:3.0:1746065119.627862:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259668224:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.627865:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d0380/2, rc 0, transno 17179872740 00000100:00100000:3.0:1746065119.627867:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259668736:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.627870:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131b08380/2, rc 0, transno 21474839973 00000100:00100000:3.0:1746065119.627871:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259669248:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.627874:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095350000/2, rc 0, transno 21474839974 00000100:00100000:3.0:1746065119.627875:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259669760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.628044:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 17 in progress, 4 in flight, 27 done 00000100:00100000:3.0:1746065119.628084:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259670016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065119.628104:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065119.628133:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131b0b480/2, rc 0, transno 21474839971 00000100:00100000:3.0:1746065119.628135:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259669120:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.628141:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095353800/2, rc 0, transno 21474839972 00000100:00100000:3.0:1746065119.628143:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259669632:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.628149:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095351180/2, rc 0, transno 21474839970 00000100:00100000:3.0:1746065119.628151:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259669504:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.628156:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094245180/2, rc 0, transno 21474839975 00000100:00100000:3.0:1746065119.628158:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259668992:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065119.628164:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095357100/2, rc 0, transno 17179872743 00000100:00100000:3.0:1746065119.628166:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259668096:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.628172:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d1180/2, rc 0, transno 17179872744 00000100:00100000:3.0:1746065119.628174:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259668608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065119.628179:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095356300/2, rc 0, transno 17179872745 00000100:00100000:1.0:1746065119.628179:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259670016 00000100:00100000:3.0:1746065119.628181:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259667968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.628183:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259670016 00000004:00080000:3.0:1746065119.628187:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130447800/2, rc 0, transno 17179872738 00000100:00100000:3.0:1746065119.628189:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259668480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.628199:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10401 00000100:00100000:1.0:1746065119.628203:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830881259670016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065119.628342:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881259670016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 138us (236us total) trans 17179872746 rc 0/0 00000100:00100000:1.0:1746065119.628347:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10401 00000004:00080000:3.0:1746065119.628424:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06d80/2, rc 0, transno 17179872746 00000100:00100000:3.0:1746065119.628428:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259670016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065119.630459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.630477:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259667712:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065119.630485:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259667840:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065119.630517:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536e00/0x14b4f8542d4f23da lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 250 pid: 16767 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065119.630531:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.630553:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d537000, rc 0) 00000100:00100000:3.0:1746065119.630595:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28837:x1830881260897536:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 55280us (55654us total) trans 8589942991 rc 0/0 00000100:00100000:3.0:1746065119.630601:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8950 00000100:00100000:2.0:1746065119.631562:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.631603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.631665:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260898560 00000100:00100000:3.0:1746065119.631670:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260898560 00000100:00100000:3.0:1746065119.631693:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260898688 00000100:00100000:3.0:1746065119.631695:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260898688 00000100:00100000:3.0:1746065119.631704:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3635 00000100:00100000:3.0:1746065119.631709:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28841:x1830881260898560:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:2.0:1746065119.631800:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3636 00000100:00100000:2.0:1746065119.631806:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b878450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:28842:x1830881260898688:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065119.631898:0:14647:0:(service.c:3346:ptlrpc_start_thread()) mdt_readpage[0] started 3 min 2 max 80 00000100:00100000:3.0:1746065119.631904:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28841:x1830881260898560:12345-192.168.202.46@tcp:49:cat.0 Request processed in 193us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.631905:0:14647:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_003' 00000100:00100000:3.0:1746065119.631909:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3635 00000100:00100000:2.0:1746065119.631934:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b878450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:28842:x1830881260898688:12345-192.168.202.46@tcp:49:cat.0 Request processed in 128us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.631939:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3636 00000100:00100000:1.0:1746065119.631950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.631962:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260898944 00000100:00100000:2.0:1746065119.631965:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260898944 00000100:00100000:2.0:1746065119.631975:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3637 00000100:00100000:2.0:1746065119.631979:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28837:x1830881260898944:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:2.0:1746065119.632013:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28837:x1830881260898944:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 33us (64us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.632018:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3637 00000100:00100000:3.0:1746065119.632054:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260898816 00000100:00100000:3.0:1746065119.632057:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260898816 00000100:00100000:3.0:1746065119.632074:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8953 00000100:00100000:3.0:1746065119.632079:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:28840:x1830881260898816:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065119.632090:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.632100:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a28200/0x14b4f8542d4f2404 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a814 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.632132:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094a28200/0x14b4f8542d4f2404 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a814 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.632142:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094a28200/0x14b4f8542d4f2404 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a814 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.632152:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.632155:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065119.632158:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a28200, rc 0) 00000100:00100000:3.0:1746065119.632172:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:28840:x1830881260898816:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 93us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.632177:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8953 00000100:00100000:3.0:1746065119.634018:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.634084:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260899072 00000100:00100000:0.0:1746065119.634088:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260899072 00000100:00100000:0.0:1746065119.634129:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 617 00000100:00100000:0.0:1746065119.634135:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881260899072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.634145:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.634162:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a28200/0x14b4f8542d4f2404 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a814 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.634177:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.634181:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.634215:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881260899072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.634220:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 617 00000100:00100000:0.0:1746065119.637676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.637865:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260899200 00000100:00100000:1.0:1746065119.637873:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260899200 00000100:00100000:1.0:1746065119.637913:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10402 00000100:00100000:1.0:1746065119.637919:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+7:28840:x1830881260899200:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065119.637934:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065119.637959:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a81b expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.637980:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.637987:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.637992:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.637993:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.637996:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [778240->1048575] (req 778240->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 8 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.638023:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.638033:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 21 pid: 9716 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.638037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.638043:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259670144:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.638093:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260899328 00000100:00100000:0.0:1746065119.638096:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260899328 00010000:00010000:1.0:1746065119.638115:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.638123:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 8 pid: 4545 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.638130:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259670272:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065119.638146:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.638171:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10403 00000100:00100000:0.0:1746065119.638177:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:28837:x1830881260899328:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065119.638184:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.638193:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a822 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.638207:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 15 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.638413:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 6 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.638418:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.638419:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.638422:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1097728->1855487] (req 1097728->1855487) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.638438:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 6 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.638446:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 6 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.638453:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259670400:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065119.638479:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 15 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.638486:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 15 pid: 4545 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.638492:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259670528:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065119.638506:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92beb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.638882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.639262:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260899584 00000100:00100000:0.0:1746065119.639265:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260899584 00002000:00100000:0.0:1746065119.639287:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88008fd07480 x1830881260899584/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.639294:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07480 with x1830881260899584 ext(1048576->2097151) 00002000:00010000:0.0:1746065119.639298:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd07480 00000100:00100000:0.0:1746065119.639321:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4753 00000100:00100000:0.0:1746065119.639327:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:1959:x1830881260899584:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065119.641169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.641202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.641217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.641245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.641484:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260899840 00000100:00100000:0.0:1746065119.641489:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260899840 00000100:00100000:2.0:1746065119.641490:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259670144:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.641499:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259670272:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065119.641510:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 22 pid: 9716 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.641518:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [778240->1048575] (req 778240->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 10 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.641529:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8fc00, rc 0) 00000100:00100000:0.0:1746065119.641530:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260900096 00000100:00100000:0.0:1746065119.641532:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260900096 00010000:00010000:0.0:1746065119.641543:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 16 pid: 4545 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.641555:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260899712 00000100:00100000:0.0:1746065119.641557:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260899712 00000100:00100000:2.0:1746065119.641562:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:28840:x1830881260899200:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3643us (3891us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065119.641564:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 11 pid: 4545 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.641568:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10402 00000100:00100000:0.0:1746065119.641572:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260899968 00000100:00100000:0.0:1746065119.641574:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260899968 00010000:00010000:0.0:1746065119.641581:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 7 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.641585:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5166 00000100:00100000:2.0:1746065119.641592:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5167 00000100:00100000:3.0:1746065119.641593:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260899840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065119.641598:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260900096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065119.641600:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5168 00010000:00010000:3.0:1746065119.641602:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065119.641605:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065119.641605:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260899712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.641611:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065119.641618:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 16 pid: 4545 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.641619:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 22 pid: 9716 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.641620:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 10 pid: 4545 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.641628:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 22 pid: 9716 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.641631:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 16 pid: 4545 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.641635:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 10 pid: 4545 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.641647:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.641661:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260900096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 63us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.641666:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5167 00000100:00100000:2.0:1746065119.641682:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5169 00000100:00100000:2.0:1746065119.641686:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+7:1960:x1830881260899968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065119.641693:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065119.641699:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 7 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.641707:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 7 pid: 4544 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.641717:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.641719:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065119.641724:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.641732:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.641753:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.641762:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259670656:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065119.641795:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00010000:00010000:3.0:1746065119.641975:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd0e00/0x14b4f8542d4f23b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ce expref: 22 pid: 9716 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.641990:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.642006:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881260899840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 415us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.642012:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5166 00010000:00010000:0.0:1746065119.642070:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd1c00/0x14b4f8542d4f23b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7c7 expref: 10 pid: 4545 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746065119.642079:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.642081:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.642085:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 9 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.642091:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 9 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.642109:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 9 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.642117:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259670784:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065119.642160:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be000 going to sleep for 11 seconds 00010000:00010000:0.0:1746065119.642182:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0a00/0x14b4f8542d4f23c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7dc expref: 7 pid: 4544 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.642190:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259670400:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065119.642198:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0c00/0x14b4f8542d4f23be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7d5 expref: 15 pid: 4545 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746065119.642205:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259670528:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065119.642219:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.642227:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b18200, rc 0) 00000100:00100000:0.0:1746065119.642243:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:28837:x1830881260899328:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4067us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.642248:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10403 00000100:00100000:2.0:1746065119.643840:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259670656:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065119.643850:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065119.643868:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+6:1960:x1830881260899968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2181us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.643874:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5169 00000100:00100000:0.0:1746065119.645670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.645733:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260900352 00000100:00100000:2.0:1746065119.645740:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260900352 00002000:00100000:2.0:1746065119.645771:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009ba1f800 x1830881260900352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.645779:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f800 with x1830881260900352 ext(1048576->2097151) 00002000:00010000:2.0:1746065119.645784:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1f800 00000100:00100000:2.0:1746065119.645808:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4754 00000100:00100000:2.0:1746065119.645954:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260900352:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065119.647850:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.647877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.647894:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260900608 00000100:00100000:3.0:1746065119.647899:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260900608 00002000:00100000:3.0:1746065119.647923:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (778240->782335) req@ffff88008fd05180 x1830881260900608/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.647932:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05180 with x1830881260900608 ext(778240->782335) 00002000:00010000:3.0:1746065119.647936:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05180 00000100:00100000:3.0:1746065119.647946:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260900864 00000100:00100000:3.0:1746065119.647947:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260900864 00002000:00100000:3.0:1746065119.647956:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1097728->1101823) req@ffff88009ba3f800 x1830881260900864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.647961:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f800 with x1830881260900864 ext(1097728->1101823) 00002000:00010000:3.0:1746065119.647964:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3f800 00000100:00100000:2.0:1746065119.647969:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4755 00000100:00100000:2.0:1746065119.647977:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260900608:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065119.648069:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259670784:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065119.648082:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260900608:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 105us (236us total) trans 0 rc 4096/4096 00010000:00010000:1.0:1746065119.648084:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065119.648248:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260899712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6508us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.648257:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5168 00000100:00100000:3.0:1746065119.648388:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4756 00000100:00100000:3.0:1746065119.648394:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881260900864:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065119.648445:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4755 00002000:00100000:2.0:1746065119.648451:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37d:0x0] (778240->782335) req@ffff88008fd05180 x1830881260900608/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.648464:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05180 with x1830881260900608 ext(778240->782335) 00000100:00100000:3.0:1746065119.648467:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881260900864:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 73us (589us total) trans 0 rc 4096/4096 00002000:00010000:2.0:1746065119.648470:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05180 00000100:00100000:3.0:1746065119.648473:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4756 00002000:00100000:3.0:1746065119.648477:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1097728->1101823) req@ffff88009ba3f800 x1830881260900864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.648485:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f800 with x1830881260900864 ext(1097728->1101823) 00002000:00010000:3.0:1746065119.648487:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3f800 00000100:00100000:1.0:1746065119.654503:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+7:1959:x1830881260899584:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 15167us (15612us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065119.654514:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4753 00002000:00100000:1.0:1746065119.654525:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88008fd07480 x1830881260899584/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.654533:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07480 with x1830881260899584 ext(1048576->2097151) 00002000:00010000:1.0:1746065119.654539:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd07480 00000100:00100000:2.0:1746065119.659848:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260900352:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13853us (14138us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.659859:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4754 00002000:00100000:2.0:1746065119.659869:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009ba1f800 x1830881260900352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.659877:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f800 with x1830881260900352 ext(1048576->2097151) 00002000:00010000:2.0:1746065119.659882:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1f800 00000100:00100000:0.0:1746065119.662678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.663072:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260900992 00000100:00100000:2.0:1746065119.663080:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260900992 00000100:00100000:2.0:1746065119.663127:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10404 00000100:00100000:2.0:1746065119.663135:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+6:28840:x1830881260900992:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065119.663151:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.663167:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a829 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.663193:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.663200:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.663202:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.663205:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->1622015] (req 1048576->1622015) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 7 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.663235:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.663245:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 13 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.663256:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259670912:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.663328:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.664106:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.664133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.664146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.664168:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.664219:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260901120 00000100:00100000:3.0:1746065119.664223:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260901120 00000100:00100000:3.0:1746065119.664241:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260901376 00000100:00100000:3.0:1746065119.664242:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260901376 00000100:00100000:3.0:1746065119.664251:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260901248 00000100:00100000:3.0:1746065119.664252:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260901248 00000100:00100000:3.0:1746065119.664264:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10405 00000100:00100000:3.0:1746065119.664269:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:1958:x1830881260901120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.664278:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.664287:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5529c00/0x14b4f8542d4f2420 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a830 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.664313:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259671040:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.664369:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.664384:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10406 00000100:00100000:3.0:1746065119.664390:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881260901376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.664396:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.664402:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f2427 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a83e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.664423:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259671168:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.664445:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.664457:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10407 00000100:00100000:3.0:1746065119.664464:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+7:1958:x1830881260901248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.664470:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.664479:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf1800/0x14b4f8542d4f242e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a837 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.664500:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259671296:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.664531:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.664587:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260901632 00000100:00100000:2.0:1746065119.664596:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260901632 00002000:00100000:2.0:1746065119.664618:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x379:0x0] (1851392->1855487) req@ffff88009ba1d500 x1830881260901632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.664626:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d500 with x1830881260901632 ext(1851392->1855487) 00010000:00010000:2.0:1746065119.664632:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 14 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.664642:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 14 pid: 21998 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746065119.664648:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba1d500 00000100:00100000:2.0:1746065119.664660:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1475 00000100:00100000:2.0:1746065119.664666:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881260901632:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065119.664784:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881260901632:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 117us (614us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065119.664792:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1475 00002000:00100000:2.0:1746065119.664797:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x379:0x0] (1851392->1855487) req@ffff88009ba1d500 x1830881260901632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.664803:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d500 with x1830881260901632 ext(1851392->1855487) 00010000:00010000:2.0:1746065119.664807:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 14 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746065119.664834:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 14 pid: 21998 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746065119.664840:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba1d500 00000100:00100000:2.0:1746065119.665581:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259670912:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.665596:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->1622015] (req 1048576->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 11 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.665605:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093036000, rc 0) 00000100:00100000:2.0:1746065119.665631:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+11:28840:x1830881260900992:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2497us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.665636:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10404 00002000:00010000:2.0:1746065119.666237:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065119 -> 1746065120 00002000:00010000:2.0:1746065119.666241:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime: 1746065119 -> 1746065120 00000100:00100000:2.0:1746065119.666252:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259671040:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065119.666269:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5529c00/0x14b4f8542d4f2420 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a830 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.666285:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5529c00/0x14b4f8542d4f2420 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a830 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.666305:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5529c00, rc 0) 00000100:00100000:2.0:1746065119.666331:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:1958:x1830881260901120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2062us (2227us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.666336:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10405 00010000:00010000:3.0:1746065119.666402:0:25185:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.666417:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259671168:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065119.666430:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f2427 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a83e expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.666438:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f2427 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a83e expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.666996:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596d400, rc 0) 00000100:00100000:3.0:1746065119.667020:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+7:1958:x1830881260901376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2630us (2886us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065119.667026:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10406 00010000:00010000:3.0:1746065119.667052:0:4545:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 5 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.667066:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259671296:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065119.667083:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf1800/0x14b4f8542d4f242e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a837 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.667091:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf1800/0x14b4f8542d4f242e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a837 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.667098:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4bf1800, rc 0) 00000100:00100000:3.0:1746065119.667110:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+7:1958:x1830881260901248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2648us (2964us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065119.667115:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10407 00000100:00100000:0.0:1746065119.667507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.667587:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260902016 00000100:00100000:3.0:1746065119.667592:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260902016 00000100:00100000:0.0:1746065119.667639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.667687:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3638 00000100:00100000:3.0:1746065119.667693:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28837:x1830881260902016:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065119.667783:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260902144 00000100:00100000:1.0:1746065119.667787:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260902144 00002000:00100000:1.0:1746065119.667811:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1097728->1855487) req@ffff88009ba1d180 x1830881260902144/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.667837:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d180 with x1830881260902144 ext(1097728->1855487) 00010000:00010000:1.0:1746065119.667844:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 14 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.667856:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 14 pid: 21998 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746065119.667862:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba1d180 00000100:00100000:3.0:1746065119.667882:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28837:x1830881260902016:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 188us (374us total) trans 8589942992 rc 0/0 00000100:00100000:3.0:1746065119.667887:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3638 00000100:00100000:1.0:1746065119.667889:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1476 00000100:00100000:1.0:1746065119.667894:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881260902144:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065119.669068:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.669103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.669128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.669141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.669162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.669219:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260902272 00000100:00100000:3.0:1746065119.669224:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260902272 00000100:00100000:3.0:1746065119.669248:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260902400 00000100:00100000:3.0:1746065119.669250:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260902400 00000100:00100000:3.0:1746065119.669259:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260902528 00000100:00100000:3.0:1746065119.669261:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260902528 00000100:00100000:3.0:1746065119.669271:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260902656 00000100:00100000:3.0:1746065119.669272:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260902656 00000100:00100000:3.0:1746065119.669280:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260902784 00000100:00100000:3.0:1746065119.669282:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260902784 00000100:00100000:3.0:1746065119.669294:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10408 00000100:00100000:3.0:1746065119.669299:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260902272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.669311:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.669323:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e26400/0x14b4f8542d4f2435 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a845 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.669376:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259671424:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.669424:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.669440:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10409 00000100:00100000:3.0:1746065119.669447:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881260902400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.669453:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.669462:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f243c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a84c expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.669484:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259671552:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.669502:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.669516:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10410 00000100:00100000:3.0:1746065119.669521:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260902528:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.669526:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.669532:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c757e00/0x14b4f8542d4f2443 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a853 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.669554:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259671680:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.669573:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.669586:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10411 00000100:00100000:3.0:1746065119.669592:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260902656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.669598:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.669603:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4f244a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a85a expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.669614:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10412 00000100:00100000:3.0:1746065119.669622:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259671808:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065119.669623:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+7:28842:x1830881260902784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.669630:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.669638:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a861 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.669640:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b402dc00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065119.669655:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 5 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.669668:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.669670:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065119.669673:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.669691:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 5 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.669700:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 5 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746065119.669708:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259671936:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.669729:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.674432:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259671936:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.674459:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.674475:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009feb0200, rc 0) 00000100:00100000:2.0:1746065119.674510:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+8:28842:x1830881260902784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4889us (5347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.674518:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10412 00000100:00100000:3.0:1746065119.674877:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259671552:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065119.674899:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f243c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a84c expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.674909:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f243c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a84c expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.674918:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e26800, rc 0) 00000100:00100000:3.0:1746065119.674953:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260902400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5506us (5848us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065119.674959:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10409 00002000:00010000:3.0:1746065119.674988:0:4545:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime: 1746065119 -> 1746065120 00002000:00010000:3.0:1746065119.674991:0:4545:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime: 1746065119 -> 1746065120 00000100:00100000:3.0:1746065119.675002:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259671424:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065119.675017:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e26400/0x14b4f8542d4f2435 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a845 expref: 24 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.675024:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e26400/0x14b4f8542d4f2435 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a845 expref: 24 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.675035:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e26400, rc 0) 00000100:00100000:3.0:1746065119.675052:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260902272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5752us (5987us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065119.675057:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10408 00000100:00100000:0.0:1746065119.675117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065119.675156:0:8427:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 5 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.675169:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259671680:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065119.675181:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c757e00/0x14b4f8542d4f2443 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a853 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.675189:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c757e00/0x14b4f8542d4f2443 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a853 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.675195:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c757e00, rc 0) 00000100:00100000:3.0:1746065119.675222:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881260902528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5701us (6092us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065119.675227:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10410 00010000:00010000:3.0:1746065119.675251:0:4544:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.675265:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259671808:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065119.675267:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260902912 00000100:00100000:1.0:1746065119.675273:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260902912 00010000:00010000:3.0:1746065119.675278:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4f244a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a85a expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065119.675290:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4f244a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a85a expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.675295:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 6 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746065119.675296:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b4800, rc 0) 00000100:00100000:3.0:1746065119.675313:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260902656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5721us (6170us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065119.675317:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5170 00000100:00100000:3.0:1746065119.675319:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10411 00000100:00100000:1.0:1746065119.675324:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260902912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.675334:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.675343:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 6 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.675351:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 6 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.675381:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f716a00/0x14b4f8542d4f2339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a79d expref: 6 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.675392:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.675394:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.675400:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.675408:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.675432:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.675442:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259672064:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065119.675923:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.680003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.680077:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259672064:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065119.680095:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.680128:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260903040 00000100:00100000:1.0:1746065119.680129:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881260902912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4805us (5012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.680133:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260903040 00000100:00100000:1.0:1746065119.680138:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5170 00000100:00100000:3.0:1746065119.680163:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10413 00000100:00100000:3.0:1746065119.680169:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:28841:x1830881260903040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.680183:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.680196:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a868 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.680214:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.680216:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065119.680222:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a868 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.680233:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a868 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.680241:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b4000, rc 0) 00000100:00100000:3.0:1746065119.680259:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:28841:x1830881260903040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.680264:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10413 00000100:00100000:0.0:1746065119.681002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.681053:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260903296 00000100:00100000:2.0:1746065119.681059:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260903296 00002000:00100000:2.0:1746065119.681083:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ba1ed80 x1830881260903296/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.681091:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ed80 with x1830881260903296 ext(2097152->3145727) 00002000:00010000:2.0:1746065119.681095:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1ed80 00000100:00100000:2.0:1746065119.681115:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4757 00000100:00100000:2.0:1746065119.681120:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881260903296:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065119.684978:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881260902144:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 17076us (17331us total) trans 21474839978 rc 0/0 00000100:00100000:1.0:1746065119.684988:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1476 00002000:00100000:1.0:1746065119.684996:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1097728->1855487) req@ffff88009ba1d180 x1830881260902144/t21474839978(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/448 e 0 to 0 dl 1746065130 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.685005:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d180 with x1830881260902144 ext(1097728->1855487) 00010000:00010000:1.0:1746065119.685014:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 16 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.685030:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 16 pid: 21998 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746065119.685036:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba1d180 00000100:00100000:2.0:1746065119.687516:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.687986:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260903552 00000100:00100000:1.0:1746065119.687994:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260903552 00002000:00100000:1.0:1746065119.688030:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880095353100 x1830881260903552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.688038:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353100 with x1830881260903552 ext(2097152->3145727) 00002000:00010000:1.0:1746065119.688043:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353100 00000100:00100000:1.0:1746065119.688060:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4758 00000100:00100000:1.0:1746065119.688066:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260903552:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065119.693066:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.693129:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260903680 00000100:00100000:1.0:1746065119.693137:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260903680 00010000:00010000:1.0:1746065119.693170:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 16 pid: 21998 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.693206:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5171 00000100:00100000:1.0:1746065119.693213:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881260903680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.693225:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.693242:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 16 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.693254:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 16 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.693273:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b18200/0x14b4f8542d4f2412 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a822 expref: 16 pid: 21998 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.693289:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.693291:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.693296:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 6 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.693304:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 6 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.693331:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 6 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.693341:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259672192:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065119.693416:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.693745:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881260903296:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12622us (12742us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.693752:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4757 00002000:00100000:2.0:1746065119.693856:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ba1ed80 x1830881260903296/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.693865:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ed80 with x1830881260903296 ext(2097152->3145727) 00002000:00010000:2.0:1746065119.693869:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1ed80 00000100:00100000:0.0:1746065119.700077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.700138:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260903936 00000100:00100000:3.0:1746065119.700146:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260903936 00000100:00100000:3.0:1746065119.700202:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10414 00000100:00100000:3.0:1746065119.700210:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+7:28842:x1830881260903936:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065119.700213:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259672192:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065119.700228:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065119.700233:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065119.700246:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a86f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.700270:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881260903680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7057us (7212us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065119.700271:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.700277:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065119.700279:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746065119.700279:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5171 00010000:00010000:3.0:1746065119.700282:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 8 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.700307:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.700317:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 9 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746065119.700328:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259672320:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065119.700383:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b402dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065119.700680:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260903552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12613us (13171us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065119.700687:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4758 00002000:00100000:1.0:1746065119.700694:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880095353100 x1830881260903552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.700702:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353100 with x1830881260903552 ext(2097152->3145727) 00002000:00010000:1.0:1746065119.700705:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353100 00000100:00100000:3.0:1746065119.707673:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259672320:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065119.707702:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 8 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.707717:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b5000, rc 0) 00000100:00100000:3.0:1746065119.707771:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:28842:x1830881260903936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7561us (7702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.707779:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10414 00000100:00100000:0.0:1746065119.708047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.708076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.708116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.708172:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260904192 00000100:00100000:3.0:1746065119.708177:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260904192 00000100:00100000:3.0:1746065119.708210:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10415 00000100:00100000:3.0:1746065119.708217:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:28841:x1830881260904192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.708230:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.708247:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a876 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.708268:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065119.708272:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 16 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.708283:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 16 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.708291:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b5800, rc 0) 00000100:00100000:3.0:1746065119.708310:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:28841:x1830881260904192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.708315:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10415 00000100:00100000:1.0:1746065119.708541:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260904064 00000100:00100000:1.0:1746065119.708545:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260904064 00010000:00010000:1.0:1746065119.708562:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 10 pid: 8429 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746065119.708957:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5172 00000100:00100000:1.0:1746065119.708963:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260904064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065119.708970:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065119.708987:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 10 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.708997:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 10 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.709013:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093036e00/0x14b4f8542d4f2340 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7a4 expref: 10 pid: 8429 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746065119.709030:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.709031:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.709037:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 7 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.709044:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 7 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.709055:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.709056:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065119.709059:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 15 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.709065:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 15 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065119.709085:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 15 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.709094:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259672448:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065119.709154:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 7 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.709161:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259672576:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065119.709174:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065119.709187:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260904448 00000100:00100000:1.0:1746065119.709190:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260904448 00002000:00100000:1.0:1746065119.709207:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1617920->1622015) req@ffff880093ba0380 x1830881260904448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.709408:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0380 with x1830881260904448 ext(1617920->1622015) 00002000:00010000:1.0:1746065119.709412:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba0380 00000100:00100000:1.0:1746065119.709435:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4759 00000100:00100000:1.0:1746065119.709441:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260904448:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065119.710534:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260904448:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1091us (2415us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065119.710541:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4759 00002000:00100000:1.0:1746065119.710546:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1617920->1622015) req@ffff880093ba0380 x1830881260904448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/4536 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.710552:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0380 with x1830881260904448 ext(1617920->1622015) 00002000:00010000:1.0:1746065119.710555:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba0380 00000100:00100000:1.0:1746065119.712531:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259672448:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065119.713611:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259672576:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065119.713630:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065119.713676:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260904064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4711us (5632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065119.713685:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5172 00000100:00100000:0.0:1746065119.718504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.718532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.718561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.718581:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260904960 00000100:00100000:0.0:1746065119.718588:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260904960 00002000:00100000:0.0:1746065119.718617:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880093ba3800 x1830881260904960/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.718626:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3800 with x1830881260904960 ext(3145728->4194303) 00002000:00010000:0.0:1746065119.718630:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba3800 00000100:00100000:0.0:1746065119.718653:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260905216 00000100:00100000:0.0:1746065119.718655:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260905216 00002000:00100000:0.0:1746065119.718664:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880093ba2a00 x1830881260905216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.718670:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2a00 with x1830881260905216 ext(3145728->4194303) 00002000:00010000:0.0:1746065119.718673:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba2a00 00000100:00100000:0.0:1746065119.718679:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260905472 00000100:00100000:0.0:1746065119.718680:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260905472 00002000:00100000:0.0:1746065119.718686:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880093ba1f80 x1830881260905472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065119.718692:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1f80 with x1830881260905472 ext(2097152->3145727) 00002000:00010000:0.0:1746065119.718694:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba1f80 00000100:00100000:0.0:1746065119.718701:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4760 00000100:00100000:0.0:1746065119.718707:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260904960:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065119.718776:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4761 00000100:00100000:3.0:1746065119.718784:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260905216:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065119.719270:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4762 00000100:00100000:2.0:1746065119.719278:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260905472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065119.723037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.723064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.723076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.723098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.723120:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260904704 00000100:00100000:3.0:1746065119.723125:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260904704 00002000:00100000:3.0:1746065119.723154:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009ba3d500 x1830881260904704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.723163:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d500 with x1830881260904704 ext(2097152->3145727) 00002000:00010000:3.0:1746065119.723167:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3d500 00000100:00100000:3.0:1746065119.723179:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260905728 00000100:00100000:3.0:1746065119.723181:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260905728 00002000:00100000:3.0:1746065119.723190:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009ba3ea00 x1830881260905728/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.723196:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3ea00 with x1830881260905728 ext(3145728->4194303) 00002000:00010000:3.0:1746065119.723198:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3ea00 00000100:00100000:3.0:1746065119.723205:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260905984 00000100:00100000:3.0:1746065119.723207:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260905984 00002000:00100000:3.0:1746065119.723216:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009ba3d880 x1830881260905984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.723222:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d880 with x1830881260905984 ext(3145728->4194303) 00002000:00010000:3.0:1746065119.723225:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3d880 00000100:00100000:3.0:1746065119.723234:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4763 00000100:00100000:3.0:1746065119.723240:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881260904704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065119.723903:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4764 00000100:00100000:1.0:1746065119.723912:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260905728:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065119.724473:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4765 00000100:00100000:1.0:1746065119.724481:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260905984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065119.725575:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260906240 00000100:00100000:3.0:1746065119.725581:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260906240 00000100:00100000:3.0:1746065119.725607:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3639 00000100:00100000:3.0:1746065119.725612:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+8:28840:x1830881260906240:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065119.726042:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:28840:x1830881260906240:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 429us (2942us total) trans 8589942993 rc 0/0 00000100:00100000:3.0:1746065119.726048:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3639 00000100:00100000:3.0:1746065119.735315:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260905216:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16524us (16773us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065119.735326:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4761 00002000:00100000:3.0:1746065119.735335:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880093ba2a00 x1830881260905216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.735344:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2a00 with x1830881260905216 ext(3145728->4194303) 00002000:00010000:3.0:1746065119.735349:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba2a00 00000100:00100000:2.0:1746065119.738771:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260905472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19484us (20198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.738780:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4762 00002000:00100000:2.0:1746065119.738790:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880093ba1f80 x1830881260905472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.738799:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1f80 with x1830881260905472 ext(2097152->3145727) 00002000:00010000:2.0:1746065119.738804:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba1f80 00000100:00100000:3.0:1746065119.741225:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881260904704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17976us (18186us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065119.741236:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4763 00002000:00100000:3.0:1746065119.741245:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009ba3d500 x1830881260904704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.741253:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d500 with x1830881260904704 ext(2097152->3145727) 00002000:00010000:3.0:1746065119.741257:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3d500 00000100:00100000:1.0:1746065119.743995:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260905984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19509us (20910us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065119.744005:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4765 00002000:00100000:1.0:1746065119.744014:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009ba3d880 x1830881260905984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.744027:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d880 with x1830881260905984 ext(3145728->4194303) 00002000:00010000:1.0:1746065119.744032:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3d880 00000100:00100000:2.0:1746065119.756423:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260905728:12345-192.168.202.46@tcp:3:cat.0 Request processed in 32503us (33348us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065119.756433:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4764 00002000:00100000:2.0:1746065119.756442:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009ba3ea00 x1830881260905728/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.756450:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3ea00 with x1830881260905728 ext(3145728->4194303) 00002000:00010000:2.0:1746065119.756455:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3ea00 00000100:00100000:1.0:1746065119.757449:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260904960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 38739us (38949us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065119.757456:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4760 00002000:00100000:1.0:1746065119.757461:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880093ba3800 x1830881260904960/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.757467:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3800 with x1830881260904960 ext(3145728->4194303) 00002000:00010000:1.0:1746065119.757471:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba3800 00000100:00100000:0.0:1746065119.766218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.767285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.767324:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260906624 00000100:00100000:1.0:1746065119.767331:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260906624 00002000:00100000:1.0:1746065119.767373:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880093ba1880 x1830881260906624/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.767382:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1880 with x1830881260906624 ext(4194304->4976639) 00002000:00010000:1.0:1746065119.767387:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba1880 00000100:00100000:1.0:1746065119.767410:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4766 00000100:00100000:1.0:1746065119.767416:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260906624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065119.770188:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260906368 00000100:00100000:3.0:1746065119.770195:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260906368 00000100:00100000:3.0:1746065119.770235:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10416 00000100:00100000:3.0:1746065119.770241:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881260906368:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.770254:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.770267:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941e9600/0x14b4f8542d4f246d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a87d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.770315:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259672704:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.770381:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b402dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.770454:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.770485:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260906752 00000100:00100000:2.0:1746065119.770489:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260906752 00000100:00100000:2.0:1746065119.771330:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10417 00000100:00100000:2.0:1746065119.771338:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881260906752:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.771349:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.771369:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f2474 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a884 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.771396:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259672832:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065119.772142:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.773596:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259672832:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065119.773617:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f2474 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a884 expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.773627:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f2474 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a884 expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.773929:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e26000, rc 0) 00000100:00100000:2.0:1746065119.773972:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881260906752:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2635us (3517us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.773978:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10417 00000100:00100000:2.0:1746065119.774447:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259672704:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065119.774469:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941e9600/0x14b4f8542d4f246d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a87d expref: 23 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.774478:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9600/0x14b4f8542d4f246d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a87d expref: 23 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.774485:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e9600, rc 0) 00000100:00100000:2.0:1746065119.774506:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881260906368:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4264us (7222us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.774511:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10416 00000100:00100000:1.0:1746065119.775449:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260906624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8030us (9236us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746065119.775457:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4766 00002000:00100000:1.0:1746065119.775465:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880093ba1880 x1830881260906624/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.775473:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1880 with x1830881260906624 ext(4194304->4976639) 00002000:00010000:1.0:1746065119.775478:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba1880 00000100:00100000:2.0:1746065119.777312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.777401:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260907008 00000100:00100000:1.0:1746065119.777408:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260907008 00002000:00100000:1.0:1746065119.777439:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880095352a00 x1830881260907008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.777446:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352a00 with x1830881260907008 ext(4194304->4976639) 00002000:00010000:1.0:1746065119.777449:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352a00 00000100:00100000:1.0:1746065119.777475:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4767 00000100:00100000:1.0:1746065119.777482:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881260907008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065119.784635:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881260907008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7145us (7320us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746065119.784645:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4767 00002000:00100000:1.0:1746065119.784655:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880095352a00 x1830881260907008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.784663:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352a00 with x1830881260907008 ext(4194304->4976639) 00002000:00010000:1.0:1746065119.784668:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352a00 00000100:00100000:0.0:1746065119.787154:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.787209:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260907136 00000100:00100000:2.0:1746065119.787216:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260907136 00000100:00100000:0.0:1746065119.787222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.787246:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260907264 00000100:00100000:2.0:1746065119.787248:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260907264 00000100:00100000:2.0:1746065119.787262:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10418 00000100:00100000:2.0:1746065119.787269:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881260907136:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065119.787271:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10419 00000100:00100000:0.0:1746065119.787276:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881260907264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065119.787285:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.787285:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.787300:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e26800/0x14b4f8542d4f247b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a88b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.787300:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4bb4400/0x14b4f8542d4f2482 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a892 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.787338:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259672960:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065119.787338:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259673088:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065119.787421:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.787498:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92beb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.788893:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259672960:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065119.788914:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e26800/0x14b4f8542d4f247b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a88b expref: 23 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.788924:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e26800/0x14b4f8542d4f247b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a88b expref: 23 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.788946:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e26800, rc 0) 00000100:00100000:2.0:1746065119.788974:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881260907136:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1706us (1826us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.788981:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10418 00000100:00100000:1.0:1746065119.789156:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259673088:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065119.789172:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4bb4400/0x14b4f8542d4f2482 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a892 expref: 17 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.789181:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4bb4400/0x14b4f8542d4f2482 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a892 expref: 17 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.789201:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4bb4400, rc 0) 00000100:00100000:1.0:1746065119.789222:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881260907264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1946us (1998us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065119.789226:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10419 00000100:00100000:0.0:1746065119.791195:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.791447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.791526:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260907520 00000100:00100000:1.0:1746065119.791526:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260907392 00000100:00100000:2.0:1746065119.791531:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260907520 00000100:00100000:1.0:1746065119.791531:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260907392 00000100:00100000:1.0:1746065119.791679:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10420 00000100:00100000:1.0:1746065119.791686:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260907392:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065119.791701:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065119.791714:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094977400/0x14b4f8542d4f2489 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a899 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065119.791759:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259673216:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065119.791920:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10421 00000100:00100000:3.0:1746065119.791927:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260907520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.791933:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.791942:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f2490 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8a0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065119.791970:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259673344:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065119.792132:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.792142:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b402dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065119.793321:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259673216:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065119.793341:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094977400/0x14b4f8542d4f2489 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a899 expref: 23 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.793351:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094977400/0x14b4f8542d4f2489 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a899 expref: 23 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.793371:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094977400, rc 0) 00000100:00100000:2.0:1746065119.793375:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259673344:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065119.793387:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f2490 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a0 expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065119.793394:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260907392:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1709us (2206us total) trans 0 rc 301/301 00010000:00010000:2.0:1746065119.793395:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f2490 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a0 expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065119.793400:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10420 00010000:00010000:2.0:1746065119.793401:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e9a00, rc 0) 00000100:00100000:2.0:1746065119.793414:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260907520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1490us (1968us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.793419:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10421 00000100:00100000:0.0:1746065119.797145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.797269:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260907776 00000100:00100000:3.0:1746065119.797277:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260907776 00000100:00100000:3.0:1746065119.797945:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3640 00000100:00100000:3.0:1746065119.797954:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28841:x1830881260907776:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065119.799225:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28841:x1830881260907776:12345-192.168.202.46@tcp:35:cat.0 Request processed in 1269us (2084us total) trans 8589942994 rc 0/0 00000100:00100000:3.0:1746065119.799232:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3640 00010000:00010000:3.0:1746065119.818010:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065119.890803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.890921:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260908032 00000100:00100000:2.0:1746065119.890929:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260908032 00000100:00100000:2.0:1746065119.890976:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8954 00000100:00100000:2.0:1746065119.890985:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28849:x1830881260908032:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065119.891002:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.891017:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26a00/0x14b4f8542d4f2497 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8a7 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.891144:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.891154:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.891163:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.891175:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.891179:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.891183:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.891616:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.891624:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.891630:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065119.891638:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065119.893318:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893329:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893335:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893340:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e26000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065119.893347:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893352:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893374:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065119.893377:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065119.893380:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893384:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4f249e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893416:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893421:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893425:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893428:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e26800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065119.893430:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893435:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893441:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205b00) 00010000:00010000:2.0:1746065119.893442:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065119.893444:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893448:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f24a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.893493:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e26a00/0x14b4f8542d4f2497 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a7 expref: 254 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.893510:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a7 expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.893516:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.893518:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065119.893520:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5528c00, rc 0) 00000100:00100000:3.0:1746065119.893716:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:28849:x1830881260908032:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2729us (2917us total) trans 8589942995 rc 0/0 00000100:00100000:3.0:1746065119.893724:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8954 00000100:00100000:1.0:1746065119.897348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.897807:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260908288 00000100:00100000:3.0:1746065119.897827:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260908288 00000100:00100000:3.0:1746065119.897867:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8955 00000100:00100000:3.0:1746065119.897873:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:28852:x1830881260908288:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065119.897892:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065119.897905:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f24ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8ae expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.897984:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.897995:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898004:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898013:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898019:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898023:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898102:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898109:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898113:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065119.898120:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065119.898178:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898183:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898188:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898193:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e9a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065119.898195:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898200:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898208:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065119.898211:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065119.898214:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.898218:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4f24c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.899201:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.899208:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.899212:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.899220:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e9e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065119.899222:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.899227:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.899234:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669500) 00010000:00010000:3.0:1746065119.899236:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065119.899238:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.899243:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f24c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065119.899277:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f24ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ae expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.899287:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ae expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065119.899293:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.899294:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065119.899296:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e9400, rc 0) 00000100:00100000:3.0:1746065119.899347:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:28852:x1830881260908288:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1473us (2005us total) trans 8589942996 rc 0/0 00000100:00100000:3.0:1746065119.899353:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8955 00000100:00100000:0.0:1746065119.900747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.900837:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260908544 00000100:00100000:3.0:1746065119.900843:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260908544 00000100:00100000:3.0:1746065119.900871:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3641 00000100:00100000:3.0:1746065119.900877:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:28852:x1830881260908544:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065119.901012:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:28852:x1830881260908544:12345-192.168.202.46@tcp:35:cat.0 Request processed in 135us (268us total) trans 8589942997 rc 0/0 00000100:00100000:3.0:1746065119.901018:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3641 00000100:00100000:0.0:1746065119.906025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.906057:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.906749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.908951:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260908928 00000100:00100000:2.0:1746065119.908961:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260908928 00002000:00100000:2.0:1746065119.908999:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->778239) req@ffff88009c7ac000 x1830881260908928/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.909009:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac000 with x1830881260908928 ext(0->778239) 00002000:00010000:2.0:1746065119.909015:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ac000 00000100:00100000:2.0:1746065119.909035:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260909056 00000100:00100000:2.0:1746065119.909037:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260909056 00002000:00100000:2.0:1746065119.909048:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1622016->2097151) req@ffff88009c7ace00 x1830881260909056/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.909055:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ace00 with x1830881260909056 ext(1622016->2097151) 00002000:00010000:2.0:1746065119.909058:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ace00 00000100:00100000:2.0:1746065119.909064:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260909184 00000100:00100000:2.0:1746065119.909065:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260909184 00002000:00100000:2.0:1746065119.909072:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009c7afb80 x1830881260909184/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/0 e 0 to 0 dl 1746065130 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.909077:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7afb80 with x1830881260909184 ext(1048576->2097151) 00002000:00010000:2.0:1746065119.909080:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7afb80 00000100:00100000:2.0:1746065119.909089:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4768 00000100:00100000:2.0:1746065119.909095:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1958:x1830881260908928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065119.910134:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4769 00000100:00100000:1.0:1746065119.910144:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+9:1959:x1830881260909056:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065119.911296:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4770 00000100:00100000:3.0:1746065119.911304:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+10:1959:x1830881260909184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065119.915407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.915442:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260909440 00000100:00100000:2.0:1746065119.915448:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260909440 00000100:00100000:2.0:1746065119.915480:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8956 00000100:00100000:2.0:1746065119.915487:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:28853:x1830881260909440:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.915504:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.915518:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f24dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8b5 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.915562:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915572:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915580:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915590:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915595:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915600:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915674:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915680:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915685:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065119.915708:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:2.0:1746065119.915711:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065119.915721:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915728:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915734:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915739:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915743:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915748:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a596cc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065119.915752:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915758:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915766:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065119.915768:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065119.915771:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915776:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f24e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915797:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915802:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915807:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915810:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a596c600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065119.915812:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915833:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915838:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205e00) 00010000:00010000:2.0:1746065119.915840:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065119.915842:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915846:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f24eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065119.915867:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f24dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8b5 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.915876:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8b5 expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.915881:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.915884:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065119.915886:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596d200, rc 0) 00000100:00100000:2.0:1746065119.915906:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28853:x1830881260909440:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 420us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.915911:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8956 00000100:00100000:1.0:1746065119.924621:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+10:1959:x1830881260909056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14466us (18549us total) trans 0 rc 475136/475136 00000100:00100000:1.0:1746065119.924633:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4769 00002000:00100000:1.0:1746065119.924644:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1622016->2097151) req@ffff88009c7ace00 x1830881260909056/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 475136/475136 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065119.924654:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ace00 with x1830881260909056 ext(1622016->2097151) 00002000:00010000:1.0:1746065119.924662:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ace00 00000100:00100000:0.0:1746065119.932529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.932543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.932563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.932573:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.932592:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260909696 00000100:00100000:0.0:1746065119.932598:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260909696 00000100:00100000:0.0:1746065119.932624:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260909952 00000100:00100000:0.0:1746065119.932625:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260909952 00000100:00100000:0.0:1746065119.932633:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260910208 00000100:00100000:0.0:1746065119.932635:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260910208 00000100:00100000:0.0:1746065119.932642:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260909568 00000100:00100000:0.0:1746065119.932644:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260909568 00000100:00100000:0.0:1746065119.932653:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10422 00000100:00100000:0.0:1746065119.932659:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260909696:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.932673:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.932686:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e38e400/0x14b4f8542d4f24f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8c3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.932723:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259673472:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065119.932780:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.932794:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10423 00000100:00100000:0.0:1746065119.932799:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1959:x1830881260909952:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.932804:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.932812:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8d1 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.932845:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.932846:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.932853:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d1 expref: 7 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.932866:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d1 expref: 7 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.932874:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f89400, rc 0) 00000100:00100000:0.0:1746065119.932890:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881260909952:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.932898:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10423 00000100:00100000:0.0:1746065119.932912:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10424 00000100:00100000:0.0:1746065119.932915:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260910208:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.932920:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.932925:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8df expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.932932:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.932934:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.932937:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8df expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.932945:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8df expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.932951:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f89c00, rc 0) 00000100:00100000:0.0:1746065119.932960:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881260910208:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 45us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.932964:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10424 00000100:00100000:0.0:1746065119.932971:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10425 00000100:00100000:0.0:1746065119.932974:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1959:x1830881260909568:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.932978:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.932983:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4f250e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8bc expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.933000:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259673600:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065119.933028:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.933046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.933059:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260909824 00000100:00100000:0.0:1746065119.933061:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260909824 00000100:00100000:0.0:1746065119.933073:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10426 00000100:00100000:0.0:1746065119.933077:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881260909824:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.933082:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.933087:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8ca expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.933096:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.933097:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.933101:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ca expref: 13 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.933108:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ca expref: 13 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.933115:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8e600, rc 0) 00000100:00100000:0.0:1746065119.933125:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1959:x1830881260909824:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 48us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.933130:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10426 00000100:00100000:0.0:1746065119.933173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.933182:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260910080 00000100:00100000:0.0:1746065119.933184:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260910080 00000100:00100000:0.0:1746065119.933196:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10427 00000100:00100000:0.0:1746065119.933199:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881260910080:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.933207:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.933212:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8d8 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.933220:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.933221:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065119.933226:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d8 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.933233:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d8 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.933239:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5000, rc 0) 00000100:00100000:0.0:1746065119.933251:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881260910080:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.933255:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10427 00000100:00100000:3.0:1746065119.933953:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+8:1959:x1830881260909184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22649us (27203us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065119.933961:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4770 00002000:00100000:3.0:1746065119.933969:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009c7afb80 x1830881260909184/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065119.933977:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7afb80 with x1830881260909184 ext(1048576->2097151) 00002000:00010000:3.0:1746065119.933981:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7afb80 00000100:00100000:2.0:1746065119.936246:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1958:x1830881260908928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27145us (30222us total) trans 0 rc 778240/778240 00000100:00100000:2.0:1746065119.936255:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4768 00002000:00100000:2.0:1746065119.936263:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->778239) req@ffff88009c7ac000 x1830881260908928/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:35/0 lens 488/440 e 0 to 0 dl 1746065130 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065119.936271:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac000 with x1830881260908928 ext(0->778239) 00002000:00010000:2.0:1746065119.936275:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ac000 00000100:00100000:1.0:1746065119.938026:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259673472:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065119.938026:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259673600:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065119.938050:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e38e400/0x14b4f8542d4f24f9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8c3 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.938063:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e38e400/0x14b4f8542d4f24f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8c3 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.938085:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e38e400, rc 0) 00000100:00100000:1.0:1746065119.938112:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260909696:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5453us (5591us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065119.938118:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10422 00010000:00010000:0.0:1746065119.940494:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4f250e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8bc expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.940511:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4f250e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8bc expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065119.940551:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f89800, rc 0) 00000100:00100000:0.0:1746065119.940627:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881260909568:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 7648us (8048us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065119.940635:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10425 00000100:00100000:0.0:1746065119.950330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.950393:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260910464 00000100:00100000:2.0:1746065119.950400:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260910464 00000100:00100000:2.0:1746065119.950667:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8957 00000100:00100000:2.0:1746065119.950675:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28853:x1830881260910464:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.950690:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.950706:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f2523 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8e6 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.950779:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.950791:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a7 expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.950798:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ae expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.950803:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8b5 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.950808:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 6/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.950853:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8b5 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.950863:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8b5 expref: 8 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065119.950873:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259673728:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.951573:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ae expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.951581:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ae expref: 11 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065119.951589:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259673856:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.951614:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a7 expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.951620:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a7 expref: 252 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065119.951627:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259673984:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.951637:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.956896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.956915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.956977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.957005:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260910592 00000100:00100000:0.0:1746065119.957010:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260910592 00010000:00010000:0.0:1746065119.957042:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8b5 expref: 9 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065119.957061:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260910848 00000100:00100000:0.0:1746065119.957063:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260910848 00010000:00010000:0.0:1746065119.957070:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a7 expref: 253 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065119.957079:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260910720 00000100:00100000:0.0:1746065119.957080:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260910720 00010000:00010000:0.0:1746065119.957086:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ae expref: 12 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065119.957096:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5173 00000100:00100000:0.0:1746065119.957101:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260910592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.957111:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.957115:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8b5 expref: 9 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.957124:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8b5 expref: 9 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.957140:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.957145:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.957152:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.957156:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.957183:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260910592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.957188:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5173 00000100:00100000:0.0:1746065119.957222:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5174 00000100:00100000:0.0:1746065119.957227:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:1960:x1830881260910848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.957232:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.957235:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a7 expref: 253 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.957242:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a7 expref: 253 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.957251:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.957253:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.957259:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.957262:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.957272:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:1960:x1830881260910848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.957276:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5174 00000100:00100000:0.0:1746065119.957284:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5175 00000100:00100000:0.0:1746065119.957288:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260910720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065119.957293:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065119.957296:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ae expref: 12 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.957303:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ae expref: 12 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065119.957311:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.957314:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.957320:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.957325:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.957337:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065119.957346:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260910720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 57us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065119.957350:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5175 00010000:00010000:2.0:1746065119.957571:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f24f2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8b5 expref: 8 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065119.957588:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259673728:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.957596:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f24cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ae expref: 11 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065119.957604:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259673856:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.957610:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5528c00/0x14b4f8542d4f24ac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8a7 expref: 252 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065119.957617:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259673984:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.957636:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.957643:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.957648:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065119.957662:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065119.957768:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f2523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8e6 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.957778:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8e6 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.957788:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.957791:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065119.957793:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596d400, rc 0) 00000100:00100000:2.0:1746065119.960450:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28853:x1830881260910464:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 9766us (10116us total) trans 8589942998 rc 0/0 00000100:00100000:2.0:1746065119.960459:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8957 00000100:00100000:0.0:1746065119.968514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.968582:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260910976 00000100:00100000:2.0:1746065119.968590:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260910976 00000100:00100000:2.0:1746065119.968634:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8958 00000100:00100000:2.0:1746065119.968640:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28853:x1830881260910976:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.968659:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.968672:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093036c00/0x14b4f8542d4f2538 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8ed expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.968730:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.968741:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8e6 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.968747:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.968770:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8e6 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.968785:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8e6 expref: 9 pid: 16767 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065119.968799:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259674112:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065119.968985:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065119.969034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065119.969067:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260911232 00000100:00100000:0.0:1746065119.969071:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260911232 00000100:00100000:0.0:1746065119.969100:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8959 00000100:00100000:0.0:1746065119.969105:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:28855:x1830881260911232:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065119.969114:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.969121:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2546 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8f4 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.969180:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969186:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969194:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969203:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969207:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969211:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969279:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969285:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969289:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065119.969296:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:0.0:1746065119.969352:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969367:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969372:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969377:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a4000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065119.969380:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969385:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969393:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065119.969394:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065119.969397:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969401:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4000/0x14b4f8542d4f254d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969422:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969426:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969430:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969434:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a5800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065119.969436:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969440:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969448:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6fa00) 00010000:00010000:0.0:1746065119.969450:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065119.969451:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969455:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4f2554 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065119.969491:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8f4 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.969501:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8f4 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065119.969506:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065119.969508:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065119.969510:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.969514:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065119.969518:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a4c00, rc 0) 00000100:00100000:0.0:1746065119.969590:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:28855:x1830881260911232:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 483us (554us total) trans 8589942999 rc 0/0 00000100:00100000:0.0:1746065119.969596:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8959 00000100:00100000:2.0:1746065119.971607:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259674112:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065119.971623:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065119.971986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065119.972028:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260911360 00000100:00100000:3.0:1746065119.972033:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260911360 00010000:00010000:3.0:1746065119.972053:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8e6 expref: 10 pid: 16767 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065119.972083:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5176 00000100:00100000:3.0:1746065119.972088:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260911360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065119.972098:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065119.972102:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8e6 expref: 10 pid: 16767 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065119.972116:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8e6 expref: 10 pid: 16767 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065119.972130:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4f252a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8e6 expref: 10 pid: 16767 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065119.972152:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065119.972156:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065119.972163:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065119.972169:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065119.972188:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065119.972212:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260911360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 123us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065119.972218:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5176 00010000:00010000:2.0:1746065119.972240:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.972247:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065119.972274:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:2.0:1746065119.972277:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065119.972287:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.972315:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093036c00/0x14b4f8542d4f2538 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ed expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.972328:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ed expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.972334:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.972336:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065119.972338:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093037800, rc 0) 00000100:00100000:2.0:1746065119.972377:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28853:x1830881260910976:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3736us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065119.972386:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8958 00000100:00100000:0.0:1746065119.974727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065119.975625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.975660:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260911488 00000100:00100000:2.0:1746065119.975669:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260911488 00000100:00100000:2.0:1746065119.975721:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10428 00000100:00100000:2.0:1746065119.975730:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260911488:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.975747:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.975764:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093036a00/0x14b4f8542d4f2569 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a8fb expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065119.975842:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259674240:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065119.975934:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065119.976380:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260911616 00000100:00100000:0.0:1746065119.976384:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260911616 00000100:00100000:0.0:1746065119.976444:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10429 00000100:00100000:0.0:1746065119.976450:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260911616:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065119.976457:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065119.976466:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2570 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a902 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065119.976489:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259674368:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065119.976872:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065119.978127:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259674240:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065119.978156:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093036a00/0x14b4f8542d4f2569 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8fb expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.978169:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093036a00/0x14b4f8542d4f2569 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8fb expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065119.978203:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093036a00, rc 0) 00000100:00100000:1.0:1746065119.978856:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259674368:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065119.978877:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2570 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a902 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.978892:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2570 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a902 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065119.978927:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5e00, rc 0) 00000100:00100000:1.0:1746065119.979938:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260911616:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3476us (4304us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065119.979945:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10429 00000100:00100000:2.0:1746065119.980175:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260911488:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4445us (5451us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.980180:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10428 00000100:00100000:0.0:1746065119.984512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.984583:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260911872 00000100:00100000:2.0:1746065119.984589:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260911872 00000100:00100000:2.0:1746065119.984621:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8960 00000100:00100000:2.0:1746065119.984627:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28853:x1830881260911872:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065119.984644:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065119.984660:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2577 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a909 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.984735:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984746:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984754:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984763:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984768:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984773:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984778:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a596d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065119.984781:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984786:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984795:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065119.984798:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065119.984802:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984809:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f257e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065119.984848:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2577 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a909 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.984854:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2577 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a909 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065119.984861:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596cc00, rc 0) 00000100:00100000:2.0:1746065119.984896:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28853:x1830881260911872:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 270us (391us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065119.984901:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8960 00000100:00100000:0.0:1746065119.989099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065119.989208:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260912128 00000100:00100000:2.0:1746065119.989217:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260912128 00000100:00100000:2.0:1746065119.989339:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3642 00000100:00100000:2.0:1746065119.989350:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b879c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28853:x1830881260912128:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:2.0:1746065119.990299:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b879c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28853:x1830881260912128:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 946us (1206us total) trans 8589943000 rc 0/0 00000100:00100000:2.0:1746065119.990308:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3642 00000100:00100000:0.0:1746065120.008673:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.012078:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260912256 00000100:00100000:2.0:1746065120.012088:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260912256 00000100:00100000:2.0:1746065120.012253:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10430 00000100:00100000:2.0:1746065120.012262:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+8:28855:x1830881260912256:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065120.012277:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.012292:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a910 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.012316:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 9 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.012324:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8df expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.012331:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 15 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.012336:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.012338:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.012341:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3899392->4194303] (req 3899392->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.012378:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 15 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.012389:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 15 pid: 8427 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.012400:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259674496:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.014171:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8df expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.014183:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8df expref: 10 pid: 21235 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.014195:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259674624:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.016487:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 9 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.016504:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 9 pid: 8427 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.016515:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259674752:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.017125:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.017148:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259674496:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.018745:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.018782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.018839:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260912384 00000100:00100000:1.0:1746065120.018845:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260912384 00010000:00010000:1.0:1746065120.018878:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8df expref: 11 pid: 21235 timeout: 819 lvb_type: 1 00000100:00100000:1.0:1746065120.018897:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260912512 00000100:00100000:1.0:1746065120.018900:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260912512 00010000:00010000:1.0:1746065120.018910:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 16 pid: 8427 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.018923:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5177 00000100:00100000:1.0:1746065120.018928:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260912384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.018938:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.018954:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8df expref: 11 pid: 21235 timeout: 819 lvb_type: 1 00010000:00010000:1.0:1746065120.018963:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8df expref: 11 pid: 21235 timeout: 819 lvb_type: 1 00010000:00010000:1.0:1746065120.018989:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.019019:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260912384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.019025:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5177 00000100:00100000:1.0:1746065120.019040:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5178 00000100:00100000:1.0:1746065120.019044:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260912512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.019050:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.019056:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 16 pid: 8427 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.019064:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 16 pid: 8427 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.019075:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5800/0x14b4f8542d4f2466 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a876 expref: 16 pid: 8427 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.019089:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.019102:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881260912512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.019106:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5178 00000100:00080000:1.0:1746065120.019191:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746065120.019421:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f89c00/0x14b4f8542d4f2507 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8df expref: 10 pid: 21235 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746065120.019434:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259674624:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.019780:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259674752:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.019808:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3899392->4194303] (req 3899392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.019913:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596d200, rc 0) 00000100:00100000:3.0:1746065120.020347:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+9:28855:x1830881260912256:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8085us (11680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.020353:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10430 00000100:00100000:2.0:1746065120.022522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.022522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.023391:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260912768 00000100:00100000:0.0:1746065120.023397:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260912768 00000100:00100000:0.0:1746065120.023433:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8961 00000100:00100000:0.0:1746065120.023439:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:28860:x1830881260912768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.023457:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.023470:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e38e400/0x14b4f8542d4f258c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a917 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.024020:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024030:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024042:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024051:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024056:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024061:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024146:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024154:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024159:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065120.024166:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:0.0:1746065120.024344:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024350:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024356:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024370:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ed4600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065120.024373:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024379:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024387:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065120.024389:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065120.024392:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024396:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4f2593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024613:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024618:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024623:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024627:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ed4800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065120.024629:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024633:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024640:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f500) 00010000:00010000:0.0:1746065120.024642:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065120.024644:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024648:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4f259a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.024681:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e38e400/0x14b4f8542d4f258c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a917 expref: 255 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.024690:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a917 expref: 254 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.024696:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065120.024697:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065120.024699:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4400, rc 0) 00000100:00100000:0.0:1746065120.024993:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28860:x1830881260912768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1552us (2474us total) trans 8589943001 rc 0/0 00000100:00100000:0.0:1746065120.025000:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8961 00000100:00100000:0.0:1746065120.025029:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260912896 00000100:00100000:0.0:1746065120.025033:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260912896 00010000:00010000:0.0:1746065120.025050:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 9 pid: 8427 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.025081:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5179 00000100:00100000:0.0:1746065120.025086:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:1959:x1830881260912896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.025095:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.025110:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 9 pid: 8427 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.025253:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 9 pid: 8427 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.025273:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5000/0x14b4f8542d4f245f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a86f expref: 9 pid: 8427 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.025282:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.025283:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.025289:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.025295:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.025318:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.025326:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259674880:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065120.025606:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.030251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.030635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.030662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.030683:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260913024 00000100:00100000:1.0:1746065120.030689:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260913024 00000100:00100000:0.0:1746065120.030706:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259674880:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065120.030721:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.030736:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260913152 00000100:00100000:1.0:1746065120.030739:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260913152 00000100:00100000:1.0:1746065120.030751:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260913280 00000100:00100000:0.0:1746065120.030752:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+8:1959:x1830881260912896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5666us (8234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.030753:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260913280 00000100:00100000:0.0:1746065120.030760:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5179 00000100:00100000:1.0:1746065120.030763:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10431 00000100:00100000:1.0:1746065120.030768:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260913024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.030780:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065120.030785:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10432 00000100:00100000:0.0:1746065120.030791:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881260913152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.030794:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a66de00/0x14b4f8542d4f25af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a91e expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.030796:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.030803:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d02200/0x14b4f8542d4f25b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a925 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.030843:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259675136:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065120.030843:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259675008:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065120.030886:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.031237:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10433 00000100:00100000:2.0:1746065120.031243:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881260913280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.031248:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.031254:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b916800/0x14b4f8542d4f25bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a92c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.031273:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259675264:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065120.031392:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00080000:1.0:1746065120.031402:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065120.031446:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.031455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.031470:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260913536 00000100:00100000:2.0:1746065120.031473:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260913536 00002000:00100000:2.0:1746065120.031498:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3899392->3903487) req@ffff88009ba1c700 x1830881260913536/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.031510:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c700 with x1830881260913536 ext(3899392->3903487) 00002000:00010000:2.0:1746065120.031513:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1c700 00000100:00100000:2.0:1746065120.031808:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4771 00000100:00100000:2.0:1746065120.031830:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260913536:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065120.032151:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881260913536:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 336us (694us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065120.032157:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4771 00002000:00100000:2.0:1746065120.032161:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3899392->3903487) req@ffff88009ba1c700 x1830881260913536/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.032168:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c700 with x1830881260913536 ext(3899392->3903487) 00002000:00010000:2.0:1746065120.032170:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1c700 00000100:00100000:1.0:1746065120.033345:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259675136:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065120.033378:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a66de00/0x14b4f8542d4f25af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a91e expref: 23 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.033388:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a66de00/0x14b4f8542d4f25af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a91e expref: 23 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.033395:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66de00, rc 0) 00000100:00100000:1.0:1746065120.033429:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260913024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2661us (3186us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065120.033435:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10431 00000100:00100000:2.0:1746065120.033527:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259675008:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065120.033545:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d02200/0x14b4f8542d4f25b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a925 expref: 18 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.033554:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d02200/0x14b4f8542d4f25b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a925 expref: 18 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.034102:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d02200, rc 0) 00000100:00100000:2.0:1746065120.034127:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881260913152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3335us (3492us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.034133:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10432 00000100:00100000:0.0:1746065120.036040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.036164:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260913664 00000100:00100000:2.0:1746065120.036171:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260913664 00000100:00100000:2.0:1746065120.036215:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10434 00000100:00100000:2.0:1746065120.036222:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+8:28855:x1830881260913664:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065120.036240:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.036255:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a933 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.036278:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.036286:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d8 expref: 6 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.036292:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a868 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.036298:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.036300:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.036303:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.036398:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a868 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.036409:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a868 expref: 21 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.036420:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259675392:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.036499:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d8 expref: 6 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.036507:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d8 expref: 6 pid: 25185 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.037263:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259675520:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.037979:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.037990:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 9 pid: 8428 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.037999:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259675648:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.038469:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dc00 going to sleep for 11 seconds 00002000:00010000:3.0:1746065120.038981:0:4544:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065119 -> 1746065120 00002000:00010000:3.0:1746065120.038985:0:4544:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065119 -> 1746065120 00000100:00100000:3.0:1746065120.039001:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259675264:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065120.039032:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b916800/0x14b4f8542d4f25bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a92c expref: 16 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.039043:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b916800/0x14b4f8542d4f25bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a92c expref: 16 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.039056:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b916800, rc 0) 00000100:00100000:3.0:1746065120.039081:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881260913280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7837us (8416us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065120.039088:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10433 00000100:00100000:2.0:1746065120.041420:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259675392:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.041432:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259675520:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.041439:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259675648:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.041466:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.041483:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b917800, rc 0) 00000100:00100000:2.0:1746065120.041525:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+9:28855:x1830881260913664:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5302us (5492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.041536:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10434 00000100:00100000:2.0:1746065120.044390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.044421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.044510:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260913792 00000100:00100000:3.0:1746065120.044517:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260913792 00000100:00100000:2.0:1746065120.044523:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065120.044545:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d8 expref: 7 pid: 25185 timeout: 819 lvb_type: 1 00000100:00100000:1.0:1746065120.044578:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260913920 00000100:00100000:0.0:1746065120.044578:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260914048 00000100:00100000:1.0:1746065120.044581:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260913920 00000100:00100000:0.0:1746065120.044581:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260914048 00010000:00010000:1.0:1746065120.044593:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a868 expref: 22 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.044593:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 9 pid: 8428 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.044617:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5180 00000100:00100000:0.0:1746065120.044624:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881260914048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.044636:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065120.044637:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5181 00000100:00100000:1.0:1746065120.044642:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260913920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.044647:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.044652:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 9 pid: 8428 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.044654:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a868 expref: 22 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.044661:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 9 pid: 8428 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.044696:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5182 00000100:00100000:3.0:1746065120.044701:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260913792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.044709:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.044933:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a868 expref: 22 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.044943:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d8 expref: 7 pid: 25185 timeout: 819 lvb_type: 1 00010000:00010000:1.0:1746065120.044950:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4f2458 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a868 expref: 22 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.044951:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d8 expref: 7 pid: 25185 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746065120.044960:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5000/0x14b4f8542d4f251c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d8 expref: 7 pid: 25185 timeout: 819 lvb_type: 1 00010000:00010000:1.0:1746065120.044962:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065120.044969:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065120.044994:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009feb0200/0x14b4f8542d4f2451 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a861 expref: 9 pid: 8428 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.045007:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.045009:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.045014:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.045021:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.045045:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.045054:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259675776:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065120.045095:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260913920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 452us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.045101:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5181 00000100:00100000:3.0:1746065120.045164:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260913792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 463us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.045170:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5182 00000100:00100000:0.0:1746065120.045261:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.045276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.045381:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260914176 00000100:00100000:3.0:1746065120.045384:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260914176 00000100:00100000:3.0:1746065120.045400:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10435 00000100:00100000:3.0:1746065120.045404:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:28860:x1830881260914176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.045414:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.045422:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a93a expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.045436:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 8 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.045441:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065120.045519:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065120.045524:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.045550:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 8 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.045559:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 8 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.045566:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259675904:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.045598:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.047035:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259675776:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065120.047048:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.047080:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881260914048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2456us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.047088:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5180 00000100:00100000:0.0:1746065120.049443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.049498:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260914304 00000100:00100000:2.0:1746065120.049505:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260914304 00000100:00100000:3.0:1746065120.049527:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259675904:192.168.202.46@tcp:104: 00002000:00100000:2.0:1746065120.049538:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (778240->1048575) req@ffff88009f044a80 x1830881260914304/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.049546:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044a80 with x1830881260914304 ext(778240->1048575) 00010000:00010000:3.0:1746065120.049551:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.049552:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 8 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.049562:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 8 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.049563:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e9a00, rc 0) 00002000:00010000:2.0:1746065120.049567:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f044a80 00000100:00100000:2.0:1746065120.049596:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1477 00000100:00100000:3.0:1746065120.049602:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:28860:x1830881260914176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4198us (4326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.049602:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1958:x1830881260914304:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065120.049608:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10435 00000100:00100000:2.0:1746065120.050774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.051109:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260914560 00000100:00100000:0.0:1746065120.051115:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260914560 00002000:00100000:0.0:1746065120.051135:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (4419584->4423679) req@ffff880095350700 x1830881260914560/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.051143:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350700 with x1830881260914560 ext(4419584->4423679) 00002000:00010000:0.0:1746065120.051147:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350700 00000100:00100000:0.0:1746065120.051174:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4772 00000100:00100000:0.0:1746065120.051180:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260914560:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065120.052409:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260914560:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1222us (1631us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065120.052417:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4772 00002000:00100000:0.0:1746065120.052427:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (4419584->4423679) req@ffff880095350700 x1830881260914560/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.052440:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350700 with x1830881260914560 ext(4419584->4423679) 00002000:00010000:0.0:1746065120.052445:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350700 00000100:00100000:2.0:1746065120.056043:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881260914304:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 6430us (6595us total) trans 17179872747 rc 0/0 00000100:00100000:2.0:1746065120.056055:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1477 00002000:00100000:2.0:1746065120.056066:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (778240->1048575) req@ffff88009f044a80 x1830881260914304/t17179872747(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.056075:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044a80 with x1830881260914304 ext(778240->1048575) 00010000:00010000:2.0:1746065120.056084:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 10 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.056099:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 10 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746065120.056105:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f044a80 00000100:00100000:0.0:1746065120.058138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.058315:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260914816 00000100:00100000:2.0:1746065120.058323:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260914816 00000100:00100000:2.0:1746065120.058425:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3643 00000100:00100000:2.0:1746065120.058435:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:28855:x1830881260914816:12345-192.168.202.46@tcp:35:multiop.0 00000100:00080000:1.0:1746065120.059702:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065120.060794:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:28855:x1830881260914816:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 2354us (2655us total) trans 8589943002 rc 0/0 00000100:00100000:2.0:1746065120.060804:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3643 00000100:00100000:0.0:1746065120.061598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.061789:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260914944 00000100:00100000:2.0:1746065120.061797:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260914944 00010000:00010000:2.0:1746065120.061855:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 10 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.061885:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5183 00000100:00100000:2.0:1746065120.061894:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881260914944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.061907:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065120.061925:0:7080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065120 -> 1746065121 00010000:00010000:2.0:1746065120.061933:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 10 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.061944:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 10 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.061967:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f240b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a81b expref: 10 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.061982:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.061984:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.061992:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.062001:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.062033:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.062045:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259676032:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.062109:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.065597:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.065653:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260915200 00000100:00100000:3.0:1746065120.065660:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260915200 00002000:00100000:3.0:1746065120.065692:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f044380 x1830881260915200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065120.065742:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259676032:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065120.065766:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065120.065899:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044380 with x1830881260915200 ext(0->1048575) 00002000:00010000:3.0:1746065120.065903:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f044380 00000100:00100000:3.0:1746065120.065920:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4773 00000100:00100000:3.0:1746065120.065928:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260915200:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065120.066112:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:1958:x1830881260914944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3919us (4218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.066120:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5183 00000100:00100000:3.0:1746065120.079380:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260915200:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13445us (13781us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.079390:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4773 00002000:00100000:3.0:1746065120.079400:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f044380 x1830881260915200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.079407:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044380 with x1830881260915200 ext(0->1048575) 00002000:00010000:3.0:1746065120.079413:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f044380 00000100:00100000:0.0:1746065120.091314:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.091400:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260915328 00000100:00100000:3.0:1746065120.091409:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260915328 00000100:00100000:3.0:1746065120.091520:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10436 00000100:00100000:3.0:1746065120.091529:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:28860:x1830881260915328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.091543:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.091558:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a941 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.091583:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 7 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.091589:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065120.091591:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065120.091593:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 16 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.091618:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 7 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.091632:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 7 pid: 21998 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.091642:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259676160:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.091733:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.096392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.096494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.096535:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260915712 00000100:00100000:2.0:1746065120.096542:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260915712 00000100:00100000:2.0:1746065120.096586:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8962 00000100:00100000:2.0:1746065120.096592:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:28864:x1830881260915712:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.096611:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.096626:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395e00/0x14b4f8542d4f25d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a94f expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.097400:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097411:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097420:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097430:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097435:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097440:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097529:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097536:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097542:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065120.097549:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065120.097616:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097622:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097627:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097631:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e46400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065120.097634:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097640:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097648:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065120.097651:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065120.097654:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097658:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46400/0x14b4f8542d4f25e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097684:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097692:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097697:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097700:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e47200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065120.097702:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097707:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097712:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205e00) 00010000:00010000:2.0:1746065120.097714:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065120.097716:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097721:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47200/0x14b4f8542d4f25e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.097752:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395e00/0x14b4f8542d4f25d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a94f expref: 17 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.097766:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a94f expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.097771:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065120.097773:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065120.097775:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c314800, rc 0) 00000100:00100000:2.0:1746065120.097828:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+16:28864:x1830881260915712:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1220us (1318us total) trans 8589943003 rc 0/0 00000100:00100000:2.0:1746065120.097835:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8962 00000100:00100000:1.0:1746065120.098405:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260915456 00000100:00100000:1.0:1746065120.098409:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260915456 00000100:00100000:1.0:1746065120.098439:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10437 00000100:00100000:1.0:1746065120.098445:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:28849:x1830881260915456:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065120.098454:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.098640:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a948 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.098657:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 7 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.098668:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.098670:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.098672:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2498560->3145727] (req 2498560->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 18 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.098695:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 7 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.098705:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 7 pid: 21235 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.098715:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259676288:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.099175:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.099452:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259676160:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.099471:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.099480:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e9000, rc 0) 00000100:00100000:2.0:1746065120.099500:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:28860:x1830881260915328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7973us (8193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.099505:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10436 00000100:00100000:0.0:1746065120.099642:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.100007:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260915840 00000100:00100000:2.0:1746065120.100011:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260915840 00002000:00100000:2.0:1746065120.100035:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1622015) req@ffff88009f047480 x1830881260915840/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.100043:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047480 with x1830881260915840 ext(1048576->1622015) 00010000:00010000:2.0:1746065120.100048:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 8 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.100057:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 8 pid: 21998 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746065120.100062:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f047480 00000100:00100000:2.0:1746065120.100074:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1478 00000100:00100000:2.0:1746065120.100080:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881260915840:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065120.102616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.102758:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260916096 00000100:00100000:3.0:1746065120.102765:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260916096 00000100:00100000:3.0:1746065120.102812:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3644 00000100:00100000:3.0:1746065120.102854:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+16:28864:x1830881260916096:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065120.103028:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+17:28864:x1830881260916096:12345-192.168.202.46@tcp:35:cat.0 Request processed in 176us (419us total) trans 8589943004 rc 0/0 00000100:00100000:3.0:1746065120.103034:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3644 00000100:00100000:1.0:1746065120.103264:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259676288:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.103286:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2498560->3145727] (req 2498560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 17 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.103300:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66c400, rc 0) 00000100:00100000:1.0:1746065120.103321:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:28849:x1830881260915456:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4876us (6938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.103327:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10437 00000100:00100000:3.0:1746065120.103601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.103924:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260916224 00000100:00100000:0.0:1746065120.103929:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260916224 00002000:00100000:0.0:1746065120.103952:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3899392->4194303) req@ffff88009ba3c000 x1830881260916224/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.103960:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c000 with x1830881260916224 ext(3899392->4194303) 00010000:00010000:0.0:1746065120.103965:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 10 pid: 21235 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.103976:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 10 pid: 21235 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.103981:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba3c000 00000100:00100000:0.0:1746065120.104007:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1479 00000100:00100000:0.0:1746065120.104013:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260916224:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065120.106000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.106239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.107291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.108305:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260916352 00000100:00100000:1.0:1746065120.108313:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260916352 00000100:00100000:1.0:1746065120.108459:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260916608 00000100:00100000:1.0:1746065120.108463:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260916608 00000100:00100000:0.0:1746065120.108611:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260916480 00000100:00100000:0.0:1746065120.108615:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260916480 00000100:00100000:0.0:1746065120.108640:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10438 00000100:00100000:0.0:1746065120.108646:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+9:1961:x1830881260916352:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.108660:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.108673:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a956 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.108692:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.108694:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.108700:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a956 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.108713:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a956 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.108722:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58fe600, rc 0) 00000100:00100000:0.0:1746065120.108738:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260916352:12345-192.168.202.46@tcp:101:cat.0 Request processed in 93us (2745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.108739:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260915840:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 8658us (9096us total) trans 21474839979 rc 0/0 00000100:00100000:0.0:1746065120.108744:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10438 00000100:00100000:2.0:1746065120.108747:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1478 00002000:00100000:2.0:1746065120.108753:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1622015) req@ffff88009f047480 x1830881260915840/t21474839979(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065120.108756:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10439 00002000:00100000:2.0:1746065120.108761:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047480 with x1830881260915840 ext(1048576->1622015) 00000100:00100000:0.0:1746065120.108761:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260916608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.108767:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 14 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.108767:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.108773:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f260a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a964 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.108776:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 14 pid: 21998 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746065120.108782:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f047480 00000100:00100000:2.0:1746065120.108800:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10440 00000100:00100000:0.0:1746065120.108803:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259676416:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065120.108804:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260916480:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.108809:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.108836:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900c8e00/0x14b4f8542d4f2611 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a95d expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.108853:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92beb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.108855:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259676544:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065120.108872:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dc00 going to sleep for 11 seconds 00002000:00010000:2.0:1746065120.111586:0:4545:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065120 -> 1746065121 00002000:00010000:2.0:1746065120.111592:0:4545:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065120 -> 1746065121 00000100:00100000:2.0:1746065120.111608:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259676544:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065120.111632:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900c8e00/0x14b4f8542d4f2611 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a95d expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.111647:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900c8e00/0x14b4f8542d4f2611 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a95d expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.111660:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900c8e00, rc 0) 00000100:00100000:2.0:1746065120.111693:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260916480:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2887us (4403us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.111699:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10440 00002000:00010000:1.0:1746065120.111842:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065120 -> 1746065121 00002000:00010000:1.0:1746065120.111845:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065120 -> 1746065121 00000100:00100000:1.0:1746065120.111852:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259676416:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065120.111866:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f260a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a964 expref: 13 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.111875:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f260a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a964 expref: 13 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.111890:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58fec00, rc 0) 00000100:00100000:1.0:1746065120.111908:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260916608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3146us (5669us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065120.111913:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10439 00000100:00100000:3.0:1746065120.112090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.112320:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260916736 00000100:00100000:2.0:1746065120.112325:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260916736 00010000:00010000:2.0:1746065120.112343:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 12 pid: 21998 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.112375:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5184 00000100:00100000:2.0:1746065120.112381:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260916736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.112391:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.112398:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 12 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.112407:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 12 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.112422:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093036000/0x14b4f8542d4f2419 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a829 expref: 12 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.112430:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.112432:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.112437:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 16 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.112445:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 16 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.112467:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 16 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.112477:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259676672:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.112529:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.112702:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260916224:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 8688us (9101us total) trans 21474839980 rc 0/0 00000100:00100000:0.0:1746065120.112709:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1479 00002000:00100000:0.0:1746065120.112716:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3899392->4194303) req@ffff88009ba3c000 x1830881260916224/t21474839980(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.112724:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c000 with x1830881260916224 ext(3899392->4194303) 00010000:00010000:0.0:1746065120.112729:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 12 pid: 21235 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.112738:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 12 pid: 21235 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.112743:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba3c000 00000100:00100000:0.0:1746065120.117184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.117293:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259676672:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065120.117310:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.117967:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260916736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5583us (5876us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.117976:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5184 00000100:00100000:1.0:1746065120.118705:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.118724:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260917120 00000100:00100000:1.0:1746065120.118730:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260917120 00002000:00100000:1.0:1746065120.118764:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009a4ebb80 x1830881260917120/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.118772:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ebb80 with x1830881260917120 ext(0->1048575) 00002000:00010000:1.0:1746065120.118776:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ebb80 00000100:00100000:1.0:1746065120.118791:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4774 00000100:00100000:1.0:1746065120.118796:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881260917120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065120.119770:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260916864 00000100:00100000:3.0:1746065120.119776:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260916864 00010000:00010000:3.0:1746065120.119796:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 11 pid: 21235 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.119830:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5185 00000100:00100000:3.0:1746065120.119835:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260916864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.119843:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.119858:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 11 pid: 21235 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.119867:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 11 pid: 21235 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.119885:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4f2585 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a910 expref: 11 pid: 21235 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.119908:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.119910:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.119916:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.119924:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.119948:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.119959:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259676800:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065120.119996:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.121244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.121317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.121426:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260917504 00000100:00100000:2.0:1746065120.121431:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260917504 00002000:00100000:2.0:1746065120.121459:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f046680 x1830881260917504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.121467:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046680 with x1830881260917504 ext(1048576->2097151) 00002000:00010000:2.0:1746065120.121472:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f046680 00000100:00100000:2.0:1746065120.121487:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260917376 00000100:00100000:2.0:1746065120.121490:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260917376 00002000:00100000:2.0:1746065120.121500:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f044700 x1830881260917376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.121511:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044700 with x1830881260917376 ext(1048576->2097151) 00002000:00010000:2.0:1746065120.121513:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f044700 00000100:00100000:2.0:1746065120.121523:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4775 00000100:00100000:2.0:1746065120.121529:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881260917504:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065120.122616:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4776 00000100:00100000:1.0:1746065120.122626:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260917376:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065120.129421:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259676800:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065120.129440:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.129488:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260916864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 9651us (12310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.129502:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5185 00000100:00100000:0.0:1746065120.129856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.129925:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260917888 00000100:00100000:2.0:1746065120.129930:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260917888 00002000:00100000:2.0:1746065120.129960:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2498560->2502655) req@ffff88009f044e00 x1830881260917888/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.129969:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044e00 with x1830881260917888 ext(2498560->2502655) 00002000:00010000:2.0:1746065120.129973:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f044e00 00000100:00100000:2.0:1746065120.129987:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4777 00000100:00100000:2.0:1746065120.129994:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881260917888:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065120.130131:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881260917888:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 137us (275us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065120.130137:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4777 00002000:00100000:2.0:1746065120.130142:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2498560->2502655) req@ffff88009f044e00 x1830881260917888/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.130148:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044e00 with x1830881260917888 ext(2498560->2502655) 00002000:00010000:2.0:1746065120.130150:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f044e00 00000100:00100000:1.0:1746065120.132197:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881260917120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13394us (13486us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065120.132206:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4774 00002000:00100000:1.0:1746065120.132212:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009a4ebb80 x1830881260917120/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.132220:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ebb80 with x1830881260917120 ext(0->1048575) 00002000:00010000:1.0:1746065120.132224:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ebb80 00000100:00100000:1.0:1746065120.135876:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260917376:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13244us (14550us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065120.135887:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4776 00002000:00100000:1.0:1746065120.135897:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f044700 x1830881260917376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.135906:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044700 with x1830881260917376 ext(1048576->2097151) 00002000:00010000:1.0:1746065120.135911:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f044700 00000100:00100000:0.0:1746065120.141082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.141161:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881260917504:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 19631us (19919us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065120.141170:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4775 00002000:00100000:2.0:1746065120.141180:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f046680 x1830881260917504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.141188:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046680 with x1830881260917504 ext(1048576->2097151) 00002000:00010000:2.0:1746065120.141193:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f046680 00000100:00100000:1.0:1746065120.141800:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260918016 00000100:00100000:1.0:1746065120.141807:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260918016 00000100:00100000:1.0:1746065120.142299:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10441 00000100:00100000:1.0:1746065120.142305:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+10:28864:x1830881260918016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.142316:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.142330:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a96b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.142350:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.142352:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.142368:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a96b expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.142386:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a96b expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.142394:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f88400, rc 0) 00000100:00100000:1.0:1746065120.142415:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+11:28864:x1830881260918016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 110us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.142420:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10441 00000100:00100000:0.0:1746065120.149464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.149510:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260918272 00000100:00100000:2.0:1746065120.149517:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260918272 00002000:00100000:2.0:1746065120.149553:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f047800 x1830881260918272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.149562:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047800 with x1830881260918272 ext(1048576->2097151) 00002000:00010000:2.0:1746065120.149571:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f047800 00000100:00100000:2.0:1746065120.149600:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4778 00000100:00100000:2.0:1746065120.149607:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881260918272:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.151747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.152028:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260918400 00000100:00100000:2.0:1746065120.152035:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260918400 00000100:00100000:2.0:1746065120.152683:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10442 00000100:00100000:2.0:1746065120.152691:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:28860:x1830881260918400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.152706:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.152721:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a972 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.152745:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.152752:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065120.152754:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065120.152757:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.152782:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.152794:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 9 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.152805:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259676928:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.152903:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.156439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.156514:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260918528 00000100:00100000:1.0:1746065120.156521:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260918528 00000100:00100000:2.0:1746065120.156676:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259676928:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.156704:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.156719:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900c8400, rc 0) 00000100:00100000:2.0:1746065120.157061:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28860:x1830881260918400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4370us (5320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.157147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.157211:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10443 00000100:00100000:2.0:1746065120.157216:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10442 00000100:00100000:1.0:1746065120.157218:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28849:x1830881260918528:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065120.157231:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.157243:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a979 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.157258:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.157259:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.157262:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3538943] (req 3145728->3538943) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 24 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.157268:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3538943] (req 3145728->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 24 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.157274:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f89a00, rc 0) 00000100:00100000:1.0:1746065120.157292:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28849:x1830881260918528:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 75us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.157300:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10443 00000100:00100000:1.0:1746065120.157315:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260918656 00000100:00100000:1.0:1746065120.157318:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260918656 00002000:00100000:1.0:1746065120.157334:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4423679) req@ffff88009c125f80 x1830881260918656/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.157341:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125f80 with x1830881260918656 ext(4194304->4423679) 00010000:00010000:1.0:1746065120.157346:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 10 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.157355:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 10 pid: 4545 timeout: 819 lvb_type: 0 00002000:00010000:1.0:1746065120.157375:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c125f80 00000100:00100000:1.0:1746065120.157387:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1480 00000100:00100000:1.0:1746065120.157392:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260918656:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065120.157498:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881260918272:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7891us (8041us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065120.157504:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4778 00002000:00100000:2.0:1746065120.157509:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f047800 x1830881260918272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.157516:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047800 with x1830881260918272 ext(1048576->2097151) 00002000:00010000:2.0:1746065120.157519:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f047800 00000100:00100000:1.0:1746065120.161278:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260918656:12345-192.168.202.46@tcp:4:cat.0 Request processed in 3878us (4123us total) trans 17179872748 rc 0/0 00000100:00100000:1.0:1746065120.161289:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1480 00002000:00100000:1.0:1746065120.161299:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4423679) req@ffff88009c125f80 x1830881260918656/t17179872748(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.161306:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125f80 with x1830881260918656 ext(4194304->4423679) 00010000:00010000:1.0:1746065120.161315:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 12 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.161332:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 12 pid: 4545 timeout: 819 lvb_type: 0 00002000:00010000:1.0:1746065120.161338:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c125f80 00000100:00100000:0.0:1746065120.163249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.163675:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260918784 00000100:00100000:3.0:1746065120.163684:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260918784 00000100:00100000:3.0:1746065120.163732:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10444 00000100:00100000:3.0:1746065120.163739:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+12:28864:x1830881260918784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.163753:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.163767:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a980 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.163787:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065120.163792:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 13 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.163802:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 13 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.163812:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e9400, rc 0) 00000100:00100000:3.0:1746065120.163882:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+13:28864:x1830881260918784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 143us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.163887:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10444 00000100:00100000:0.0:1746065120.164722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.165435:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260918912 00000100:00100000:3.0:1746065120.165441:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260918912 00010000:00010000:3.0:1746065120.165467:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 13 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.165670:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5186 00000100:00100000:3.0:1746065120.165679:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881260918912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.165691:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065120.165716:0:10991:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065119 -> 1746065121 00002000:00010000:3.0:1746065120.165718:0:10991:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065120 -> 1746065121 00010000:00010000:3.0:1746065120.165723:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 13 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.165733:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 13 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.165753:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b917800/0x14b4f8542d4f25c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a933 expref: 13 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.165778:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.165780:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.165785:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.165792:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.165798:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.165799:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.165801:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 23 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.165807:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 23 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.165812:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.165826:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.165830:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.165835:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.165858:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.165868:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259677056:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065120.165947:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 23 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.165955:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259677184:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065120.165980:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.165987:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259677312:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065120.166001:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.171488:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259677184:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065120.171647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.172421:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259677312:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065120.172428:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259677056:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065120.172451:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.172487:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260918912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6810us (7765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.172499:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5186 00000100:00100000:3.0:1746065120.173267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.173275:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260919168 00000100:00100000:1.0:1746065120.173282:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260919168 00000100:00100000:3.0:1746065120.173291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065120.173336:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3534848->3538943) req@ffff88009c125c00 x1830881260919168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065120.173344:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260919424 00002000:00100000:3.0:1746065120.173345:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125c00 with x1830881260919168 ext(3534848->3538943) 00000100:00100000:0.0:1746065120.173347:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260919424 00002000:00010000:3.0:1746065120.173349:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c125c00 00000100:00100000:3.0:1746065120.173371:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260919808 00002000:00100000:0.0:1746065120.173372:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012e8b4a80 x1830881260919424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065120.173373:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260919808 00002000:00100000:0.0:1746065120.173379:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4a80 with x1830881260919424 ext(2097152->3145727) 00002000:00100000:3.0:1746065120.173381:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012e8b4700 x1830881260919808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746065120.173381:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b4a80 00002000:00100000:3.0:1746065120.173387:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4700 with x1830881260919808 ext(2097152->3145727) 00002000:00010000:3.0:1746065120.173389:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b4700 00000100:00100000:0.0:1746065120.173389:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4779 00000100:00100000:0.0:1746065120.173395:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260919168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065120.173398:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4780 00000100:00100000:3.0:1746065120.173401:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260919424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065120.173446:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4781 00000100:00100000:3.0:1746065120.173451:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881260919808:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.173600:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260919168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 204us (1954us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065120.173605:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4779 00002000:00100000:0.0:1746065120.173610:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3534848->3538943) req@ffff88009c125c00 x1830881260919168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.173617:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125c00 with x1830881260919168 ext(3534848->3538943) 00002000:00010000:0.0:1746065120.173620:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c125c00 00000100:00100000:0.0:1746065120.177675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.178436:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260919936 00000100:00100000:2.0:1746065120.178443:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260919936 00002000:00100000:2.0:1746065120.178479:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->2498559) req@ffff88009c126a00 x1830881260919936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.178489:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c126a00 with x1830881260919936 ext(2097152->2498559) 00002000:00010000:2.0:1746065120.178493:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c126a00 00000100:00100000:2.0:1746065120.179323:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4782 00000100:00100000:2.0:1746065120.179334:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881260919936:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065120.180687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.181255:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260920192 00000100:00100000:3.0:1746065120.181261:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260920192 00000100:00100000:3.0:1746065120.181464:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3645 00000100:00100000:3.0:1746065120.181472:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28849:x1830881260920192:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065120.182936:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:28849:x1830881260920192:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1460us (2247us total) trans 8589943005 rc 0/0 00000100:00100000:3.0:1746065120.182948:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3645 00000100:00100000:2.0:1746065120.186351:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260919424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12940us (13077us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065120.186373:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4780 00002000:00100000:2.0:1746065120.186383:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012e8b4a80 x1830881260919424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.186392:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4a80 with x1830881260919424 ext(2097152->3145727) 00002000:00010000:2.0:1746065120.186397:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b4a80 00000100:00100000:3.0:1746065120.192533:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260919808:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19072us (19232us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.192543:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4781 00002000:00100000:3.0:1746065120.192553:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012e8b4700 x1830881260919808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.192561:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4700 with x1830881260919808 ext(2097152->3145727) 00002000:00010000:3.0:1746065120.192566:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b4700 00000100:00100000:0.0:1746065120.192912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.193149:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881260919936:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13817us (15480us total) trans 0 rc 401408/401408 00000100:00100000:2.0:1746065120.193155:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4782 00002000:00100000:2.0:1746065120.193161:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->2498559) req@ffff88009c126a00 x1830881260919936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.193168:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c126a00 with x1830881260919936 ext(2097152->2498559) 00002000:00010000:2.0:1746065120.193171:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c126a00 00000100:00100000:1.0:1746065120.193244:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260920320 00000100:00100000:1.0:1746065120.193250:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260920320 00000100:00100000:1.0:1746065120.193291:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10445 00000100:00100000:1.0:1746065120.193298:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+11:28864:x1830881260920320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.193309:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.193322:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a987 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.193343:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.193349:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.193350:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.193353:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.193390:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.193399:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 16 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.193411:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259677440:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.193467:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.197127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.197397:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260920576 00000100:00100000:2.0:1746065120.197405:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260920576 00002000:00100000:2.0:1746065120.197441:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3538944->4194303) req@ffff88009c126300 x1830881260920576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.197449:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c126300 with x1830881260920576 ext(3538944->4194303) 00002000:00010000:2.0:1746065120.197454:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c126300 00000100:00100000:2.0:1746065120.197495:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4783 00000100:00100000:2.0:1746065120.197501:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260920576:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.198714:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.199458:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260920832 00000100:00100000:3.0:1746065120.199464:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260920832 00002000:00100000:3.0:1746065120.199491:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009c124700 x1830881260920832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.199499:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124700 with x1830881260920832 ext(3145728->4194303) 00010000:00010000:3.0:1746065120.199506:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 17 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.199517:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 17 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746065120.199522:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c124700 00000100:00100000:3.0:1746065120.199550:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1481 00000100:00100000:3.0:1746065120.199556:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881260920832:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.201559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.201587:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260920960 00000100:00100000:0.0:1746065120.201593:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260920960 00002000:00100000:0.0:1746065120.201624:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2498560->3145727) req@ffff88009c125880 x1830881260920960/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.201634:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125880 with x1830881260920960 ext(2498560->3145727) 00010000:00010000:0.0:1746065120.201643:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 19 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.201660:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 19 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746065120.201666:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c125880 00000100:00100000:0.0:1746065120.201683:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1482 00000100:00100000:0.0:1746065120.201690:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881260920960:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065120.203335:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259677440:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.203372:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.203387:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01b4a00, rc 0) 00000100:00100000:1.0:1746065120.203421:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:28864:x1830881260920320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10122us (10508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.203427:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10445 00000100:00100000:3.0:1746065120.209059:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260920576:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11550us (11931us total) trans 0 rc 655360/655360 00000100:00100000:3.0:1746065120.209072:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4783 00002000:00100000:3.0:1746065120.209082:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3538944->4194303) req@ffff88009c126300 x1830881260920576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.209091:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c126300 with x1830881260920576 ext(3538944->4194303) 00002000:00010000:3.0:1746065120.209096:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c126300 00000100:00100000:2.0:1746065120.213017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.213760:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260921088 00000100:00100000:3.0:1746065120.213768:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260921088 00000100:00100000:3.0:1746065120.213836:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8963 00000100:00100000:3.0:1746065120.213846:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28866:x1830881260921088:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065120.213869:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.213886:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f263b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a98e expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.213931:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.213940:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.213948:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.213957:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.213962:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.213966:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214054:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4f2650 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214061:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4f2650 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214069:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4f2650 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065120.214093:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:3.0:1746065120.214096:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065120.214106:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4f2650 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214113:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4f2650 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214118:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214123:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214127:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214132:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53cee00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065120.214134:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214139:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214146:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065120.214148:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065120.214151:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214155:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214487:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214492:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214497:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214501:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53cea00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065120.214503:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214508:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214515:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669200) 00010000:00010000:3.0:1746065120.214517:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065120.214519:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214523:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f2649 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.214545:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4f263b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a98e expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.214559:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4f2650 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a98e expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.214564:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.214566:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065120.214568:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53cf000, rc 0) 00000100:00100000:3.0:1746065120.214607:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28866:x1830881260921088:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 764us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.214613:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8963 00000100:00100000:2.0:1746065120.215416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.216066:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881260920832:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16509us (17353us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.216075:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1481 00002000:00100000:3.0:1746065120.216084:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009c124700 x1830881260920832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.216092:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124700 with x1830881260920832 ext(3145728->4194303) 00010000:00010000:3.0:1746065120.216099:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 19 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.216112:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 19 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746065120.216118:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c124700 00000100:00100000:0.0:1746065120.221419:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260921216 00000100:00100000:0.0:1746065120.221429:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260921216 00000100:00100000:0.0:1746065120.221476:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10446 00000100:00100000:0.0:1746065120.221484:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:28860:x1830881260921216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.221499:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.221514:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a995 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.221535:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065120.221538:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065120.221541:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.221550:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.221558:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501e00, rc 0) 00000100:00100000:0.0:1746065120.221599:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:28860:x1830881260921216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 116us (6184us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.221607:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10446 00000100:00100000:2.0:1746065120.223505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.223532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.224167:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881260920960:12345-192.168.202.46@tcp:4:cat.0 Request processed in 22436us (22574us total) trans 21474839981 rc 0/0 00000100:00100000:1.0:1746065120.224177:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1482 00002000:00100000:1.0:1746065120.224185:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2498560->3145727) req@ffff88009c125880 x1830881260920960/t21474839981(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.224193:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125880 with x1830881260920960 ext(2498560->3145727) 00010000:00010000:1.0:1746065120.224201:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 20 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.224340:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 20 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:1.0:1746065120.224345:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c125880 00000100:00100000:2.0:1746065120.224703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.224719:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260921472 00000100:00100000:2.0:1746065120.224725:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260921472 00000100:00100000:2.0:1746065120.224794:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10447 00000100:00100000:2.0:1746065120.224800:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260921472:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065120.224811:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065120.224849:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260921728 00000100:00100000:1.0:1746065120.224852:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260921728 00010000:00010000:2.0:1746065120.224930:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9a3 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.224946:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.224947:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.224954:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9a3 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.224966:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9a3 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.224978:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58fec00, rc 0) 00000100:00100000:2.0:1746065120.225001:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260921472:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 201us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.225005:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10447 00000100:00100000:2.0:1746065120.225014:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260921344 00000100:00100000:2.0:1746065120.225017:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260921344 00000100:00100000:2.0:1746065120.225031:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10448 00000100:00100000:2.0:1746065120.225035:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881260921344:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065120.225041:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.225050:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a99c expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.225059:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.225061:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.225064:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a99c expref: 7 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.225072:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a99c expref: 7 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.225078:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5c00, rc 0) 00000100:00100000:2.0:1746065120.225093:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260921344:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 58us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.225097:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10448 00000100:00100000:2.0:1746065120.225121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.225132:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260921600 00000100:00100000:2.0:1746065120.225134:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260921600 00000100:00100000:2.0:1746065120.225147:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10449 00000100:00100000:2.0:1746065120.225151:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260921600:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065120.225156:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.225162:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f266c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9aa expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.225191:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259677568:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065120.225228:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.225266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.225712:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10450 00000100:00100000:1.0:1746065120.225718:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260921728:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065120.225725:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.225731:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f2673 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9b1 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.225752:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259677696:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065120.226533:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.227200:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260921856 00000100:00100000:3.0:1746065120.227206:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260921856 00000100:00100000:3.0:1746065120.227438:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 618 00000100:00100000:3.0:1746065120.227446:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260921856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.227456:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.227474:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4f2650 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a98e expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.227849:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.227853:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.227880:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881260921856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 435us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.227887:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 618 00000100:00100000:0.0:1746065120.228572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.229215:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260921984 00000100:00100000:3.0:1746065120.229221:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260921984 00010000:00010000:3.0:1746065120.229242:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 20 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.229273:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5187 00000100:00100000:3.0:1746065120.229278:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881260921984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.229287:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.229305:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 20 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.229317:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 20 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.229332:0:4544:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88009a4e9500 x1830881259677696) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x54801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 20 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.229336:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.229338:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.229343:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.229350:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.229370:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.229372:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.229375:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.229381:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.229412:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c400/0x14b4f8542d4f25fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a948 expref: 20 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.229419:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065120.229420:0:4545:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065119 -> 1746065121 00000100:00100000:3.0:1746065120.229430:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259677824:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.229432:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259677568:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065120.229439:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259677696:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065120.229451:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f266c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9aa expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.229457:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f2673 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b1 expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.229459:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f266c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9aa expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.229465:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0094e00/0x14b4f8542d4f2673 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b1 expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.229469:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5e00, rc 0) 00010000:00010000:1.0:1746065120.229472:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0094e00, rc 0) 00010000:00010000:3.0:1746065120.229483:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.229486:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260921600:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4335us (4365us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065120.229492:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259677952:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065120.229493:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260921728:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3775us (5959us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.229494:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10449 00000100:00100000:1.0:1746065120.229502:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10450 00000100:00100000:3.0:1746065120.229508:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.231156:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259677824:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065120.231166:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259677952:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065120.231183:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.231681:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260921984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2400us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.231690:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5187 00000100:00100000:0.0:1746065120.232096:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.232592:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260922240 00000100:00100000:3.0:1746065120.232599:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260922240 00000100:00100000:3.0:1746065120.232725:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8964 00000100:00100000:3.0:1746065120.232732:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28866:x1830881260922240:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065120.232745:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.232758:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f267a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9b8 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.232860:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.232872:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ed expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.232879:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a917 expref: 254 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.232885:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a94f expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.232890:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.232911:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a94f expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.232920:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a94f expref: 16 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.232935:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259678080:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.233005:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a917 expref: 254 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.233013:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a917 expref: 254 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.233019:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259678208:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.233041:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ed expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.233048:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ed expref: 10 pid: 16767 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.233054:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259678336:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.233069:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.234728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.234771:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260922496 00000100:00100000:1.0:1746065120.234777:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260922496 00002000:00100000:1.0:1746065120.234810:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009c125180 x1830881260922496/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.234843:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125180 with x1830881260922496 ext(2097152->3145727) 00002000:00010000:1.0:1746065120.234848:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c125180 00000100:00100000:1.0:1746065120.234887:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4784 00000100:00100000:1.0:1746065120.234894:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260922496:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065120.234941:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259678080:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.235195:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.235207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.235225:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260922752 00000100:00100000:1.0:1746065120.235228:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260922752 00000100:00100000:0.0:1746065120.235234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065120.235244:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a917 expref: 255 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.235258:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259678208:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.235264:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259678336:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.235284:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065120.235832:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260922624 00000100:00100000:1.0:1746065120.235836:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260922624 00000100:00100000:0.0:1746065120.235836:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260922880 00000100:00100000:0.0:1746065120.235840:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260922880 00010000:00010000:1.0:1746065120.235847:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a94f expref: 17 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.235853:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ed expref: 11 pid: 16767 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.235869:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5188 00000100:00100000:1.0:1746065120.235875:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1959:x1830881260922752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.235884:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.235889:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a917 expref: 255 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.235892:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5189 00010000:00010000:1.0:1746065120.235897:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a917 expref: 255 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.235897:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260922624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.235904:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.235908:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a94f expref: 17 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.235914:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4400/0x14b4f8542d4f25a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a917 expref: 255 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.235915:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a94f expref: 17 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.235925:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c314800/0x14b4f8542d4f25ee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a94f expref: 17 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.235939:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065120.235943:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.235953:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065120.235957:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.235975:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5190 00000100:00100000:0.0:1746065120.235986:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881260922624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 89us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.235990:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260922880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065120.235992:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5189 00010000:00010000:2.0:1746065120.235998:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.236002:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ed expref: 11 pid: 16767 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.236010:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ed expref: 11 pid: 16767 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.236021:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093037800/0x14b4f8542d4f253f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ed expref: 11 pid: 16767 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.236030:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065120.236033:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.236040:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.236046:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.236060:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.236086:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260922880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.236091:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5190 00010000:00010000:3.0:1746065120.236239:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.236248:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065120.236262:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065120.236274:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065120.236276:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.236294:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1959:x1830881260922752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 418us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.236300:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5188 00010000:00010000:3.0:1746065120.236382:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4f267a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b8 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.236400:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b8 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.236406:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.236409:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065120.236411:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53cee00, rc 0) 00000100:00100000:3.0:1746065120.236432:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28866:x1830881260922240:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3701us (4337us total) trans 8589943006 rc 0/0 00000100:00100000:3.0:1746065120.236437:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8964 00000100:00100000:0.0:1746065120.239658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.240734:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260923136 00000100:00100000:2.0:1746065120.240742:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260923136 00002000:00100000:2.0:1746065120.240780:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009c124000 x1830881260923136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.240790:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124000 with x1830881260923136 ext(3145728->4194303) 00002000:00010000:2.0:1746065120.240795:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c124000 00000100:00100000:2.0:1746065120.240812:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4785 00000100:00100000:2.0:1746065120.240835:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260923136:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.245933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.247158:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260923264 00000100:00100000:3.0:1746065120.247168:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260923264 00000100:00100000:3.0:1746065120.247224:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8965 00000100:00100000:3.0:1746065120.247231:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28866:x1830881260923264:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065120.247253:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.247267:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5574800/0x14b4f8542d4f268f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9bf expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.247333:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.247345:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b8 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.247352:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.247388:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b8 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.247408:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b8 expref: 11 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.247419:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259678464:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.247483:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065120.248312:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260922496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13416us (13586us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065120.248320:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4784 00002000:00100000:1.0:1746065120.248334:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009c125180 x1830881260922496/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.248342:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c125180 with x1830881260922496 ext(2097152->3145727) 00002000:00010000:1.0:1746065120.248347:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c125180 00000100:00100000:3.0:1746065120.249014:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260923136:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8179us (9366us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.249020:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4785 00002000:00100000:3.0:1746065120.249024:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009c124000 x1830881260923136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.249030:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124000 with x1830881260923136 ext(3145728->4194303) 00002000:00010000:3.0:1746065120.249033:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c124000 00000100:00100000:3.0:1746065120.249279:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259678464:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.249296:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065120.250858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.250881:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260923392 00000100:00100000:1.0:1746065120.250888:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260923392 00010000:00010000:1.0:1746065120.250913:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b8 expref: 12 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.250947:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5191 00000100:00100000:1.0:1746065120.250954:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260923392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.250966:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.250971:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b8 expref: 12 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.250984:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b8 expref: 12 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.251000:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cee00/0x14b4f8542d4f2681 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9b8 expref: 12 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.251023:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065120.251027:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.251035:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.251041:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.251064:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.251093:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260923392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 140us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.251099:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5191 00010000:00010000:2.0:1746065120.251218:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.251224:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065120.251257:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:2.0:1746065120.251261:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065120.251271:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.251293:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5574800/0x14b4f8542d4f268f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9bf expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.251344:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9bf expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.251350:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065120.251352:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065120.251362:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5575800, rc 0) 00000100:00100000:2.0:1746065120.251386:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28866:x1830881260923264:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4156us (5464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.251391:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8965 00000100:00100000:2.0:1746065120.254410:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.254455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.254455:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260923520 00000100:00100000:1.0:1746065120.254464:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260923520 00000100:00100000:3.0:1746065120.254660:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260923648 00000100:00100000:3.0:1746065120.254663:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260923648 00000100:00100000:3.0:1746065120.254695:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10451 00000100:00100000:3.0:1746065120.254702:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260923520:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065120.254719:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.254732:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53ce200/0x14b4f8542d4f269d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9c6 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.254775:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259678592:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065120.254801:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10452 00000100:00100000:2.0:1746065120.254809:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260923648:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065120.254832:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.254843:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9cd expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.254853:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.254855:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.254862:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9cd expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.254874:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9cd expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.254882:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58fe200, rc 0) 00000100:00100000:2.0:1746065120.254900:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260923648:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 93us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.254905:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10452 00000100:00100000:3.0:1746065120.255197:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.255924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.255953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.256285:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260923776 00000100:00100000:1.0:1746065120.256290:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260923776 00000100:00100000:1.0:1746065120.256315:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260923904 00000100:00100000:1.0:1746065120.256317:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260923904 00000100:00100000:0.0:1746065120.256326:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10453 00000100:00100000:0.0:1746065120.256332:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+12:28864:x1830881260923776:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065120.256336:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10454 00000100:00100000:1.0:1746065120.256340:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260923904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.256341:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.256347:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.256349:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9d4 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.256353:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0094800/0x14b4f8542d4f26b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9db expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.256375:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.256381:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065120.256382:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065120.256385:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.256400:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.256404:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259678848:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065120.256412:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 25 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.256420:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259678720:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.256607:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.256729:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259678592:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065120.256750:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53ce200/0x14b4f8542d4f269d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9c6 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.256758:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53ce200/0x14b4f8542d4f269d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9c6 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.256770:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53ce200, rc 0) 00000100:00100000:0.0:1746065120.256807:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.257188:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260923520:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2483us (2782us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065120.257194:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10451 00000100:00100000:0.0:1746065120.260529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.260595:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259678720:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065120.260625:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.260640:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501000, rc 0) 00000100:00100000:0.0:1746065120.260672:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+13:28864:x1830881260923776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4340us (4749us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.260679:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10453 00000100:00100000:0.0:1746065120.260749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.260861:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259678848:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065120.260881:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0094800/0x14b4f8542d4f26b2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9db expref: 25 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.260890:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0094800/0x14b4f8542d4f26b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9db expref: 25 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.260900:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0094800, rc 0) 00000100:00100000:1.0:1746065120.260918:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260923904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4578us (4965us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065120.260923:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10454 00000100:00100000:3.0:1746065120.261117:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260924160 00000100:00100000:3.0:1746065120.261122:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260924160 00000100:00100000:3.0:1746065120.262485:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8966 00000100:00100000:3.0:1746065120.262497:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28866:x1830881260924160:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065120.262511:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.262525:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4f26b9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9e2 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.262594:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.262606:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.262613:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065120.262622:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065120.262709:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4f26b9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e2 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.262723:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e2 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.262729:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.262732:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065120.262734:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53ce000, rc 0) 00000100:00100000:3.0:1746065120.262779:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28866:x1830881260924160:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 285us (2257us total) trans 8589943007 rc 0/0 00000100:00100000:3.0:1746065120.262784:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8966 00000100:00100000:3.0:1746065120.262810:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260924288 00000100:00100000:3.0:1746065120.262827:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260924288 00002000:00100000:3.0:1746065120.262849:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3538943) req@ffff88012b4b0e00 x1830881260924288/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.262857:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0e00 with x1830881260924288 ext(3145728->3538943) 00010000:00010000:3.0:1746065120.262863:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 24 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.262873:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 24 pid: 9716 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746065120.262879:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b0e00 00000100:00100000:3.0:1746065120.262891:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1483 00000100:00100000:3.0:1746065120.262896:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260924288:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065120.263750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.263812:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260924416 00000100:00100000:1.0:1746065120.263837:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260924416 00000100:00100000:1.0:1746065120.263857:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10455 00000100:00100000:1.0:1746065120.263861:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:28860:x1830881260924416:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.263868:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.263876:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9e9 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.264139:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.264142:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.264146:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.264155:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.264163:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be8bc00, rc 0) 00000100:00100000:1.0:1746065120.265000:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:28860:x1830881260924416:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1135us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.265006:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10455 00000100:00100000:2.0:1746065120.266145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.266176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.266188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.266193:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260924544 00000100:00100000:2.0:1746065120.266199:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.266200:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260924544 00000100:00100000:2.0:1746065120.266210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.266220:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260924800 00000100:00100000:0.0:1746065120.266221:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260924800 00000100:00100000:2.0:1746065120.266222:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260925056 00000100:00100000:2.0:1746065120.266225:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260925056 00000100:00100000:0.0:1746065120.266230:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260924672 00000100:00100000:0.0:1746065120.266232:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260924672 00000100:00100000:2.0:1746065120.266240:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260924928 00000100:00100000:0.0:1746065120.266405:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10456 00000100:00100000:0.0:1746065120.266412:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260924544:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065120.266439:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266457:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 26 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266464:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a99c expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.266469:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a956 expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.266474:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.266475:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.266478:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266501:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a956 expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065120.266506:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10457 00010000:00010000:0.0:1746065120.266511:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a956 expref: 12 pid: 9716 timeout: 819 lvb_type: 1 00000100:00100000:1.0:1746065120.266514:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260924800:12345-192.168.202.46@tcp:1:lfs.0 00000100:00100000:0.0:1746065120.266520:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259678976:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.266532:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266543:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266551:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ca expref: 13 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.266558:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266563:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.266564:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.266566:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266577:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a99c expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.266585:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266585:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a99c expref: 8 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:1.0:1746065120.266593:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 11 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.266597:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259679104:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.266602:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259679232:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065120.266622:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 26 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266627:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ca expref: 13 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.266630:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 26 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.266634:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ca expref: 13 pid: 8429 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746065120.266637:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259679360:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.266642:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259679488:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.266655:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be000 going to sleep for 11 seconds 00010000:00010000:1.0:1746065120.266660:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266666:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 18 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.266670:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10458 00000100:00100000:1.0:1746065120.266672:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259679616:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.266675:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260925056:12345-192.168.202.46@tcp:1:lfs.0 00000100:00100000:1.0:1746065120.266683:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00010000:00010000:0.0:1746065120.266689:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.266695:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10459 00010000:00010000:0.0:1746065120.266699:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 26 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.266700:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260924672:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065120.266705:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266711:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746065120.266712:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266713:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 12 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266720:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266723:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266727:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9a3 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.266727:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 5 00010000:00010000:0.0:1746065120.266729:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266733:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a96b expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266738:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.266739:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.266741:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 6/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266748:0:8428:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [4194304->4976639] (req 4194304->4976639) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266752:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a96b expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266757:0:8428:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 12 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.266759:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a96b expref: 11 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.266765:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259679872:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065120.266765:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266771:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.266779:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259680128:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.266784:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9a3 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.266795:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9a3 expref: 13 pid: 4545 timeout: 819 lvb_type: 1 00000100:00100000:1.0:1746065120.266801:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259680256:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065120.266804:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 26 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.266811:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 26 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.266833:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.266838:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259680384:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.266840:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 18 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.266846:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259680512:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.266854:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92beb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065120.266857:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.267036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.267049:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260925184 00000100:00100000:3.0:1746065120.267052:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260925184 00000100:00100000:2.0:1746065120.267391:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260924928 00000100:00100000:3.0:1746065120.267791:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10460 00000100:00100000:3.0:1746065120.267797:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881260925184:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065120.267828:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.267843:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.267849:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9cd expref: 14 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.267855:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.267859:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.267861:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.267862:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.267882:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.267890:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 18 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.267898:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259680640:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.267934:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9cd expref: 14 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.267941:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9cd expref: 14 pid: 21235 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746065120.267947:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259680768:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.267963:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.267969:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 11 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.267975:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259680896:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.267984:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.268056:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10461 00000100:00100000:0.0:1746065120.268063:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260924928:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065120.268079:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.268089:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 12 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.268097:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d1 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.268103:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 26 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.268107:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.268109:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.268110:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.268125:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 26 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.268133:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 26 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.268142:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259681024:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065120.268169:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d1 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.268176:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d1 expref: 9 pid: 21235 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746065120.268245:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259681152:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065120.268275:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 12 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.268282:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 12 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.268289:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259681280:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.268304:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.271510:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260924288:12345-192.168.202.46@tcp:4:cat.0 Request processed in 8607us (10753us total) trans 17179872749 rc 0/0 00000100:00100000:2.0:1746065120.271519:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1483 00002000:00100000:2.0:1746065120.271529:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3538943) req@ffff88012b4b0e00 x1830881260924288/t17179872749(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.271537:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0e00 with x1830881260924288 ext(3145728->3538943) 00010000:00010000:2.0:1746065120.271545:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 27 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.271556:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 27 pid: 9716 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746065120.271562:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b0e00 00000100:00100000:1.0:1746065120.278668:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259679232:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.278668:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259680128:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.278669:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259678976:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.278680:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259679104:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.278680:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259679488:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.278686:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259679616:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.278688:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259679360:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.278707:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.278708:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259680384:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.278712:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.278721:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.278730:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259679872:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.278737:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259680256:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.278743:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259680512:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.278745:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065120.278756:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.278778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.278792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.278841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.279111:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260926080 00000100:00100000:0.0:1746065120.279111:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260925568 00000100:00100000:3.0:1746065120.279116:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260926080 00000100:00100000:0.0:1746065120.279116:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260925568 00010000:00010000:3.0:1746065120.279146:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9a3 expref: 15 pid: 4545 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.279152:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260925952 00000100:00100000:2.0:1746065120.279155:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260925952 00000100:00100000:3.0:1746065120.279166:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260926336 00010000:00010000:0.0:1746065120.279178:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 12 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.279197:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5192 00000100:00100000:0.0:1746065120.279203:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1959:x1830881260926080:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.279218:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.279239:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9a3 expref: 15 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.279248:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9a3 expref: 15 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.279266:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4f265e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9a3 expref: 15 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.279290:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065120.279322:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881260926080:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 118us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.279329:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5192 00000100:00100000:0.0:1746065120.279343:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5193 00000100:00100000:0.0:1746065120.279347:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881260925568:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.279353:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.279373:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 12 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.279380:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 12 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.279390:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c5ec00/0x14b4f8542d4f23d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ea expref: 12 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.279400:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065120.279414:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881260925568:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.279418:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5193 00000100:00100000:0.0:1746065120.279481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.279492:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260925440 00000100:00100000:0.0:1746065120.279494:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260925440 00010000:00010000:0.0:1746065120.279504:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ca expref: 14 pid: 8429 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746065120.279513:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5194 00000100:00100000:0.0:1746065120.279517:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260925440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.279522:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.279528:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ca expref: 14 pid: 8429 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.279534:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ca expref: 14 pid: 8429 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.279548:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8e600/0x14b4f8542d4f2515 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8ca expref: 14 pid: 8429 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.279563:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065120.279576:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881260925440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.279580:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5194 00010000:00010000:2.0:1746065120.279641:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 27 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.279662:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5195 00000100:00100000:2.0:1746065120.279672:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881260925952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.279679:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.279690:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 27 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.279702:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 27 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.279713:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4f25cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a93a expref: 27 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.279724:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.279737:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260925952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.279741:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5195 00000100:00100000:0.0:1746065120.279788:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.279797:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260925824 00000100:00100000:0.0:1746065120.279799:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260925824 00010000:00010000:0.0:1746065120.279809:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a956 expref: 13 pid: 9716 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746065120.279845:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5196 00000100:00100000:0.0:1746065120.279850:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881260925824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.279855:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.279862:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a956 expref: 13 pid: 9716 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.279869:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a956 expref: 13 pid: 9716 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746065120.279897:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260926336 00010000:00010000:3.0:1746065120.279908:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 26 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.279922:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5197 00000100:00100000:3.0:1746065120.279926:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260926336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.279932:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.279940:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 26 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.279940:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58fe600/0x14b4f8542d4f2603 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a956 expref: 13 pid: 9716 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746065120.279946:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 26 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.279949:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065120.279962:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f261f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a972 expref: 26 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.279962:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260925824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 113us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.279966:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5196 00010000:00010000:3.0:1746065120.279980:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.279995:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881260926336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.280000:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5197 00000100:00100000:3.0:1746065120.280028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.280039:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.280039:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260926464 00000100:00100000:2.0:1746065120.280043:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260926464 00010000:00010000:2.0:1746065120.280053:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 19 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.280055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.280065:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260926592 00000100:00100000:3.0:1746065120.280066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.280067:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260926592 00000100:00100000:3.0:1746065120.280074:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260925312 00010000:00010000:2.0:1746065120.280074:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a96b expref: 11 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.280076:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260925312 00000100:00100000:2.0:1746065120.280082:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260925696 00000100:00100000:2.0:1746065120.280083:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260925696 00010000:00010000:3.0:1746065120.280084:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a99c expref: 10 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.280091:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 20 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.280093:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5198 00000100:00100000:3.0:1746065120.280097:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881260926464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065120.280100:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5199 00010000:00010000:3.0:1746065120.280102:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065120.280104:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881260926592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.280109:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 20 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.280110:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.280115:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 20 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.280121:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a96b expref: 11 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.280155:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5200 00000100:00100000:0.0:1746065120.280160:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260925312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.280165:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.280172:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a99c expref: 10 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.280180:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a99c expref: 10 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.280190:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5c00/0x14b4f8542d4f2665 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a99c expref: 10 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.280197:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.280198:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.280201:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.280208:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.280222:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065120.280236:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260925312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.280241:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5200 00000100:00100000:1.0:1746065120.280246:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5201 00000100:00100000:1.0:1746065120.280252:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881260925696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.280255:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280260:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.280262:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280267:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 20 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.280275:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 20 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.280277:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.280282:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280284:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d537600/0x14b4f8542d4f23cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7e3 expref: 20 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.280288:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.280293:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d501600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065120.280294:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.280295:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.280296:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280298:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.280301:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280303:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.280309:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280313:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065120.280314:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f26d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.280325:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260925696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.280329:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5201 00010000:00010000:1.0:1746065120.280342:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.280347:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260924544:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 13935us (14204us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065120.280348:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.280353:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10456 00010000:00010000:1.0:1746065120.280366:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280371:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280376:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280381:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be8b600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065120.280383:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280388:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280396:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.280401:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4f26dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.280430:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260924800:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 13918us (14254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.280435:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10457 00000100:00100000:1.0:1746065120.280476:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.280486:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260926208 00000100:00100000:1.0:1746065120.280489:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260926208 00010000:00010000:1.0:1746065120.280499:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.280522:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f25d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a941 expref: 18 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.280528:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a96b expref: 11 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.280536:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065120.280541:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4f2618 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a96b expref: 11 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.280546:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881260926464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 448us (518us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065120.280549:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065120.280550:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5198 00010000:00010000:2.0:1746065120.280551:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.280553:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.280559:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.280571:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.280583:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1959:x1830881260926592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 478us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.280586:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259680640:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.280588:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5199 00000100:00100000:3.0:1746065120.280606:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259680768:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.280633:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259680896:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.280651:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.281184:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5202 00000100:00100000:1.0:1746065120.281189:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260926208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.281196:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.281205:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.281212:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.281222:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4f262d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a980 expref: 12 pid: 21235 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.281230:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.281242:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881260926208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.281246:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5202 00000100:00100000:0.0:1746065120.282134:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259681024:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.282143:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259681152:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.282150:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259681280:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065120.282170:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.282185:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.282191:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.282207:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.282213:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.282218:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.282222:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be8aa00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065120.282225:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.282234:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.282243:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.282248:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be8aa00/0x14b4f8542d4f26ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.282297:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260924672:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 15596us (16095us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.282303:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10459 00000100:00100000:1.0:1746065120.282391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.282426:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260926848 00000100:00100000:2.0:1746065120.282431:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260926848 00010000:00010000:2.0:1746065120.282445:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 17 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.282450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.282470:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260926720 00000100:00100000:2.0:1746065120.282472:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260926720 00010000:00010000:2.0:1746065120.282481:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9cd expref: 11 pid: 21235 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.282493:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5203 00000100:00100000:2.0:1746065120.282497:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881260926848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.282503:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.282513:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 17 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.282520:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 17 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.282531:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f2657 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a995 expref: 17 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.282539:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.282556:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881260926848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.282560:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5203 00000100:00100000:2.0:1746065120.282569:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5204 00000100:00100000:2.0:1746065120.282574:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260926720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.282581:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.282588:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9cd expref: 11 pid: 21235 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.282595:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9cd expref: 11 pid: 21235 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.282605:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58fe200/0x14b4f8542d4f26a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9cd expref: 11 pid: 21235 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.282615:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.282627:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260926720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.282632:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5204 00000100:00100000:1.0:1746065120.283058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.283319:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260927104 00000100:00100000:0.0:1746065120.283323:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260927104 00010000:00010000:0.0:1746065120.283336:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 10 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.283342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.283421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.283745:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260926976 00000100:00100000:0.0:1746065120.283748:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260926976 00000100:00100000:1.0:1746065120.283759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065120.283761:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d1 expref: 8 pid: 21235 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746065120.283772:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260927232 00000100:00100000:0.0:1746065120.283773:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260927232 00000100:00100000:1.0:1746065120.283778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065120.283781:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 25 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.283792:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260927360 00000100:00100000:0.0:1746065120.283793:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260927360 00010000:00010000:0.0:1746065120.283799:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 26 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.283807:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260927488 00000100:00100000:0.0:1746065120.283808:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260927488 00010000:00010000:0.0:1746065120.283832:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 11 pid: 4545 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.284126:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5205 00000100:00100000:0.0:1746065120.284132:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:1959:x1830881260927104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.284141:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065120.284151:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5206 00010000:00010000:0.0:1746065120.284154:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 10 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.284158:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260926976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.284162:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 10 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.284168:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.284175:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01b4a00/0x14b4f8542d4f2634 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a987 expref: 10 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.284184:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d1 expref: 8 pid: 21235 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.284186:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.284187:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.284191:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284196:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d1 expref: 8 pid: 21235 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.284202:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284206:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89400/0x14b4f8542d4f2500 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8d1 expref: 8 pid: 21235 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746065120.284215:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065120.284218:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.284243:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260926976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.284248:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5206 00000100:00100000:2.0:1746065120.284261:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5207 00000100:00100000:2.0:1746065120.284266:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260927232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.284273:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.284282:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 26 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.284289:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 26 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.284300:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a979 expref: 26 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.284311:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.284313:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.284317:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 11 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.284323:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 11 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.284329:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.284330:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.284333:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.284338:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.284373:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.284383:0:7078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 25 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.284392:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259681408:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065120.284435:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:1959:x1830881260927104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 302us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.284529:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5208 00000100:00100000:3.0:1746065120.284536:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881260927360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.284542:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.284549:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 25 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.284556:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 25 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.284566:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d536a00/0x14b4f8542d4f23ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7ff expref: 25 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.284576:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.284595:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881260927360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.284601:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5208 00000100:00100000:3.0:1746065120.284614:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5209 00000100:00100000:3.0:1746065120.284618:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881260927488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.284624:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.284629:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 11 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.284636:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 11 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.284645:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f23e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f8 expref: 11 pid: 4545 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.284652:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.284653:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.284655:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284660:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284673:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.284685:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881260927488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.284689:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5209 00010000:00010000:3.0:1746065120.284741:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284748:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284765:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284771:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284778:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284783:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53cfe00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065120.284786:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284793:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284802:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.284811:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53cfe00/0x14b4f8542d4f26f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.284855:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5205 00000100:00100000:3.0:1746065120.284861:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260925184:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 17065us (17825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.284866:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10460 00010000:00010000:1.0:1746065120.284925:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.284931:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.284944:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.284948:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.284953:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.284958:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a5800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065120.284960:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.284966:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.284977:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.284982:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5800/0x14b4f8542d4f26f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.285008:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260924928:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 16947us (18797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.285014:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10461 00010000:00010000:2.0:1746065120.285037:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 9 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.285051:0:7078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 9 pid: 21998 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.285058:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259681536:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.285089:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.287162:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259681408:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.287172:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259681536:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065120.287185:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.287724:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260927232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3455us (4299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.287733:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5207 00000100:00100000:0.0:1746065120.290770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.290862:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260927744 00000100:00100000:2.0:1746065120.290871:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260927744 00002000:00100000:2.0:1746065120.290906:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88012b4b2680 x1830881260927744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.290915:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b2680 with x1830881260927744 ext(4194304->4976639) 00010000:00010000:2.0:1746065120.290922:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 23 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.290933:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 23 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746065120.290939:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b2680 00000100:00100000:0.0:1746065120.291174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.291633:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260928000 00000100:00100000:2.0:1746065120.291637:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260928000 00002000:00100000:2.0:1746065120.291652:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012b4b0700 x1830881260928000/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.291658:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0700 with x1830881260928000 ext(3145728->4194303) 00010000:00010000:2.0:1746065120.291662:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 10 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.291668:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 10 pid: 21998 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746065120.291673:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b0700 00000100:00100000:2.0:1746065120.291689:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1484 00000100:00100000:2.0:1746065120.291696:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260927744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065120.292156:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1485 00000100:00100000:3.0:1746065120.292163:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260928000:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.298645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.299395:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260928256 00000100:00100000:2.0:1746065120.299403:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260928256 00000100:00100000:2.0:1746065120.299443:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8967 00000100:00100000:2.0:1746065120.299450:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:28868:x1830881260928256:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065120.299469:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065120.299878:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260928000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7715us (8704us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.299886:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1485 00002000:00100000:3.0:1746065120.299894:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012b4b0700 x1830881260928000/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.299902:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0700 with x1830881260928000 ext(3145728->4194303) 00010000:00010000:3.0:1746065120.299909:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 10 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.299920:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 10 pid: 21998 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746065120.299925:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b0700 00010000:00010000:2.0:1746065120.299985:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c800/0x14b4f8542d4f26ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9f0 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.300059:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065120.300071:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9bf expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.300077:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e2 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.300082:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065120.300107:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e2 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.300115:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e2 expref: 11 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.300137:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259681664:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.300203:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9bf expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.300210:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9bf expref: 11 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.300218:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259681792:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.300240:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.300548:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260927744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8853us (9784us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746065120.300554:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1484 00002000:00100000:2.0:1746065120.300559:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88012b4b2680 x1830881260927744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.300565:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b2680 with x1830881260927744 ext(4194304->4976639) 00010000:00010000:2.0:1746065120.300570:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 23 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.300577:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 23 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746065120.300581:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b2680 00000100:00100000:0.0:1746065120.303036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.303244:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259681664:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.303254:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259681792:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.303274:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065120.303343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.303795:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260928384 00000100:00100000:3.0:1746065120.303801:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260928384 00000100:00100000:1.0:1746065120.303846:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260928512 00000100:00100000:1.0:1746065120.303849:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260928512 00010000:00010000:3.0:1746065120.303852:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e2 expref: 12 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.303860:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9bf expref: 13 pid: 14644 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.303877:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5210 00000100:00100000:3.0:1746065120.303884:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1958:x1830881260928384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.303894:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.303898:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e2 expref: 13 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.303906:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e2 expref: 13 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.303923:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4f26c0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e2 expref: 13 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.303945:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.303949:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065120.303955:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065120.303960:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.303989:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1958:x1830881260928384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 105us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.303995:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5210 00000100:00100000:3.0:1746065120.304007:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5211 00000100:00100000:3.0:1746065120.304012:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260928512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.304018:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.304027:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9bf expref: 11 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.304033:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9bf expref: 11 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.304042:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5575800/0x14b4f8542d4f2696 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9bf expref: 11 pid: 14644 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.304050:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.304053:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065120.304059:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065120.304064:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065120.304082:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.304096:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260928512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (754us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065120.304099:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065120.304101:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5211 00010000:00010000:2.0:1746065120.304106:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065120.304122:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065120.304880:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c800/0x14b4f8542d4f26ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f0 expref: 19 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.304906:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f0 expref: 18 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.304915:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065120.304920:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065120.304922:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35d600, rc 0) 00000100:00100000:2.0:1746065120.304951:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:28868:x1830881260928256:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5502us (6314us total) trans 8589943008 rc 0/0 00000100:00100000:2.0:1746065120.304960:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8967 00000100:00100000:0.0:1746065120.310946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.312136:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260928640 00000100:00100000:3.0:1746065120.312146:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260928640 00010000:00010000:3.0:1746065120.312181:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 10 pid: 21998 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.312207:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5212 00000100:00100000:3.0:1746065120.312214:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260928640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.312230:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.312249:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 10 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.312258:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 10 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.312275:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d501000/0x14b4f8542d4f26ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9d4 expref: 10 pid: 21998 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.312288:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.312381:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:1961:x1830881260928640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 166us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.312390:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5212 00000100:00100000:0.0:1746065120.313103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.313127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.313243:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260928768 00000100:00100000:1.0:1746065120.313247:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260928768 00000100:00100000:0.0:1746065120.313251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.313264:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260928896 00000100:00100000:1.0:1746065120.313265:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260928896 00000100:00100000:0.0:1746065120.313265:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260929024 00000100:00100000:0.0:1746065120.313268:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260929024 00000100:00100000:1.0:1746065120.313279:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10462 00000100:00100000:1.0:1746065120.313284:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+9:28864:x1830881260928768:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065120.313292:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10463 00010000:00010000:1.0:1746065120.313294:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065120.313297:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260928896:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.313305:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9f7 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.313305:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.313314:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5a9fe expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065120.313320:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6e1, atime: 0x6812d6e0, ctime: 0x6812d6e1, blocks: 0x102b 00002000:00010000:0.0:1746065120.313326:0:4544:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e1, atime: 0x6812d6e0, ctime: 0x6812d6e0, blocks: 0x7f1 00010000:00010000:1.0:1746065120.313330:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.313332:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.313335:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.313337:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.313338:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f7 expref: 10 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.313341:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9fe expref: 24 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.313349:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f7 expref: 10 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.313351:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9fe expref: 24 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.313365:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec32800, rc 0) 00010000:00010000:0.0:1746065120.313371:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b916000, rc 0) 00000100:00100000:1.0:1746065120.313389:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+10:28864:x1830881260928768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.313391:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260928896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.313394:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10462 00000100:00100000:0.0:1746065120.313397:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10463 00000100:00100000:1.0:1746065120.313407:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10464 00000100:00100000:1.0:1746065120.313411:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881260929024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.313417:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.313423:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa05 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.313428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065120.313432:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6e1, atime: 0x6812d6e0, ctime: 0x6812d6e0, blocks: 0x81d 00010000:00010000:1.0:1746065120.313440:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.313441:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.313445:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa05 expref: 17 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.313453:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa05 expref: 17 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065120.313453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065120.313459:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec33600, rc 0) 00000100:00100000:0.0:1746065120.313461:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260929152 00000100:00100000:0.0:1746065120.313463:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260929152 00000100:00100000:1.0:1746065120.313475:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260929024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.313477:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10465 00000100:00100000:1.0:1746065120.313480:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10464 00000100:00100000:0.0:1746065120.313481:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260929152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.313487:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.313494:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa0c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065120.313504:0:4544:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6df, atime: 0x6812d6df, ctime: 0x6812d6e0, blocks: 0x821 00010000:00010000:0.0:1746065120.313511:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.313512:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.313516:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa0c expref: 18 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.313525:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa0c expref: 18 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.313532:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b917800, rc 0) 00000100:00100000:0.0:1746065120.313545:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260929152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 63us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.313550:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10465 00000100:00100000:0.0:1746065120.313565:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260929408 00000100:00100000:0.0:1746065120.313567:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260929408 00010000:00010000:0.0:1746065120.313575:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 24 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746065120.313598:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5213 00000100:00100000:0.0:1746065120.313603:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260929408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.313608:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.313616:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 24 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.313702:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 24 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.313713:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be8bc00/0x14b4f8542d4f26ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4976639) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9e9 expref: 24 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746065120.313730:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.313731:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.313734:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.313746:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.313762:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065120.313773:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.313776:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881260929408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 173us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.313781:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5213 00010000:00010000:2.0:1746065120.313783:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.313802:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.313808:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.313809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065120.313834:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.313841:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d500c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065120.313844:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.313850:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.313859:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.313865:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4f26e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.313901:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881260925056:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 47225us (47711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.313907:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10458 00000100:00100000:2.0:1746065120.314392:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260929280 00000100:00100000:2.0:1746065120.314396:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260929280 00000100:00100000:0.0:1746065120.314407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.314421:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260929664 00000100:00100000:2.0:1746065120.314423:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260929664 00000100:00100000:2.0:1746065120.314436:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10466 00000100:00100000:2.0:1746065120.314441:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260929280:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065120.314442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065120.314447:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.314455:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa13 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065120.314466:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6df, atime: 0x6812d6df, ctime: 0x6812d6e0, blocks: 0x821 00010000:00010000:2.0:1746065120.314474:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.314475:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.314479:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa13 expref: 24 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.314487:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa13 expref: 24 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.314493:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f89a00, rc 0) 00000100:00100000:2.0:1746065120.314510:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260929280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 69us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.314515:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10466 00000100:00100000:2.0:1746065120.314525:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260929536 00000100:00100000:2.0:1746065120.314527:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260929536 00000100:00100000:2.0:1746065120.314539:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10467 00000100:00100000:2.0:1746065120.314544:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881260929664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.314549:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.314556:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa21 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.314565:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.314566:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.314570:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa21 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065120.314577:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10468 00010000:00010000:2.0:1746065120.314578:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa21 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.314584:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00e7800, rc 0) 00000100:00100000:1.0:1746065120.314584:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260929536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.314591:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065120.314598:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260929664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 54us (191us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065120.314599:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa1a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.314602:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10467 00002000:00010000:1.0:1746065120.314610:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 4974112, mtime: 0x6812d6e1, atime: 0x6812d6e1, ctime: 0x6812d6e1, blocks: 0x1643 00010000:00010000:1.0:1746065120.314618:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.314619:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.314624:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa1a expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.314633:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa1a expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.314644:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec33200, rc 0) 00000100:00100000:1.0:1746065120.314665:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881260929536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.314670:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10468 00000100:00100000:0.0:1746065120.318427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.318505:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260929920 00000100:00100000:2.0:1746065120.318512:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260929920 00002000:00100000:2.0:1746065120.318548:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012b4b0a80 x1830881260929920/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.318557:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0a80 with x1830881260929920 ext(3145728->4194303) 00002000:00010000:2.0:1746065120.318561:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4b0a80 00000100:00100000:2.0:1746065120.318587:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4786 00000100:00100000:2.0:1746065120.318593:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260929920:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.320870:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.320905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.321081:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260930432 00000100:00100000:2.0:1746065120.321089:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260930432 00000100:00100000:3.0:1746065120.321092:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260930176 00000100:00100000:3.0:1746065120.321096:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260930176 00002000:00100000:3.0:1746065120.321122:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4972544->4976639) req@ffff880095351880 x1830881260930176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065120.321125:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8968 00002000:00100000:3.0:1746065120.321131:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351880 with x1830881260930176 ext(4972544->4976639) 00000100:00100000:2.0:1746065120.321131:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28866:x1830881260930432:12345-192.168.202.46@tcp:36:lfs.0 00002000:00010000:3.0:1746065120.321136:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095351880 00000100:00100000:3.0:1746065120.321148:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4787 00000100:00100000:3.0:1746065120.321153:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881260930176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065120.321206:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28866:x1830881260930432:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 75us (300us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746065120.321211:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8968 00000100:00100000:3.0:1746065120.321260:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881260930176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 106us (396us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065120.321266:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4787 00002000:00100000:3.0:1746065120.321271:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4972544->4976639) req@ffff880095351880 x1830881260930176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.321278:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351880 with x1830881260930176 ext(4972544->4976639) 00002000:00010000:3.0:1746065120.321281:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095351880 00000100:00100000:2.0:1746065120.326253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.326280:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260930688 00000100:00100000:3.0:1746065120.326288:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260930688 00000100:00100000:3.0:1746065120.326322:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3646 00000100:00100000:3.0:1746065120.326330:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28866:x1830881260930688:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1746065120.326505:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28866:x1830881260930688:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 176us (260us total) trans 8589943009 rc 0/0 00000100:00100000:3.0:1746065120.326512:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3646 00000100:00100000:2.0:1746065120.329267:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260929920:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10665us (10838us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065120.329278:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4786 00002000:00100000:2.0:1746065120.329288:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012b4b0a80 x1830881260929920/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.329297:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0a80 with x1830881260929920 ext(3145728->4194303) 00002000:00010000:2.0:1746065120.329302:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4b0a80 00000100:00100000:0.0:1746065120.330421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.330472:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260930944 00000100:00100000:3.0:1746065120.330479:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260930944 00000100:00100000:3.0:1746065120.330514:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3647 00000100:00100000:3.0:1746065120.330520:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28860:x1830881260930944:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065120.330663:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:28860:x1830881260930944:12345-192.168.202.46@tcp:35:cat.0 Request processed in 142us (245us total) trans 8589943010 rc 0/0 00000100:00100000:3.0:1746065120.330669:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3647 00000100:00100000:0.0:1746065120.334417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.334535:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260931200 00000100:00100000:2.0:1746065120.334543:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260931200 00000100:00100000:2.0:1746065120.334585:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3648 00000100:00100000:2.0:1746065120.334591:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b878c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:28866:x1830881260931200:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:2.0:1746065120.334749:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b878c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28866:x1830881260931200:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 157us (338us total) trans 8589943011 rc 0/0 00000100:00100000:2.0:1746065120.334755:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3648 00000100:00100000:0.0:1746065120.338292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.338326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.338347:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260931328 00000100:00100000:1.0:1746065120.338366:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260931328 00000100:00100000:1.0:1746065120.338402:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260931456 00000100:00100000:1.0:1746065120.338404:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260931456 00000100:00100000:1.0:1746065120.338474:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10469 00000100:00100000:1.0:1746065120.338482:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:1961:x1830881260931328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.338499:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.338511:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa28 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.338513:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10470 00010000:00010000:1.0:1746065120.338530:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065120.338532:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260931456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.338532:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.338539:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa28 expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.338541:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.338550:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa2f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.338552:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa28 expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.338561:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5575800, rc 0) 00010000:00010000:2.0:1746065120.338563:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.338564:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.338569:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa2f expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.338579:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa2f expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.338585:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35c400, rc 0) 00000100:00100000:1.0:1746065120.338594:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881260931328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 113us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.338600:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10469 00000100:00100000:2.0:1746065120.338604:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260931456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.338609:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10470 00000100:00100000:3.0:1746065120.339144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.339170:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.339204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.339264:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260931584 00000100:00100000:0.0:1746065120.339268:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260931584 00000100:00100000:0.0:1746065120.339287:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260931712 00000100:00100000:0.0:1746065120.339289:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260931712 00000100:00100000:0.0:1746065120.339298:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260931840 00000100:00100000:0.0:1746065120.339299:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260931840 00000100:00100000:0.0:1746065120.339308:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10471 00000100:00100000:0.0:1746065120.339312:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260931584:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.339318:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.339325:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa36 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.339336:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.339337:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.339341:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.339349:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.339366:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596cc00, rc 0) 00000100:00100000:0.0:1746065120.339383:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260931584:12345-192.168.202.46@tcp:101:cat.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.339388:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10471 00000100:00100000:0.0:1746065120.339400:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10472 00000100:00100000:0.0:1746065120.339404:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260931712:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.339409:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.339414:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa3d expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.339421:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.339422:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.339425:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa3d expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.339432:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa3d expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.339442:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596d400, rc 0) 00000100:00100000:0.0:1746065120.339452:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260931712:12345-192.168.202.46@tcp:101:cat.0 Request processed in 48us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.339456:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10472 00000100:00100000:0.0:1746065120.339463:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10473 00000100:00100000:0.0:1746065120.339467:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260931840:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.339470:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.339474:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa44 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.339481:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.339482:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.339484:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa44 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.339491:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa44 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065120.339496:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596d200, rc 0) 00000100:00100000:0.0:1746065120.339504:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260931840:12345-192.168.202.46@tcp:101:cat.0 Request processed in 38us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.339508:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10473 00000100:00100000:0.0:1746065120.348576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.348776:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260932096 00000100:00100000:2.0:1746065120.348785:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260932096 00002000:00100000:2.0:1746065120.348850:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880095352680 x1830881260932096/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.348859:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352680 with x1830881260932096 ext(4194304->4976639) 00002000:00010000:2.0:1746065120.348864:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352680 00000100:00100000:2.0:1746065120.348886:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4788 00000100:00100000:2.0:1746065120.348894:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260932096:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065120.358711:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260932096:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9810us (10134us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746065120.358720:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4788 00002000:00100000:2.0:1746065120.358730:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880095352680 x1830881260932096/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.358738:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352680 with x1830881260932096 ext(4194304->4976639) 00002000:00010000:2.0:1746065120.358743:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352680 00000100:00100000:0.0:1746065120.418608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.418707:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260932224 00000100:00100000:1.0:1746065120.418716:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260932224 00000100:00100000:1.0:1746065120.418766:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10474 00000100:00100000:1.0:1746065120.418774:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:28868:x1830881260932224:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065120.418788:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.418803:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa4b expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.418865:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa1a expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.418884:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa44 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.418893:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.418895:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.418898:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2727936->3145727] (req 2727936->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.418926:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa44 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.418938:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa44 expref: 13 pid: 4545 timeout: 819 lvb_type: 1 00000100:00100000:1.0:1746065120.418949:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259681920:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.419043:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa1a expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.419051:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa1a expref: 24 pid: 8429 timeout: 819 lvb_type: 1 00000100:00100000:1.0:1746065120.419059:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259682048:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.419078:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.422459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.422490:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259681920:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.422504:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259682048:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.422531:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2727936->3145727] (req 2727936->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.422545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065120.422547:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5574800, rc 0) 00000100:00100000:1.0:1746065120.422589:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:28868:x1830881260932224:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3816us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.422597:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10474 00000100:00100000:2.0:1746065120.422671:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260932480 00000100:00100000:2.0:1746065120.422676:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260932480 00010000:00010000:2.0:1746065120.422698:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa1a expref: 25 pid: 8429 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.422879:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260932352 00000100:00100000:2.0:1746065120.422883:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260932352 00010000:00010000:2.0:1746065120.422893:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa44 expref: 13 pid: 4545 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.423085:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5214 00000100:00100000:2.0:1746065120.423092:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881260932480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.423103:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.423122:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa1a expref: 25 pid: 8429 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.423130:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa1a expref: 25 pid: 8429 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.423149:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f273e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa1a expref: 25 pid: 8429 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.423168:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.423185:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260932480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.423191:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5214 00000100:00100000:2.0:1746065120.423224:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5215 00000100:00100000:2.0:1746065120.423228:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1959:x1830881260932352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.423234:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.423240:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa44 expref: 13 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.423248:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa44 expref: 13 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.423258:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a596d200/0x14b4f8542d4f2761 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa44 expref: 13 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.423266:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.423268:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.423274:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.423280:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.423302:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.423312:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259682176:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.423346:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.424966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.425045:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259682176:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065120.425683:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260932736 00000100:00100000:3.0:1746065120.425689:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260932736 00010000:00010000:2.0:1746065120.425706:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065120.425726:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2727936->2732031) req@ffff880095352d80 x1830881260932736/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065120.425738:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1959:x1830881260932352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2508us (3192us total) trans 0 rc 0/0 00002000:00100000:3.0:1746065120.425745:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352d80 with x1830881260932736 ext(2727936->2732031) 00000100:00100000:2.0:1746065120.425745:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5215 00002000:00010000:3.0:1746065120.425748:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352d80 00000100:00100000:3.0:1746065120.425776:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4789 00000100:00100000:3.0:1746065120.425782:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260932736:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065120.425925:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260932736:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 142us (963us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065120.425930:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4789 00002000:00100000:3.0:1746065120.425935:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2727936->2732031) req@ffff880095352d80 x1830881260932736/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.425941:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352d80 with x1830881260932736 ext(2727936->2732031) 00002000:00010000:3.0:1746065120.425944:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352d80 00000100:00100000:0.0:1746065120.431282:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.431343:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260932864 00000100:00100000:1.0:1746065120.431351:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260932864 00000100:00100000:1.0:1746065120.431412:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10475 00000100:00100000:1.0:1746065120.431420:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:28868:x1830881260932864:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065120.431435:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.431450:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa52 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.431474:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.431482:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa21 expref: 18 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.431489:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.431491:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.431494:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->2461695] (req 2097152->2461695) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.431526:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa21 expref: 18 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.431537:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa21 expref: 18 pid: 8428 timeout: 819 lvb_type: 1 00000100:00100000:1.0:1746065120.431548:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259682304:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.431636:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.431644:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f7 expref: 13 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.431651:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259682432:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.431670:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.432673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.432839:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260933120 00000100:00100000:2.0:1746065120.432845:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260933120 00000100:00100000:2.0:1746065120.432874:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8969 00000100:00100000:2.0:1746065120.432879:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:28873:x1830881260933120:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065120.432894:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.432904:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4f2776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa59 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.432984:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.432993:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433002:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433011:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433016:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433021:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433105:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433112:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433117:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065120.433124:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065120.433188:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433193:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433198:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433202:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d501e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065120.433206:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433211:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433220:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065120.433223:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065120.433226:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.433233:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f277d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.434149:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.434157:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.434163:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.434167:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d501600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065120.434170:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.434175:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.434183:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205a00) 00010000:00010000:2.0:1746065120.434185:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065120.434188:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065120.434191:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501600/0x14b4f8542d4f2784 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065120.435078:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259682304:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.435213:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4f2776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa59 expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.435273:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa59 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.435280:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.435283:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065120.435284:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500000, rc 0) 00000100:00100000:3.0:1746065120.435326:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:28873:x1830881260933120:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2446us (2655us total) trans 8589943012 rc 0/0 00000100:00100000:3.0:1746065120.435333:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8969 00000100:00100000:1.0:1746065120.435571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.435632:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259682432:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065120.435654:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->2461695] (req 2097152->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.435664:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed70a00, rc 0) 00000100:00100000:0.0:1746065120.435686:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:28868:x1830881260932864:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4268us (4412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.435693:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10475 00000100:00100000:2.0:1746065120.435790:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260933248 00000100:00100000:2.0:1746065120.435795:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260933248 00000100:00100000:1.0:1746065120.435795:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065120.435812:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa21 expref: 19 pid: 8428 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.435850:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260933376 00000100:00100000:2.0:1746065120.435852:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260933376 00010000:00010000:2.0:1746065120.435861:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f7 expref: 13 pid: 9716 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746065120.435863:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5216 00000100:00100000:3.0:1746065120.435873:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260933248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065120.435880:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5217 00010000:00010000:3.0:1746065120.435884:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065120.435884:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881260933376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.435889:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.435899:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa21 expref: 19 pid: 8428 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.435899:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f7 expref: 13 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.435906:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f7 expref: 13 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.435972:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa21 expref: 19 pid: 8428 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.435986:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec32800/0x14b4f8542d4f2714 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f7 expref: 13 pid: 9716 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.435989:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00e7800/0x14b4f8542d4f2737 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa21 expref: 19 pid: 8428 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.435994:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.435995:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.436000:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.436054:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.436062:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065120.436078:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.436079:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881260933248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 207us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.436085:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5216 00000100:00100000:2.0:1746065120.436088:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259682560:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.436142:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.438093:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259682560:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065120.438107:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.438144:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260933376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2258us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.438152:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5217 00000100:00100000:0.0:1746065120.444487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.444857:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260933632 00000100:00100000:3.0:1746065120.444864:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260933632 00002000:00100000:3.0:1746065120.444896:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2457600->2461695) req@ffff88009c124380 x1830881260933632/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.444904:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124380 with x1830881260933632 ext(2457600->2461695) 00002000:00010000:3.0:1746065120.444909:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c124380 00000100:00100000:3.0:1746065120.444934:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4790 00000100:00100000:3.0:1746065120.444940:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260933632:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065120.445075:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260933632:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 135us (596us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065120.445084:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4790 00002000:00100000:3.0:1746065120.445089:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2457600->2461695) req@ffff88009c124380 x1830881260933632/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.445095:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124380 with x1830881260933632 ext(2457600->2461695) 00002000:00010000:3.0:1746065120.445098:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c124380 00000100:00100000:0.0:1746065120.505440:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.506247:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260933760 00000100:00100000:2.0:1746065120.506256:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260933760 00000100:00100000:2.0:1746065120.506610:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10476 00000100:00100000:2.0:1746065120.506619:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28873:x1830881260933760:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065120.506635:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.506650:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa60 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.506675:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9fe expref: 25 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.506684:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa28 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.506690:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.506691:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.506695:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [315392->1028095] (req 315392->1028095) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.506723:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa28 expref: 11 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.506733:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa28 expref: 11 pid: 4544 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.506744:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259682688:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.506850:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9fe expref: 25 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.506857:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9fe expref: 25 pid: 4544 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.506864:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259682816:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.506888:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.508495:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259682688:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.508504:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259682816:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.508524:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [315392->1028095] (req 315392->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.508536:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500400, rc 0) 00000100:00100000:2.0:1746065120.508575:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:28873:x1830881260933760:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1956us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.508584:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10476 00000100:00100000:0.0:1746065120.509330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.509454:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.509510:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260933888 00000100:00100000:2.0:1746065120.509510:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260934016 00000100:00100000:3.0:1746065120.509514:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260933888 00000100:00100000:2.0:1746065120.509514:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260934016 00010000:00010000:3.0:1746065120.509534:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa28 expref: 12 pid: 4544 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.509534:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9fe expref: 25 pid: 4544 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746065120.509552:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5218 00000100:00100000:3.0:1746065120.509558:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260933888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.509567:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.509585:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa28 expref: 12 pid: 4544 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746065120.509594:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa28 expref: 12 pid: 4544 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.509609:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5219 00010000:00010000:3.0:1746065120.509611:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f2745 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa28 expref: 12 pid: 4544 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.509614:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260934016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.509621:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.509624:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065120.509628:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9fe expref: 25 pid: 4544 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746065120.509635:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9fe expref: 25 pid: 4544 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746065120.509642:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260933888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (313us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065120.509645:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b916000/0x14b4f8542d4f271b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9fe expref: 25 pid: 4544 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746065120.509649:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5218 00010000:00010000:2.0:1746065120.509656:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.509658:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.509663:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.509670:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.509690:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.509700:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259682944:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.509733:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.518372:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259682944:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065120.518391:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.518443:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260934016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8828us (8988us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.518453:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5219 00000100:00100000:1.0:1746065120.518508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.518616:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260934272 00000100:00100000:0.0:1746065120.518623:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260934272 00002000:00100000:0.0:1746065120.518654:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (315392->319487) req@ffff88009a4e8000 x1830881260934272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.518663:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8000 with x1830881260934272 ext(315392->319487) 00002000:00010000:0.0:1746065120.518667:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e8000 00000100:00100000:0.0:1746065120.519379:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4791 00000100:00100000:0.0:1746065120.519387:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260934272:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065120.519529:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260934272:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 143us (1021us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065120.519538:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4791 00002000:00100000:0.0:1746065120.519543:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (315392->319487) req@ffff88009a4e8000 x1830881260934272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.519550:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8000 with x1830881260934272 ext(315392->319487) 00002000:00010000:0.0:1746065120.519553:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e8000 00000100:00100000:0.0:1746065120.535297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.535376:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260934528 00000100:00100000:3.0:1746065120.535383:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260934528 00002000:00100000:3.0:1746065120.535420:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (1024000->1028095) req@ffff88009c127800 x1830881260934528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.535428:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c127800 with x1830881260934528 ext(1024000->1028095) 00002000:00010000:3.0:1746065120.535433:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c127800 00000100:00100000:3.0:1746065120.535449:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4792 00000100:00100000:3.0:1746065120.535456:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260934528:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065120.535700:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260934528:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 242us (409us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065120.535706:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4792 00002000:00100000:3.0:1746065120.535711:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (1024000->1028095) req@ffff88009c127800 x1830881260934528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.535717:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c127800 with x1830881260934528 ext(1024000->1028095) 00002000:00010000:3.0:1746065120.535719:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c127800 00000100:00100000:0.0:1746065120.545225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.545397:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260934784 00000100:00100000:3.0:1746065120.545404:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260934784 00000100:00100000:3.0:1746065120.545448:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3649 00000100:00100000:3.0:1746065120.545454:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:28873:x1830881260934784:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065120.547173:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:28873:x1830881260934784:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1713us (1950us total) trans 8589943013 rc 0/0 00000100:00100000:3.0:1746065120.547346:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3649 00000100:00100000:0.0:1746065120.570975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.572515:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260935040 00000100:00100000:3.0:1746065120.572525:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260935040 00000100:00100000:3.0:1746065120.572571:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8970 00000100:00100000:3.0:1746065120.572579:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:28879:x1830881260935040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.572601:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.572617:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562200/0x14b4f8542d4f27a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa67 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.572704:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572715:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572724:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572734:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572739:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572743:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572863:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562e00/0x14b4f8542d4f27b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572871:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562e00/0x14b4f8542d4f27b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572877:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562e00/0x14b4f8542d4f27b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065120.572885:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065120.572947:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572952:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572957:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572961:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5562000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065120.572965:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572969:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572978:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065120.572980:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065120.572983:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.572988:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562000/0x14b4f8542d4f27a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.574313:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.574322:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.574326:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.574334:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5563800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065120.574336:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.574341:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.574349:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669500) 00010000:00010000:3.0:1746065120.574351:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065120.574362:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.574367:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5563800/0x14b4f8542d4f27ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.574404:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562200/0x14b4f8542d4f27a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa67 expref: 261 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.574414:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562e00/0x14b4f8542d4f27b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa67 expref: 260 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.574419:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.574421:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065120.574423:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5562e00, rc 0) 00000100:00100000:3.0:1746065120.574834:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:28879:x1830881260935040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2253us (3864us total) trans 8589943014 rc 0/0 00000100:00100000:3.0:1746065120.574841:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8970 00000100:00100000:0.0:1746065120.581275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.582405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.582435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.582774:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260935168 00000100:00100000:2.0:1746065120.582782:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260935168 00000100:00100000:2.0:1746065120.582837:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 619 00000100:00100000:2.0:1746065120.582845:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1959:x1830881260935168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.582857:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.582877:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5562e00/0x14b4f8542d4f27b5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa67 expref: 260 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.582895:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065120.582900:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.582935:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1959:x1830881260935168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.582940:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 619 00000100:00100000:3.0:1746065120.583153:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260935296 00000100:00100000:3.0:1746065120.583156:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260935296 00000100:00100000:3.0:1746065120.583186:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260935424 00000100:00100000:3.0:1746065120.583188:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260935424 00000100:00100000:3.0:1746065120.583202:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10477 00000100:00100000:3.0:1746065120.583207:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260935296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.583218:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.583229:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4f27c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa6e expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.583266:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259683072:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065120.583322:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.583341:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10478 00000100:00100000:3.0:1746065120.583345:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881260935424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.583360:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.583369:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f27ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa75 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.583390:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259683200:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065120.583408:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.589394:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259683072:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065120.589424:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4f27c3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa6e expref: 25 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.589435:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4f27c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa6e expref: 25 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.593606:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5563800, rc 0) 00002000:00010000:2.0:1746065120.594145:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065120 -> 1746065121 00000100:00100000:2.0:1746065120.594167:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259683200:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065120.594191:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f27ca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa75 expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.594207:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f27ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa75 expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.594226:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8de800, rc 0) 00000100:00100000:2.0:1746065120.594244:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881260935424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10898us (11807us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.594250:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10478 00000100:00100000:3.0:1746065120.594684:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260935296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11475us (12278us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065120.594689:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10477 00000100:00100000:0.0:1746065120.603490:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.603527:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.603567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.603641:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260935936 00000100:00100000:1.0:1746065120.603648:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260935936 00002000:00100000:1.0:1746065120.603685:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094d94e00 x1830881260935936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.603695:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94e00 with x1830881260935936 ext(1048576->2097151) 00002000:00010000:1.0:1746065120.603699:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94e00 00000100:00100000:1.0:1746065120.603715:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260935808 00000100:00100000:1.0:1746065120.603717:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260935808 00002000:00100000:1.0:1746065120.603727:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880094d95880 x1830881260935808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.603732:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95880 with x1830881260935808 ext(1048576->2097151) 00002000:00010000:1.0:1746065120.603735:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95880 00000100:00100000:1.0:1746065120.603742:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260936192 00000100:00100000:1.0:1746065120.603744:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260936192 00002000:00100000:1.0:1746065120.603754:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094d95c00 x1830881260936192/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 504/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.603760:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95c00 with x1830881260936192 ext(0->1048575) 00002000:00010000:1.0:1746065120.603763:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95c00 00000100:00100000:1.0:1746065120.603780:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4793 00000100:00100000:1.0:1746065120.603786:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881260935936:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065120.604955:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4794 00000100:00100000:1.0:1746065120.604963:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881260935808:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065120.617315:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4795 00000100:00100000:1.0:1746065120.617328:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260936192:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065120.618648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.618766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.618794:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260936576 00000100:00100000:0.0:1746065120.618801:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260936576 00000100:00100000:3.0:1746065120.618952:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260936320 00000100:00100000:3.0:1746065120.618957:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260936320 00002000:00100000:3.0:1746065120.618981:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a5880700 x1830881260936320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.618995:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880700 with x1830881260936320 ext(1048576->2097151) 00002000:00010000:3.0:1746065120.619000:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5880700 00000100:00100000:0.0:1746065120.619004:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10479 00000100:00100000:0.0:1746065120.619011:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881260936576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.619022:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065120.619023:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4796 00000100:00100000:3.0:1746065120.619028:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260936320:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:0.0:1746065120.619034:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f27d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa7c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.619072:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259683328:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065120.619121:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065120.623074:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881260935936:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19281us (19583us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065120.623083:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4793 00002000:00100000:1.0:1746065120.623093:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094d94e00 x1830881260935936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.623101:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94e00 with x1830881260935936 ext(1048576->2097151) 00002000:00010000:1.0:1746065120.623105:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94e00 00000100:00100000:2.0:1746065120.631920:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260936192:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14589us (28345us total) trans 0 rc 335872/335872 00000100:00100000:2.0:1746065120.631930:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4795 00002000:00100000:2.0:1746065120.631940:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094d95c00 x1830881260936192/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 504/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 335872/335872 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.631949:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95c00 with x1830881260936192 ext(0->1048575) 00002000:00010000:2.0:1746065120.631954:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95c00 00000100:00100000:1.0:1746065120.632342:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260935808:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27379us (28812us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065120.632349:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4794 00002000:00100000:1.0:1746065120.632367:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880094d95880 x1830881260935808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.632374:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95880 with x1830881260935808 ext(1048576->2097151) 00002000:00010000:1.0:1746065120.632377:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95880 00002000:00010000:1.0:1746065120.632763:0:4544:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime: 1746065120 -> 1746065121 00002000:00010000:1.0:1746065120.632766:0:4544:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime: 1746065120 -> 1746065121 00000100:00100000:1.0:1746065120.632780:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259683328:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065120.633180:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260936320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14150us (14533us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.633187:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4796 00002000:00100000:3.0:1746065120.633193:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a5880700 x1830881260936320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.633202:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880700 with x1830881260936320 ext(1048576->2097151) 00002000:00010000:3.0:1746065120.633205:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5880700 00010000:00010000:1.0:1746065120.633394:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f27d1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa7c expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.633406:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5575800/0x14b4f8542d4f27d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa7c expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.633426:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5575800, rc 0) 00000100:00100000:1.0:1746065120.634103:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881260936576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 15090us (15336us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065120.634110:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10479 00000100:00100000:0.0:1746065120.641036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.641101:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260936704 00000100:00100000:1.0:1746065120.641111:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260936704 00000100:00100000:1.0:1746065120.641161:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10480 00000100:00100000:1.0:1746065120.641169:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:28885:x1830881260936704:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065120.641184:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.641199:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa83 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.641223:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.641229:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.641231:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065120.641234:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.641257:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.641267:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 23 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.641278:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259683456:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.641351:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.641464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.641529:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260936832 00000100:00100000:3.0:1746065120.641533:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260936832 00000100:00100000:3.0:1746065120.641557:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10481 00000100:00100000:3.0:1746065120.641563:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881260936832:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.641569:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.641577:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8de800/0x14b4f8542d4f27df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa8a expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.641605:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259683584:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065120.641625:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.641751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.642140:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260936960 00000100:00100000:3.0:1746065120.642143:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260936960 00000100:00100000:3.0:1746065120.642169:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10482 00000100:00100000:3.0:1746065120.642174:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881260936960:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.642180:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.642189:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927da800/0x14b4f8542d4f27e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa91 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.642210:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259683712:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065120.642256:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.643846:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259683584:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065120.643873:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8de800/0x14b4f8542d4f27df lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa8a expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.643885:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8de800/0x14b4f8542d4f27df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa8a expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.643908:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8de800, rc 0) 00000100:00100000:3.0:1746065120.643941:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881260936832:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2378us (2477us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065120.643947:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10481 00000100:00100000:1.0:1746065120.644016:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259683456:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.644031:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.644045:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c775a00, rc 0) 00000100:00100000:1.0:1746065120.644061:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:28885:x1830881260936704:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2893us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.644066:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10480 00000100:00100000:0.0:1746065120.644365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.644589:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259683712:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065120.644597:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260937088 00000100:00100000:3.0:1746065120.644603:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260937088 00010000:00010000:2.0:1746065120.644605:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927da800/0x14b4f8542d4f27e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa91 expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.644614:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927da800/0x14b4f8542d4f27e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa91 expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.644629:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da800, rc 0) 00002000:00100000:3.0:1746065120.644631:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (315392->1028095) req@ffff880094d95500 x1830881260937088/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.644640:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95500 with x1830881260937088 ext(315392->1028095) 00010000:00010000:3.0:1746065120.644646:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 24 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.644648:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881260936960:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2474us (2897us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.644653:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10482 00010000:00010000:3.0:1746065120.644656:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 24 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746065120.644661:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d95500 00000100:00100000:3.0:1746065120.644675:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1486 00000100:00100000:3.0:1746065120.645104:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881260937088:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065120.650582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.650659:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260937216 00000100:00100000:2.0:1746065120.650668:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260937216 00000100:00100000:2.0:1746065120.650717:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10483 00000100:00100000:2.0:1746065120.650725:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:28879:x1830881260937216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.650739:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.650754:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa98 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.650776:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 11 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.650783:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065120.650784:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065120.650787:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.650810:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 11 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.650838:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 11 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.650852:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259683840:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.650918:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.673241:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881260937088:12345-192.168.202.46@tcp:4:cat.0 Request processed in 28552us (28879us total) trans 17179872750 rc 0/0 00000100:00100000:3.0:1746065120.673252:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1486 00002000:00100000:3.0:1746065120.673261:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (315392->1028095) req@ffff880094d95500 x1830881260937088/t17179872750(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.673270:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95500 with x1830881260937088 ext(315392->1028095) 00010000:00010000:3.0:1746065120.673279:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 28 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.673291:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 28 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746065120.673296:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d95500 00000100:00100000:2.0:1746065120.674629:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259683840:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.674649:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.674662:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336aa00, rc 0) 00000100:00100000:2.0:1746065120.674700:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:28879:x1830881260937216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 23975us (24125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.674706:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10483 00000100:00100000:0.0:1746065120.676499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.676539:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260937344 00000100:00100000:3.0:1746065120.676545:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260937344 00002000:00100000:3.0:1746065120.676574:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2727936->3145727) req@ffff880094d96d80 x1830881260937344/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.676583:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96d80 with x1830881260937344 ext(2727936->3145727) 00010000:00010000:3.0:1746065120.676590:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 12 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746065120.676599:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 12 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746065120.676605:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d96d80 00000100:00100000:3.0:1746065120.677667:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1487 00000100:00100000:3.0:1746065120.677677:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881260937344:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065120.678835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.681477:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260937472 00000100:00100000:1.0:1746065120.681486:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260937472 00010000:00010000:1.0:1746065120.681518:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 27 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746065120.681549:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5220 00000100:00100000:1.0:1746065120.681557:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881260937472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.681567:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.681584:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 27 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.681594:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 27 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.681613:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4f2799 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 315392->1028095) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa60 expref: 27 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.681627:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.681629:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.681634:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.681646:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.681674:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.681684:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259683968:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065120.681752:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.688745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.689647:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260937728 00000100:00100000:3.0:1746065120.689654:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260937728 00000100:00100000:3.0:1746065120.689696:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8971 00000100:00100000:3.0:1746065120.689703:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:28887:x1830881260937728:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065120.689720:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.689734:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f27f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aa9f expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.689807:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.689835:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.689847:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.689859:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.689864:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.689868:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.689948:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f2809 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.689955:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f2809 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.689960:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f2809 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065120.689966:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000100:00100000:1.0:1746065120.689983:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259683968:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065120.689999:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.690034:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260937472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8477us (11199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.690042:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5220 00010000:00010000:3.0:1746065120.690158:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690164:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690169:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690175:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b7d600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065120.690178:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690184:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690198:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065120.690201:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065120.690204:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690209:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f27fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690222:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690227:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690231:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690235:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b7c800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065120.690237:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690242:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690248:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669500) 00010000:00010000:3.0:1746065120.690249:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065120.690252:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690256:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f2802 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.690285:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f27f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa9f expref: 262 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.690295:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f2809 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa9f expref: 261 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.690659:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.690662:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065120.690665:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7ce00, rc 0) 00000100:00100000:3.0:1746065120.690792:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:28887:x1830881260937728:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1089us (2054us total) trans 8589943015 rc 0/0 00000100:00100000:3.0:1746065120.690798:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8971 00000100:00100000:0.0:1746065120.693013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.693037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.693062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.693091:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.693213:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260937984 00000100:00100000:2.0:1746065120.693220:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260937984 00002000:00100000:2.0:1746065120.693256:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094d94a80 x1830881260937984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.693265:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94a80 with x1830881260937984 ext(0->1048575) 00002000:00010000:2.0:1746065120.693269:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d94a80 00000100:00100000:2.0:1746065120.693282:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260938240 00000100:00100000:2.0:1746065120.693285:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260938240 00002000:00100000:2.0:1746065120.693296:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880094d94700 x1830881260938240/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.693302:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94700 with x1830881260938240 ext(1048576->2097151) 00002000:00010000:2.0:1746065120.693306:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94700 00000100:00100000:2.0:1746065120.693320:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260938496 00000100:00100000:2.0:1746065120.693322:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260938496 00002000:00100000:2.0:1746065120.693332:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094d97800 x1830881260938496/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.693339:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97800 with x1830881260938496 ext(1048576->2097151) 00002000:00010000:2.0:1746065120.693341:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97800 00000100:00100000:2.0:1746065120.693349:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260938752 00000100:00100000:2.0:1746065120.693350:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260938752 00002000:00100000:2.0:1746065120.693368:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d95f80 x1830881260938752/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.693373:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95f80 with x1830881260938752 ext(1048576->2097151) 00002000:00010000:2.0:1746065120.693376:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95f80 00000100:00100000:2.0:1746065120.693386:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4797 00000100:00100000:2.0:1746065120.693392:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260937984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065120.693599:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4798 00000100:00100000:3.0:1746065120.693606:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881260938240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.693711:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4799 00000100:00100000:0.0:1746065120.693717:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881260938496:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065120.694005:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4800 00000100:00100000:1.0:1746065120.694014:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260938752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065120.694417:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881260937344:12345-192.168.202.46@tcp:4:cat.0 Request processed in 16740us (17920us total) trans 17179872751 rc 0/0 00000100:00100000:1.0:1746065120.694424:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1487 00002000:00100000:1.0:1746065120.694429:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2727936->3145727) req@ffff880094d96d80 x1830881260937344/t17179872751(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.694435:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96d80 with x1830881260937344 ext(2727936->3145727) 00010000:00010000:1.0:1746065120.694441:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 16 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746065120.694457:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 16 pid: 4544 timeout: 819 lvb_type: 0 00002000:00010000:1.0:1746065120.694462:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d96d80 00000100:00100000:0.0:1746065120.695390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.695680:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260938880 00000100:00100000:1.0:1746065120.695685:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260938880 00000100:00100000:1.0:1746065120.695725:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 620 00000100:00100000:1.0:1746065120.695731:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:1960:x1830881260938880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.695740:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.695759:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f2809 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa9f expref: 261 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.695775:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065120.695778:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.695797:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1960:x1830881260938880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.695803:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 620 00000100:00100000:2.0:1746065120.697925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.697945:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260939008 00000100:00100000:2.0:1746065120.697950:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260939008 00000100:00100000:2.0:1746065120.697976:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10484 00000100:00100000:2.0:1746065120.697981:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:28887:x1830881260939008:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065120.697993:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.698006:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aaa6 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.698027:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa0c expref: 19 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.698034:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 14 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.698040:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.698042:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.698044:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1208320->1261567] (req 1208320->1261567) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.698066:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 14 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.698076:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 14 pid: 4545 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.698086:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259684096:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.698139:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa0c expref: 19 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.698146:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa0c expref: 19 pid: 4544 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746065120.698152:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259684224:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.699208:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.699557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.699683:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260939136 00000100:00100000:2.0:1746065120.699688:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260939136 00010000:00010000:2.0:1746065120.699711:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 18 pid: 4544 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746065120.699743:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5221 00000100:00100000:2.0:1746065120.699749:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881260939136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.699758:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.699772:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 18 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.699780:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 18 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.699795:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5574800/0x14b4f8542d4f2768 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa4b expref: 18 pid: 4544 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746065120.699808:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.699809:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.699827:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.699834:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.699855:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.699862:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259684352:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.699899:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.706804:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259684096:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.706842:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259684224:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.706869:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1208320->1261567] (req 1208320->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.706886:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e23800, rc 0) 00000100:00100000:3.0:1746065120.706930:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:28887:x1830881260939008:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8946us (9009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.706938:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10484 00000100:00100000:1.0:1746065120.717940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.718239:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260939264 00000100:00100000:0.0:1746065120.718246:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260939264 00010000:00010000:0.0:1746065120.718271:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa0c expref: 19 pid: 4544 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746065120.718303:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5222 00000100:00100000:0.0:1746065120.718310:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881260939264:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.718321:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.718335:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa0c expref: 19 pid: 4544 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.718345:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa0c expref: 19 pid: 4544 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.718381:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b917800/0x14b4f8542d4f2729 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa0c expref: 19 pid: 4544 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746065120.718401:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065120.718432:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881260939264:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 122us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.718437:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5222 00000100:00100000:1.0:1746065120.720776:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259684352:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065120.720796:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.720839:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260939136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 21088us (21284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.720847:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5221 00000100:00100000:3.0:1746065120.721031:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260938240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27425us (27992us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.721039:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4798 00002000:00100000:3.0:1746065120.721047:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880094d94700 x1830881260938240/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.721059:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94700 with x1830881260938240 ext(1048576->2097151) 00002000:00010000:3.0:1746065120.721064:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94700 00000100:00100000:2.0:1746065120.722384:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260937984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28988us (29372us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065120.722393:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4797 00002000:00100000:2.0:1746065120.722400:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094d94a80 x1830881260937984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.722408:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94a80 with x1830881260937984 ext(0->1048575) 00002000:00010000:2.0:1746065120.722412:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d94a80 00000100:00100000:0.0:1746065120.725478:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881260938752:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31457us (32378us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065120.725489:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4800 00002000:00100000:0.0:1746065120.725498:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d95f80 x1830881260938752/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.725507:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95f80 with x1830881260938752 ext(1048576->2097151) 00002000:00010000:0.0:1746065120.725512:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95f80 00000100:00100000:3.0:1746065120.725595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.725898:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260939520 00000100:00100000:0.0:1746065120.725905:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260939520 00002000:00100000:0.0:1746065120.725928:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012e8b5c00 x1830881260939520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.725936:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5c00 with x1830881260939520 ext(2097152->3145727) 00002000:00010000:0.0:1746065120.725939:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b5c00 00000100:00100000:0.0:1746065120.725953:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4801 00000100:00100000:0.0:1746065120.725960:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260939520:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065120.727210:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881260938496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 33491us (34145us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.727218:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4799 00002000:00100000:3.0:1746065120.727224:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094d97800 x1830881260938496/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.727231:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97800 with x1830881260938496 ext(1048576->2097151) 00010000:00010000:3.0:1746065120.727238:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 12 pid: 4545 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746065120.727250:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 12 pid: 4545 timeout: 820 lvb_type: 1 00002000:00010000:3.0:1746065120.727257:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d97800 00000100:00100000:0.0:1746065120.734100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.734171:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260939648 00000100:00100000:1.0:1746065120.734178:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260939648 00010000:00010000:1.0:1746065120.734206:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 12 pid: 4545 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065120.734227:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5223 00000100:00100000:1.0:1746065120.734235:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260939648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.734247:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.734269:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 12 pid: 4545 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746065120.734279:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 12 pid: 4545 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746065120.734297:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4f2753 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa36 expref: 12 pid: 4545 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746065120.734313:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.734315:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.734321:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.734327:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.734363:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.734374:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259684480:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065120.734432:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065120.740200:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259684480:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065120.740218:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.740262:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260939648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6027us (6168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.740271:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5223 00000100:00100000:0.0:1746065120.742001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.742605:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260939904 00000100:00100000:3.0:1746065120.742613:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260939904 00002000:00100000:3.0:1746065120.742646:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1208320->1212415) req@ffff8800913f9c00 x1830881260939904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.742655:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9c00 with x1830881260939904 ext(1208320->1212415) 00002000:00010000:3.0:1746065120.742660:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f9c00 00000100:00100000:3.0:1746065120.742683:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4802 00000100:00100000:3.0:1746065120.742689:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881260939904:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065120.742854:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881260939904:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 164us (859us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065120.742860:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4802 00002000:00100000:3.0:1746065120.742865:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1208320->1212415) req@ffff8800913f9c00 x1830881260939904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.742871:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9c00 with x1830881260939904 ext(1208320->1212415) 00002000:00010000:3.0:1746065120.742874:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f9c00 00000100:00100000:3.0:1746065120.746255:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260939520:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 20287us (20653us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.746264:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4801 00002000:00100000:3.0:1746065120.746273:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012e8b5c00 x1830881260939520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.746281:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5c00 with x1830881260939520 ext(2097152->3145727) 00002000:00010000:3.0:1746065120.746286:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b5c00 00000100:00100000:0.0:1746065120.746438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.746790:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260940288 00000100:00100000:3.0:1746065120.746796:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260940288 00002000:00100000:3.0:1746065120.746851:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1257472->1261567) req@ffff8800913fb480 x1830881260940288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.746858:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fb480 with x1830881260940288 ext(1257472->1261567) 00002000:00010000:3.0:1746065120.746861:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913fb480 00000100:00100000:3.0:1746065120.746875:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4803 00000100:00100000:3.0:1746065120.746882:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881260940288:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065120.747003:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881260940288:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 121us (566us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065120.747008:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4803 00002000:00100000:3.0:1746065120.747013:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1257472->1261567) req@ffff8800913fb480 x1830881260940288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.747019:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fb480 with x1830881260940288 ext(1257472->1261567) 00002000:00010000:3.0:1746065120.747021:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913fb480 00000100:00100000:1.0:1746065120.747122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.747368:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260940160 00000100:00100000:3.0:1746065120.747372:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260940160 00000100:00100000:3.0:1746065120.747402:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10485 00000100:00100000:3.0:1746065120.747408:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+11:28885:x1830881260940160:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.747416:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.747429:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aaad expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.747449:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.747456:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065120.747457:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065120.747460:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.747483:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.747498:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 17 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.747509:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259684608:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.747567:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065120.750412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.750415:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259684608:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.750438:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.750452:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c757e00, rc 0) 00000100:00100000:3.0:1746065120.750486:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:28885:x1830881260940160:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3078us (3364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.750492:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10485 00000100:00100000:1.0:1746065120.750493:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.750603:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260940544 00000100:00100000:0.0:1746065120.750608:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260940544 00002000:00100000:0.0:1746065120.750637:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1208320->1261567) req@ffff88009a4e9500 x1830881260940544/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.750645:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9500 with x1830881260940544 ext(1208320->1261567) 00010000:00010000:0.0:1746065120.750651:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 18 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065120.750661:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 18 pid: 9716 timeout: 820 lvb_type: 0 00002000:00010000:0.0:1746065120.750667:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e9500 00000100:00100000:2.0:1746065120.750704:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260940800 00000100:00100000:2.0:1746065120.750708:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260940800 00000100:00100000:2.0:1746065120.750733:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3650 00000100:00100000:2.0:1746065120.750738:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:28887:x1830881260940800:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065120.751181:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:28887:x1830881260940800:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 442us (687us total) trans 8589943016 rc 0/0 00000100:00100000:2.0:1746065120.751186:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3650 00000100:00100000:0.0:1746065120.751224:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1488 00000100:00100000:0.0:1746065120.751230:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881260940544:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065120.752142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.752329:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260940928 00000100:00100000:3.0:1746065120.752333:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260940928 00000100:00100000:3.0:1746065120.752371:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10486 00000100:00100000:3.0:1746065120.752378:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:28879:x1830881260940928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.752386:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.752398:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aab4 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.752415:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 11 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.752425:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065120.752426:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065120.752429:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.752449:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 11 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.752458:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 11 pid: 4544 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.752468:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259684736:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.752532:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.752851:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.752886:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260941056 00000100:00100000:2.0:1746065120.752890:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260941056 00000100:00100000:2.0:1746065120.752908:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10487 00000100:00100000:2.0:1746065120.752913:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:28881:x1830881260941056:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065120.752921:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.752928:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aabb expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.752939:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065120.752943:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.752952:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065120.752954:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1335296->2097151] (req 1335296->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.752974:0:4544:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.752983:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1335296->2097151] (req 1335296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.752991:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b5200, rc 0) 00000100:00100000:2.0:1746065120.753024:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:28881:x1830881260941056:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 110us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.753029:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10487 00000100:00100000:3.0:1746065120.753886:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259684736:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.753900:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.753907:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756400, rc 0) 00000100:00100000:3.0:1746065120.753926:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:28879:x1830881260940928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1549us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.753931:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10486 00000100:00100000:0.0:1746065120.756251:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881260940544:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5015us (5840us total) trans 21474839982 rc 0/0 00000100:00100000:0.0:1746065120.756260:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1488 00002000:00100000:0.0:1746065120.756268:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1208320->1261567) req@ffff88009a4e9500 x1830881260940544/t21474839982(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.756277:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9500 with x1830881260940544 ext(1208320->1261567) 00010000:00010000:0.0:1746065120.756285:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065120.756295:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00002000:00010000:0.0:1746065120.756301:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e9500 00000100:00100000:2.0:1746065120.756364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.756671:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260941184 00000100:00100000:0.0:1746065120.756676:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260941184 00002000:00100000:0.0:1746065120.756703:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->2461695) req@ffff8800a5883480 x1830881260941184/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.756709:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883480 with x1830881260941184 ext(2097152->2461695) 00010000:00010000:0.0:1746065120.756714:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 13 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065120.756721:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 13 pid: 4544 timeout: 820 lvb_type: 0 00002000:00010000:0.0:1746065120.756726:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5883480 00000100:00100000:0.0:1746065120.756752:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1489 00000100:00100000:0.0:1746065120.756759:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881260941184:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065120.760707:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.760756:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260941312 00000100:00100000:2.0:1746065120.760763:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260941312 00010000:00010000:2.0:1746065120.760793:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.760857:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5224 00000100:00100000:2.0:1746065120.760864:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881260941312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.760876:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065120.760891:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065119 -> 1746065121 00002000:00010000:2.0:1746065120.760893:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065120 -> 1746065121 00010000:00010000:2.0:1746065120.760899:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065120.760909:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065120.760927:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e23800/0x14b4f8542d4f2817 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1208320->1261567) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaa6 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065120.761637:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.761641:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.761649:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.761658:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.761687:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.761697:0:7078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.761706:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259684992:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065120.761774:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.764146:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260941184:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 7382us (7776us total) trans 21474839983 rc 0/0 00000100:00100000:0.0:1746065120.764156:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1489 00002000:00100000:0.0:1746065120.764165:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->2461695) req@ffff8800a5883480 x1830881260941184/t21474839983(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.764173:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883480 with x1830881260941184 ext(2097152->2461695) 00010000:00010000:0.0:1746065120.764181:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 15 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065120.764192:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 15 pid: 4544 timeout: 820 lvb_type: 0 00002000:00010000:0.0:1746065120.764197:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5883480 00000100:00100000:2.0:1746065120.765935:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259684992:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065120.765936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065120.765952:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.766410:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260941312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5545us (5709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.766418:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5224 00000100:00100000:1.0:1746065120.766420:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260941440 00000100:00100000:1.0:1746065120.766426:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260941440 00010000:00010000:1.0:1746065120.766448:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 15 pid: 4544 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.766464:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5225 00000100:00100000:2.0:1746065120.766469:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260941440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.766479:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.766494:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 15 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065120.766503:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 15 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065120.766521:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4f276f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa52 expref: 15 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065120.766531:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.766532:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.766538:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.766545:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.766568:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.766577:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259685120:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065120.771600:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.771627:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260941696 00000100:00100000:0.0:1746065120.771633:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260941696 00002000:00100000:0.0:1746065120.771667:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800913f8000 x1830881260941696/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.771677:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f8000 with x1830881260941696 ext(1048576->2097151) 00010000:00010000:0.0:1746065120.771685:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065120.771698:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00002000:00010000:0.0:1746065120.771704:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800913f8000 00000100:00100000:0.0:1746065120.771722:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1490 00000100:00100000:0.0:1746065120.771730:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260941696:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065120.773848:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.776624:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259685120:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065120.776643:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065120.776687:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260941440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 10216us (10750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.776696:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5225 00000100:00100000:2.0:1746065120.778413:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260941696:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 6680us (6815us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065120.778421:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1490 00002000:00100000:2.0:1746065120.778429:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800913f8000 x1830881260941696/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.778437:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f8000 with x1830881260941696 ext(1048576->2097151) 00010000:00010000:2.0:1746065120.778446:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065120.778458:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00002000:00010000:2.0:1746065120.778464:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800913f8000 00000100:00100000:0.0:1746065120.782427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.782697:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260942080 00000100:00100000:2.0:1746065120.782705:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260942080 00002000:00100000:2.0:1746065120.782737:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800913fb100 x1830881260942080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.782745:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fb100 with x1830881260942080 ext(2097152->3145727) 00002000:00010000:2.0:1746065120.782949:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913fb100 00000100:00100000:2.0:1746065120.782974:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4804 00000100:00100000:2.0:1746065120.782981:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881260942080:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065120.783277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.783307:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260942208 00000100:00100000:0.0:1746065120.783310:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260942208 00002000:00100000:0.0:1746065120.783324:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009a4e9c00 x1830881260942208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.783336:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9c00 with x1830881260942208 ext(3145728->4194303) 00002000:00010000:0.0:1746065120.783338:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e9c00 00000100:00100000:1.0:1746065120.783348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.783365:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260942464 00000100:00100000:0.0:1746065120.783367:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260942464 00002000:00100000:0.0:1746065120.783379:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009a4e8a80 x1830881260942464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.783388:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8a80 with x1830881260942464 ext(3145728->4194303) 00002000:00010000:0.0:1746065120.783392:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e8a80 00000100:00100000:0.0:1746065120.783402:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4805 00000100:00100000:0.0:1746065120.783407:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881260942208:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065120.783538:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4806 00000100:00100000:1.0:1746065120.783544:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260942464:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065120.794535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.794563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.794949:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260942720 00000100:00100000:0.0:1746065120.794956:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260942720 00010000:00010000:0.0:1746065120.794983:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746065120.795016:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5226 00000100:00100000:0.0:1746065120.795022:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260942720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065120.795032:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065120.795049:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065120.795059:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065120.795081:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f281e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaad expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065120.795096:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.795098:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065120.795103:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065120.795110:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.797009:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.797042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.797061:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260942592 00000100:00100000:2.0:1746065120.797067:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260942592 00000100:00100000:2.0:1746065120.797102:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260942848 00000100:00100000:2.0:1746065120.797105:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260942848 00000100:00100000:2.0:1746065120.797119:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260942976 00000100:00100000:2.0:1746065120.797121:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260942976 00000100:00100000:2.0:1746065120.797133:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10488 00000100:00100000:2.0:1746065120.797138:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260942592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.797152:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.797166:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4f2833 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aac2 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.797205:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259685248:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065120.797271:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.797285:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10489 00000100:00100000:2.0:1746065120.797291:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260942848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.797297:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.797308:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aac9 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.797319:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.797321:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.797327:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac9 expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.797338:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac9 expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.797346:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013047d800, rc 0) 00000100:00100000:2.0:1746065120.797380:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260942848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 89us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.797385:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10489 00000100:00100000:2.0:1746065120.797398:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10490 00000100:00100000:2.0:1746065120.797402:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260942976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.797407:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.797412:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aad0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.797420:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.797421:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.797424:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad0 expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.797433:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad0 expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.797439:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013047c200, rc 0) 00000100:00100000:2.0:1746065120.797452:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260942976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 50us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.797458:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10490 00010000:00010000:0.0:1746065120.797790:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.797799:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259685376:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065120.797841:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.799441:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260942080:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 16457us (17017us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065120.799449:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4804 00002000:00100000:2.0:1746065120.799457:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800913fb100 x1830881260942080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.799465:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fb100 with x1830881260942080 ext(2097152->3145727) 00002000:00010000:2.0:1746065120.799470:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913fb100 00000100:00100000:1.0:1746065120.801557:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260942464:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 18008us (18202us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065120.801566:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4806 00002000:00100000:1.0:1746065120.801573:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009a4e8a80 x1830881260942464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.801581:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8a80 with x1830881260942464 ext(3145728->4194303) 00002000:00010000:1.0:1746065120.801585:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e8a80 00002000:00010000:2.0:1746065120.801764:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime: 1746065119 -> 1746065121 00000100:00100000:2.0:1746065120.801780:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259685248:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065120.801805:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4f2833 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac2 expref: 16 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.801832:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4f2833 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac2 expref: 16 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.801846:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b4800, rc 0) 00000100:00100000:2.0:1746065120.801864:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260942592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4726us (7301us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.801870:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10488 00000100:00100000:0.0:1746065120.802061:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259685376:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065120.802072:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065120.802089:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260942720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7067us (7561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065120.802096:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5226 00000100:00100000:0.0:1746065120.803996:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881260942208:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 20586us (20717us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065120.804004:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4805 00002000:00100000:0.0:1746065120.804011:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009a4e9c00 x1830881260942208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.804018:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9c00 with x1830881260942208 ext(3145728->4194303) 00002000:00010000:0.0:1746065120.804022:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e9c00 00000100:00100000:0.0:1746065120.804063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.804113:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260943232 00000100:00100000:0.0:1746065120.804118:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260943232 00002000:00100000:0.0:1746065120.804138:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1335296->1339391) req@ffff8800913f8380 x1830881260943232/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.804144:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f8380 with x1830881260943232 ext(1335296->1339391) 00002000:00010000:0.0:1746065120.804147:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f8380 00000100:00100000:0.0:1746065120.804157:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4807 00000100:00100000:0.0:1746065120.804161:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260943232:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065120.805178:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260943232:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1014us (1112us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065120.805185:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4807 00002000:00100000:0.0:1746065120.805191:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1335296->1339391) req@ffff8800913f8380 x1830881260943232/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.805197:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f8380 with x1830881260943232 ext(1335296->1339391) 00002000:00010000:0.0:1746065120.805200:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f8380 00000100:00100000:0.0:1746065120.809617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.809782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.809858:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260943360 00000100:00100000:2.0:1746065120.809858:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260943488 00000100:00100000:3.0:1746065120.809865:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260943360 00000100:00100000:2.0:1746065120.809865:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260943488 00000100:00100000:2.0:1746065120.809905:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10491 00000100:00100000:2.0:1746065120.809912:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881260943488:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.809930:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065120.809943:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10492 00010000:00010000:2.0:1746065120.809944:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4f2848 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aade expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.809948:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260943360:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.809954:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.809961:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aad7 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.809970:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.809971:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.809977:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad7 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065120.809985:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259685504:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065120.809988:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad7 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.809995:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7c600, rc 0) 00000100:00100000:2.0:1746065120.810187:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.810209:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881260943360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 260us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.810283:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10492 00000100:00100000:2.0:1746065120.811483:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259685504:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065120.811507:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4f2848 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aade expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.811517:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4f2848 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aade expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.811749:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5574800, rc 0) 00000100:00100000:2.0:1746065120.811787:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881260943488:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1874us (2003us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.811792:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10491 00000100:00100000:0.0:1746065120.812300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.812332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.812497:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260943744 00000100:00100000:2.0:1746065120.812503:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260943744 00002000:00100000:2.0:1746065120.812528:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800913f9f80 x1830881260943744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.812537:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9f80 with x1830881260943744 ext(2097152->3145727) 00002000:00010000:2.0:1746065120.812541:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f9f80 00000100:00100000:2.0:1746065120.812565:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260944000 00000100:00100000:2.0:1746065120.812568:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260944000 00002000:00100000:2.0:1746065120.812578:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800913fa300 x1830881260944000/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.812584:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fa300 with x1830881260944000 ext(3145728->4194303) 00002000:00010000:2.0:1746065120.812586:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913fa300 00000100:00100000:3.0:1746065120.812589:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4808 00000100:00100000:3.0:1746065120.812596:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260943744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.813020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.813303:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260944256 00000100:00100000:2.0:1746065120.813306:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260944256 00002000:00100000:2.0:1746065120.813322:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800913f9880 x1830881260944256/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.813328:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9880 with x1830881260944256 ext(2097152->3145727) 00002000:00010000:2.0:1746065120.813331:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f9880 00000100:00100000:2.0:1746065120.813347:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4809 00000100:00100000:2.0:1746065120.813364:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260944000:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065120.813660:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4810 00000100:00100000:3.0:1746065120.813665:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260944256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.814945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.817011:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260944512 00000100:00100000:1.0:1746065120.817021:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260944512 00002000:00100000:1.0:1746065120.817057:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800913f9180 x1830881260944512/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.817066:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9180 with x1830881260944512 ext(3145728->4194303) 00002000:00010000:1.0:1746065120.817070:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f9180 00000100:00100000:1.0:1746065120.817094:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4811 00000100:00100000:1.0:1746065120.817106:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260944512:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065120.820150:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065120.820918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.820988:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260944768 00000100:00100000:1.0:1746065120.820996:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260944768 00002000:00100000:1.0:1746065120.821030:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff8800913fa680 x1830881260944768/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.821040:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fa680 with x1830881260944768 ext(4194304->4976639) 00002000:00010000:1.0:1746065120.821045:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913fa680 00000100:00100000:1.0:1746065120.821076:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4812 00000100:00100000:1.0:1746065120.821083:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881260944768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065120.821620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.821772:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260944896 00000100:00100000:3.0:1746065120.821777:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260944896 00000100:00100000:3.0:1746065120.821803:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10493 00000100:00100000:3.0:1746065120.821809:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:28881:x1830881260944896:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065120.821833:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.821850:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aae5 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.821873:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa13 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.821881:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa3d expref: 19 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.821886:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.821888:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.821891:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1294335] (req 1048576->1294335) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 19 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.821918:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa3d expref: 19 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.821928:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa3d expref: 19 pid: 4545 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.821938:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259685632:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.822343:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa13 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.822360:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa13 expref: 28 pid: 8428 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.822368:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259685760:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.822389:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.829125:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259685632:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.829137:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259685760:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.829161:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1294335] (req 1048576->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 19 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.829176:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7c000, rc 0) 00000100:00100000:2.0:1746065120.829229:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+19:28881:x1830881260944896:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7418us (7608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.829237:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10493 00000100:00100000:3.0:1746065120.829329:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881260943744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16733us (17028us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065120.829338:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4808 00002000:00100000:3.0:1746065120.829345:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800913f9f80 x1830881260943744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.829365:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9f80 with x1830881260943744 ext(2097152->3145727) 00002000:00010000:3.0:1746065120.829369:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f9f80 00000100:00100000:0.0:1746065120.829600:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260944000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16246us (17265us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065120.829606:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4809 00002000:00100000:0.0:1746065120.829612:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800913fa300 x1830881260944000/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065120.829619:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fa300 with x1830881260944000 ext(3145728->4194303) 00002000:00010000:0.0:1746065120.829623:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913fa300 00000100:00100000:0.0:1746065120.831379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.831407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.831502:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260945152 00000100:00100000:2.0:1746065120.831509:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260945152 00010000:00010000:2.0:1746065120.831538:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa13 expref: 29 pid: 8428 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065120.831561:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260945024 00000100:00100000:2.0:1746065120.831563:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260945024 00010000:00010000:2.0:1746065120.831571:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa3d expref: 15 pid: 4545 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065120.831583:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5227 00000100:00100000:2.0:1746065120.831589:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881260945152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065120.831600:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.831617:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa13 expref: 29 pid: 8428 timeout: 820 lvb_type: 1 00010000:00010000:2.0:1746065120.831627:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa13 expref: 29 pid: 8428 timeout: 820 lvb_type: 1 00010000:00010000:2.0:1746065120.831644:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89a00/0x14b4f8542d4f2730 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa13 expref: 29 pid: 8428 timeout: 820 lvb_type: 1 00010000:00010000:2.0:1746065120.831658:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.831679:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5228 00000100:00100000:3.0:1746065120.831687:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260945024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065120.831687:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260945152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.831692:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5227 00010000:00010000:3.0:1746065120.831695:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.831706:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa3d expref: 15 pid: 4545 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.831715:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa3d expref: 15 pid: 4545 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.831728:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4f275a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa3d expref: 15 pid: 4545 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.831741:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.831743:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.831748:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 14 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.831756:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 14 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.831780:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 14 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.831790:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259685888:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065120.831938:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.832225:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260944256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18558us (19204us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065120.832231:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4810 00002000:00100000:2.0:1746065120.832238:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800913f9880 x1830881260944256/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.832245:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9880 with x1830881260944256 ext(2097152->3145727) 00002000:00010000:2.0:1746065120.832249:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f9880 00000100:00100000:1.0:1746065120.833500:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260944512:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16392us (18555us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065120.833508:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4811 00002000:00100000:1.0:1746065120.833513:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800913f9180 x1830881260944512/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.833520:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9180 with x1830881260944512 ext(3145728->4194303) 00002000:00010000:1.0:1746065120.833524:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f9180 00000100:00100000:1.0:1746065120.834403:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260944768:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13318us (13809us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746065120.834410:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4812 00002000:00100000:1.0:1746065120.834415:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff8800913fa680 x1830881260944768/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.834422:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fa680 with x1830881260944768 ext(4194304->4976639) 00002000:00010000:1.0:1746065120.834426:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913fa680 00000100:00100000:3.0:1746065120.834662:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259685888:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065120.834675:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.834703:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260945024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3017us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.834709:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5228 00000100:00100000:0.0:1746065120.837158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.837220:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260945408 00000100:00100000:1.0:1746065120.837228:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260945408 00002000:00100000:1.0:1746065120.837265:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1290240->1294335) req@ffff880094d96a00 x1830881260945408/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.837273:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96a00 with x1830881260945408 ext(1290240->1294335) 00002000:00010000:1.0:1746065120.837278:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d96a00 00000100:00100000:1.0:1746065120.837304:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4813 00000100:00100000:1.0:1746065120.837311:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260945408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065120.837458:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260945408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 146us (304us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065120.837464:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4813 00002000:00100000:1.0:1746065120.837469:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1290240->1294335) req@ffff880094d96a00 x1830881260945408/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/4536 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065120.837475:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96a00 with x1830881260945408 ext(1290240->1294335) 00002000:00010000:1.0:1746065120.837477:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d96a00 00000100:00100000:0.0:1746065120.839114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.839159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.839171:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260945536 00000100:00100000:2.0:1746065120.839177:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260945536 00000100:00100000:2.0:1746065120.839209:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10494 00000100:00100000:2.0:1746065120.839215:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260945536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.839227:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.839241:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f285d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aaec expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.839283:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259686016:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065120.839344:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.839401:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260945792 00000100:00100000:3.0:1746065120.839406:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260945792 00002000:00100000:3.0:1746065120.839426:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880094ff7100 x1830881260945792/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.839434:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7100 with x1830881260945792 ext(4194304->4976639) 00002000:00010000:3.0:1746065120.839438:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff7100 00000100:00100000:3.0:1746065120.839459:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4814 00000100:00100000:3.0:1746065120.839464:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260945792:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065120.839479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.839493:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260945920 00000100:00100000:0.0:1746065120.839495:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260945920 00000100:00100000:0.0:1746065120.839514:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10495 00000100:00100000:0.0:1746065120.839518:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881260945920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065120.839524:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065120.839532:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a274400/0x14b4f8542d4f2864 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aaf3 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.839552:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259686144:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065120.839569:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be000 going to sleep for 11 seconds 00002000:00010000:1.0:1746065120.841144:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065119 -> 1746065121 00002000:00010000:1.0:1746065120.841149:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065119 -> 1746065121 00002000:00010000:1.0:1746065120.841151:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065120 -> 1746065121 00000100:00100000:1.0:1746065120.841165:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259686144:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065120.841186:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a274400/0x14b4f8542d4f2864 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaf3 expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065120.841192:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259686016:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065120.841197:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a274400/0x14b4f8542d4f2864 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaf3 expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.841209:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f285d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaec expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.841219:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094977400/0x14b4f8542d4f285d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aaec expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.841233:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094977400, rc 0) 00010000:00010000:1.0:1746065120.841257:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a274400, rc 0) 00000100:00100000:3.0:1746065120.841259:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260945536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2043us (2148us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065120.841266:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10494 00000100:00100000:1.0:1746065120.841277:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881260945920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1758us (1798us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065120.841283:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10495 00000100:00100000:3.0:1746065120.845298:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260945792:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5825us (6129us total) trans 0 rc 782336/782336 00000100:00100000:3.0:1746065120.845307:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4814 00002000:00100000:3.0:1746065120.845317:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff880094ff7100 x1830881260945792/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/440 e 0 to 0 dl 1746065131 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.845325:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7100 with x1830881260945792 ext(4194304->4976639) 00002000:00010000:3.0:1746065120.845330:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff7100 00000100:00100000:0.0:1746065120.845543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.845768:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260946048 00000100:00100000:2.0:1746065120.845775:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260946048 00000100:00100000:2.0:1746065120.845837:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10496 00000100:00100000:2.0:1746065120.845846:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881260946048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065120.845858:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.845871:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b97b600/0x14b4f8542d4f286b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aafa expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.845911:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259686272:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065120.845956:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.848206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.848394:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260946176 00000100:00100000:3.0:1746065120.848401:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260946176 00000100:00100000:3.0:1746065120.848431:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10497 00000100:00100000:3.0:1746065120.848437:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260946176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065120.848451:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.848464:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f2872 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab01 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.848502:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259686400:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065120.848557:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.848652:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259686272:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065120.848673:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b97b600/0x14b4f8542d4f286b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aafa expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.848682:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b97b600/0x14b4f8542d4f286b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aafa expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.848704:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b97b600, rc 0) 00000100:00100000:2.0:1746065120.848724:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881260946048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2879us (3183us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.848730:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10496 00000100:00100000:3.0:1746065120.850772:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259686400:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065120.850800:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f2872 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab01 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.850812:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f2872 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab01 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.850841:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7d600, rc 0) 00000100:00100000:3.0:1746065120.850868:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260946176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2431us (4169us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065120.850875:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10497 00000100:00100000:0.0:1746065120.854993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.855223:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260946432 00000100:00100000:3.0:1746065120.855232:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260946432 00000100:00100000:3.0:1746065120.855279:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3651 00000100:00100000:3.0:1746065120.855286:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:28879:x1830881260946432:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065120.856006:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:28879:x1830881260946432:12345-192.168.202.46@tcp:35:cat.0 Request processed in 719us (1019us total) trans 8589943017 rc 0/0 00000100:00100000:3.0:1746065120.856014:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3651 00000100:00100000:0.0:1746065120.869501:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.872110:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260946560 00000100:00100000:3.0:1746065120.872122:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260946560 00000100:00100000:3.0:1746065120.872161:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8972 00000100:00100000:3.0:1746065120.872168:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28892:x1830881260946560:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065120.872189:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.872203:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f2879 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab08 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.872253:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.872266:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.872274:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.872286:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.872291:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.872295:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.872397:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.872407:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f0 expref: 17 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.872413:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.872436:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f0 expref: 17 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.872445:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f0 expref: 17 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.872456:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259686528:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.881390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.881474:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260946816 00000100:00100000:2.0:1746065120.881481:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260946816 00000100:00100000:2.0:1746065120.881516:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3652 00000100:00100000:2.0:1746065120.881524:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:7710:x1830881260946816:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065120.881854:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.881877:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259686528:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.881893:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065120.884306:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:7710:x1830881260946816:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 2774us (2914us total) trans 8589943018 rc 0/0 00000100:00100000:2.0:1746065120.884326:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3652 00000100:00100000:2.0:1746065120.885669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.885847:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260946944 00000100:00100000:3.0:1746065120.885856:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260946944 00010000:00010000:3.0:1746065120.885887:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f0 expref: 19 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.885921:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5229 00000100:00100000:3.0:1746065120.885927:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881260946944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.885938:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.885942:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f0 expref: 19 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.885952:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f0 expref: 19 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.885968:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f2706 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a9f0 expref: 19 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.885996:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.886000:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.886008:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.886018:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.886038:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065120.886229:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886235:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065120.886272:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:1.0:1746065120.886276:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065120.886290:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886298:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886305:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886310:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886319:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886323:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b7d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065120.886326:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886331:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886339:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065120.886341:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065120.886343:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886347:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d200/0x14b4f8542d4f2880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886369:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886373:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886377:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886381:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b7ca00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065120.886383:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886387:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886396:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669200) 00010000:00010000:1.0:1746065120.886397:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065120.886399:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886403:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4f2887 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.886430:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f2879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab08 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.886439:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab08 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.886444:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065120.886446:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065120.886448:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7d400, rc 0) 00000100:00100000:3.0:1746065120.886700:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260946944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 770us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.886707:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5229 00000100:00100000:1.0:1746065120.887651:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28892:x1830881260946560:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 15481us (18156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.887657:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8972 00000100:00100000:0.0:1746065120.889913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.889946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.889973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.889994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.890008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.890013:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260947072 00000100:00100000:2.0:1746065120.890020:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260947072 00000100:00100000:0.0:1746065120.890031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.890050:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260947200 00000100:00100000:2.0:1746065120.890052:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260947200 00000100:00100000:2.0:1746065120.890063:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260947328 00000100:00100000:2.0:1746065120.890064:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260947328 00000100:00100000:2.0:1746065120.890073:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260947456 00000100:00100000:2.0:1746065120.890074:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260947456 00000100:00100000:2.0:1746065120.890081:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260947584 00000100:00100000:2.0:1746065120.890083:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260947584 00000100:00100000:2.0:1746065120.890090:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260947712 00000100:00100000:2.0:1746065120.890091:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260947712 00000100:00100000:2.0:1746065120.890101:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10498 00000100:00100000:2.0:1746065120.890107:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260947072:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065120.890122:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.890141:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab0f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.890158:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.890160:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.890168:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab0f expref: 8 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.890181:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab0f expref: 8 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.890190:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a61a00, rc 0) 00000100:00100000:1.0:1746065120.890197:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10499 00000100:00100000:1.0:1746065120.890205:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260947200:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065120.890213:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.890223:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab16 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.890224:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260947072:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 118us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.890230:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10498 00000100:00100000:2.0:1746065120.890244:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10500 00000100:00100000:2.0:1746065120.890249:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260947328:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065120.890255:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.890262:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a61c00/0x14b4f8542d4f28a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab1d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.890295:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259686656:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065120.890343:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.890379:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10501 00000100:00100000:2.0:1746065120.890384:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260947456:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065120.890390:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.890395:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b46fc00/0x14b4f8542d4f28aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab24 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.890416:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259686784:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065120.890434:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.890447:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10502 00000100:00100000:2.0:1746065120.890452:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260947584:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:3.0:1746065120.890453:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10503 00010000:00010000:2.0:1746065120.890457:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065120.890460:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260947712:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065120.890463:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab2b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.890467:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065120.890471:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.890473:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.890474:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab32 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.890477:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab2b expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.890483:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.890485:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.890485:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab2b expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.890490:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab32 expref: 14 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.890491:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900c9800, rc 0) 00010000:00010000:3.0:1746065120.890500:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab32 expref: 14 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065120.890505:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260947584:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 53us (495us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065120.890507:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7cc00, rc 0) 00000100:00100000:2.0:1746065120.890509:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10502 00000100:00100000:3.0:1746065120.890524:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881260947712:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 65us (493us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065120.890543:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.890545:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.890550:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab16 expref: 14 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.890559:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab16 expref: 14 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065120.890565:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c733200, rc 0) 00000100:00100000:1.0:1746065120.890578:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881260947200:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 376us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.890938:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10503 00000100:00100000:1.0:1746065120.891080:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10499 00000100:00100000:2.0:1746065120.893064:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259686656:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065120.893090:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a61c00/0x14b4f8542d4f28a3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab1d expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.893101:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a61c00/0x14b4f8542d4f28a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab1d expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.893113:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a61c00, rc 0) 00000100:00100000:2.0:1746065120.893153:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260947328:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2903us (3178us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.893159:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10500 00000100:00100000:3.0:1746065120.893916:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259686784:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065120.893933:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b46fc00/0x14b4f8542d4f28aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab24 expref: 8 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.893948:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b46fc00/0x14b4f8542d4f28aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab24 expref: 8 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.894069:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b46fc00, rc 0) 00000100:00100000:3.0:1746065120.894106:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260947456:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3718us (4108us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065120.894112:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10501 00000100:00100000:0.0:1746065120.896362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.897145:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260947968 00000100:00100000:1.0:1746065120.897153:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260947968 00000100:00100000:1.0:1746065120.897204:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8973 00000100:00100000:1.0:1746065120.897212:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28892:x1830881260947968:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065120.897227:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.897241:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732400/0x14b4f8542d4f28bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab39 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.897316:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.897328:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab08 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.897335:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.897372:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab08 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.897387:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab08 expref: 14 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065120.897397:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259686912:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.897471:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.899541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.899735:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259686912:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.899752:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065120.899897:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260948096 00000100:00100000:3.0:1746065120.899903:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260948096 00010000:00010000:3.0:1746065120.899925:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab08 expref: 15 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.899946:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5230 00000100:00100000:3.0:1746065120.899951:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1961:x1830881260948096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.899960:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.899965:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab08 expref: 15 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.899974:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab08 expref: 15 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.899989:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d400/0x14b4f8542d4f288e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab08 expref: 15 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.899999:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.900003:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.900011:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.900016:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.900029:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065120.900253:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.900258:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065120.900272:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065120.900382:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732400/0x14b4f8542d4f28bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab39 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.900396:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab39 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.900401:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065120.900404:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065120.900406:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c733c00, rc 0) 00000100:00100000:1.0:1746065120.900426:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:28892:x1830881260947968:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3215us (4078us total) trans 8589943019 rc 0/0 00000100:00100000:1.0:1746065120.900435:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8973 00000100:00100000:3.0:1746065120.901048:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260948096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1095us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.901055:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5230 00000100:00100000:0.0:1746065120.903724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.903799:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260948224 00000100:00100000:1.0:1746065120.903806:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260948224 00000100:00100000:1.0:1746065120.904310:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8974 00000100:00100000:1.0:1746065120.904321:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28892:x1830881260948224:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065120.904342:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.904363:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4f28d4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab40 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.904421:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.904437:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab39 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.904444:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.904468:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab39 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.904478:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab39 expref: 15 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065120.904488:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259687040:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.904900:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065120.906683:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259687040:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.906699:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065120.907077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.907139:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260948352 00000100:00100000:3.0:1746065120.907144:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260948352 00010000:00010000:3.0:1746065120.907166:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab39 expref: 16 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.907440:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5231 00000100:00100000:3.0:1746065120.907448:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1961:x1830881260948352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.907457:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.907462:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab39 expref: 16 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.907471:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab39 expref: 16 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.907488:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733c00/0x14b4f8542d4f28c6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab39 expref: 16 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.907498:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065120.907503:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.907510:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.907516:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065120.907539:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065120.907632:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.907637:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065120.907668:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:1.0:1746065120.907672:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065120.907684:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.907709:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4f28d4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab40 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.907962:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1961:x1830881260948352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 515us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.907968:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5231 00010000:00010000:1.0:1746065120.908099:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab40 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.908105:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065120.908107:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065120.908110:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c732200, rc 0) 00000100:00100000:1.0:1746065120.908215:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28892:x1830881260948224:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3894us (4496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.908220:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8974 00000100:00100000:0.0:1746065120.914635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.914681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.915146:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260948480 00000100:00100000:3.0:1746065120.915154:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260948480 00000100:00100000:3.0:1746065120.915191:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260948608 00000100:00100000:3.0:1746065120.915193:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260948608 00000100:00100000:3.0:1746065120.915211:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10504 00000100:00100000:3.0:1746065120.915217:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260948480:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065120.915232:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.915246:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f28e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab47 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.915288:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259687168:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065120.915358:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.915377:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10505 00000100:00100000:3.0:1746065120.915383:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260948608:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065120.915390:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065120.915399:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b7c800/0x14b4f8542d4f28e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab4e expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.915421:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259687296:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065120.915438:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.918601:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259687296:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065120.918629:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b7c800/0x14b4f8542d4f28e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab4e expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.918641:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b7c800/0x14b4f8542d4f28e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab4e expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.918655:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7c800, rc 0) 00000100:00100000:2.0:1746065120.918703:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260948608:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3319us (4021us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065120.918710:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10505 00000100:00100000:3.0:1746065120.920951:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259687168:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065120.920974:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f28e2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab47 expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.920984:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f28e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab47 expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.920994:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7ce00, rc 0) 00000100:00100000:3.0:1746065120.921026:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260948480:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5808us (6399us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065120.921033:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10504 00000100:00100000:0.0:1746065120.924468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.924848:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260948864 00000100:00100000:1.0:1746065120.924855:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260948864 00000100:00100000:1.0:1746065120.924897:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8975 00000100:00100000:1.0:1746065120.924903:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:28892:x1830881260948864:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065120.924916:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065120.924930:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4f28f0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab55 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.924998:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732e00/0x14b4f8542d4f28f7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.925009:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732e00/0x14b4f8542d4f28f7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065120.925017:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732e00/0x14b4f8542d4f28f7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065120.925025:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065120.925101:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4f28f0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab55 expref: 17 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.925114:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732e00/0x14b4f8542d4f28f7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab55 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.925120:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065120.925123:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065120.925125:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c732e00, rc 0) 00000100:00100000:1.0:1746065120.925156:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:28892:x1830881260948864:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 253us (695us total) trans 8589943020 rc 0/0 00000100:00100000:1.0:1746065120.925161:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8975 00000100:00100000:0.0:1746065120.927131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.927157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.927174:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.927185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.927195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.927211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.927562:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260949120 00000100:00100000:2.0:1746065120.927569:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260949120 00000100:00100000:2.0:1746065120.927596:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260949376 00000100:00100000:2.0:1746065120.927598:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260949376 00000100:00100000:2.0:1746065120.927610:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260949632 00000100:00100000:2.0:1746065120.927612:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260949632 00000100:00100000:2.0:1746065120.927619:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260948992 00000100:00100000:2.0:1746065120.927621:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260948992 00000100:00100000:2.0:1746065120.927627:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260949248 00000100:00100000:2.0:1746065120.927628:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260949248 00000100:00100000:2.0:1746065120.927633:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260949504 00000100:00100000:2.0:1746065120.927634:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260949504 00000100:00100000:2.0:1746065120.927644:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10506 00000100:00100000:2.0:1746065120.927650:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260949120:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065120.927681:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.927696:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa05 expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.927703:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab16 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.927710:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa2f expref: 13 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.927716:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.927718:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.927720:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.927743:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa2f expref: 13 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.927756:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa2f expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065120.927766:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259687424:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.927844:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab16 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.927851:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab16 expref: 13 pid: 4545 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065120.927858:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259687552:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.927884:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa05 expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.927890:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa05 expref: 19 pid: 9716 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065120.927896:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259687680:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.927907:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.927922:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10507 00000100:00100000:2.0:1746065120.927926:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260949376:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065120.927941:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.927954:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 13 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.927958:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065120.927959:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065120.927961:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.927973:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 13 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.927979:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 13 pid: 8427 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.927986:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259687808:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.928001:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.928012:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10508 00000100:00100000:2.0:1746065120.928016:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260949632:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065120.928027:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928035:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928040:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab32 expref: 13 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.928050:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad0 expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.928055:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.928056:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.928057:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928067:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad0 expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.928072:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad0 expref: 13 pid: 4544 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065120.928078:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259687936:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.928094:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab32 expref: 13 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.928100:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab32 expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065120.928106:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259688064:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.928118:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928127:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.928133:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259688192:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.928141:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.928150:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10509 00000100:00100000:2.0:1746065120.928154:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260948992:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065120.928164:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928171:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928177:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab0f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.928182:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad7 expref: 25 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.928186:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.928187:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065120.928189:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928198:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad7 expref: 25 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.928205:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad7 expref: 25 pid: 9716 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065120.928211:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259688320:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.928228:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab0f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065120.928233:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab0f expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065120.928239:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259688448:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.928250:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928256:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 13 pid: 4544 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.928262:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259688576:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.928269:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065120.928279:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10510 00000100:00100000:2.0:1746065120.928282:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260949248:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065120.928293:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928305:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928309:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065120.928310:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065120.928312:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928323:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.928330:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 13 pid: 4544 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.928337:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259688704:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.928358:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.928418:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10511 00000100:00100000:3.0:1746065120.928425:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260949504:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065120.928441:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.928449:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.928455:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab2b expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.928465:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac9 expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.928469:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.928470:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.928472:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.928483:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac9 expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.928489:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac9 expref: 13 pid: 4544 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.928496:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259688832:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.928513:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab2b expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065120.928519:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab2b expref: 9 pid: 8428 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.928525:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259688960:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.928537:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.928547:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.928552:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259689088:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.928561:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065120.939059:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.939132:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259688320:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.939151:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259687936:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.939158:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259688064:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065120.939165:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259688192:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065120.939192:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065120.939256:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259687424:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.939263:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259687552:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.939269:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259687680:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.939284:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.939841:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259687808:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.939852:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.940541:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260949760 00000100:00100000:3.0:1746065120.940548:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260949760 00010000:00010000:3.0:1746065120.940573:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab16 expref: 14 pid: 4545 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.940593:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5232 00000100:00100000:3.0:1746065120.940599:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1958:x1830881260949760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.940610:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.940627:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab16 expref: 14 pid: 4545 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.940636:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab16 expref: 14 pid: 4545 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.940652:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4f289c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab16 expref: 14 pid: 4545 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.940673:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.940709:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1958:x1830881260949760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 109us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.940714:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5232 00000100:00100000:0.0:1746065120.943746:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259688448:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065120.943759:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259688576:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065120.943789:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.947566:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259688832:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.947601:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259688960:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.947626:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259689088:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.947646:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.947678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.947702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.947719:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260950272 00000100:00100000:3.0:1746065120.947724:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260950272 00010000:00010000:3.0:1746065120.947749:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa05 expref: 20 pid: 9716 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.947770:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260950656 00000100:00100000:3.0:1746065120.947772:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260950656 00010000:00010000:3.0:1746065120.947787:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab0f expref: 10 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.947803:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5233 00000100:00100000:3.0:1746065120.947809:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881260950272:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.947843:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.947861:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa05 expref: 20 pid: 9716 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.947870:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa05 expref: 20 pid: 9716 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.947888:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4f2722 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa05 expref: 20 pid: 9716 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.947900:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.947933:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881260950272:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 124us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.947938:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5233 00000100:00100000:3.0:1746065120.947973:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5234 00000100:00100000:3.0:1746065120.947977:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881260950656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.947984:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.947994:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab0f expref: 10 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.948001:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab0f expref: 10 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.948013:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a61a00/0x14b4f8542d4f2895 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab0f expref: 10 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.948025:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.948039:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881260950656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.948044:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5234 00000100:00100000:3.0:1746065120.948068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.948079:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260950400 00000100:00100000:3.0:1746065120.948081:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260950400 00010000:00010000:3.0:1746065120.948091:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad7 expref: 26 pid: 9716 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.948103:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5235 00000100:00100000:3.0:1746065120.948107:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260950400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.948112:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.948118:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad7 expref: 26 pid: 9716 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.948124:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad7 expref: 26 pid: 9716 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.948135:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b7c600/0x14b4f8542d4f284f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad7 expref: 26 pid: 9716 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.948141:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.948153:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881260950400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.948161:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5235 00000100:00100000:3.0:1746065120.948209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.948220:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260951168 00000100:00100000:3.0:1746065120.948222:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260951168 00010000:00010000:3.0:1746065120.948232:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.948243:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5236 00000100:00100000:3.0:1746065120.948248:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881260951168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.948253:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.948260:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.948267:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.948278:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c775a00/0x14b4f8542d4f27d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa83 expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.948286:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.948287:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.948290:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.948297:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.948317:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.948329:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881260951168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.948334:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5236 00000100:00100000:3.0:1746065120.948377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.948391:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260950016 00000100:00100000:3.0:1746065120.948393:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260950016 00002000:00100000:3.0:1746065120.948413:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1294335) req@ffff88012e8b4000 x1830881260950016/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.948421:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4000 with x1830881260950016 ext(1048576->1294335) 00010000:00010000:3.0:1746065120.948427:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 13 pid: 8427 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.948435:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 13 pid: 8427 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746065120.948440:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e8b4000 00000100:00100000:3.0:1746065120.948452:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1491 00000100:00100000:3.0:1746065120.948457:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260950016:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065120.948695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.948706:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260950528 00000100:00100000:3.0:1746065120.948708:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260950528 00010000:00010000:3.0:1746065120.948718:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.948737:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5237 00000100:00100000:3.0:1746065120.948741:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881260950528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.948748:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.948757:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.948764:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.948774:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4f2825 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aab4 expref: 19 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.948782:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.948796:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881260950528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.948801:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5237 00000100:00100000:3.0:1746065120.948855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.948866:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260950912 00000100:00100000:3.0:1746065120.948869:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260950912 00010000:00010000:3.0:1746065120.948879:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad0 expref: 14 pid: 4544 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.948892:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5238 00000100:00100000:3.0:1746065120.948896:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260950912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.948904:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.948911:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad0 expref: 14 pid: 4544 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.948918:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad0 expref: 14 pid: 4544 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.948928:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013047c200/0x14b4f8542d4f2841 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aad0 expref: 14 pid: 4544 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.948937:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.948950:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260950912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.948954:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5238 00000100:00100000:3.0:1746065120.948982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.948991:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260949888 00000100:00100000:3.0:1746065120.948994:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260949888 00010000:00010000:3.0:1746065120.949002:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa2f expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.949015:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5239 00000100:00100000:3.0:1746065120.949019:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260949888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.949025:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.949031:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa2f expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.949043:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa2f expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.949052:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f274c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa2f expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.949059:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.949061:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.949063:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949070:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949084:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.949097:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260949888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.949103:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5239 00000100:00100000:3.0:1746065120.949135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.949144:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260950144 00000100:00100000:3.0:1746065120.949146:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260950144 00010000:00010000:3.0:1746065120.949155:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab32 expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.949168:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5240 00000100:00100000:3.0:1746065120.949172:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260950144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.949179:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.949186:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab32 expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.949193:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab32 expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.949204:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f28b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab32 expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.949212:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.949213:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065120.949215:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949221:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949234:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.949247:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260950144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 75us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.949251:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5240 00000100:00100000:3.0:1746065120.949291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.949311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.949320:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260951040 00000100:00100000:3.0:1746065120.949323:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260951040 00010000:00010000:3.0:1746065120.949332:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab2b expref: 9 pid: 8428 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065120.949347:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5241 00000100:00100000:3.0:1746065120.949365:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260951040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.949370:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.949378:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab2b expref: 9 pid: 8428 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.949384:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab2b expref: 9 pid: 8428 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.949394:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900c9800/0x14b4f8542d4f28b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab2b expref: 9 pid: 8428 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065120.949401:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.949413:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260951040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.949418:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5241 00000100:00100000:3.0:1746065120.949510:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065120.949521:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260951296 00000100:00100000:3.0:1746065120.949523:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260951296 00010000:00010000:3.0:1746065120.949532:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065120.949543:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5242 00000100:00100000:3.0:1746065120.949547:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260951296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065120.949554:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065120.949560:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.949566:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.949575:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4f27ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa98 expref: 25 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.949583:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065120.949595:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260951296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.949599:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5242 00010000:00010000:3.0:1746065120.949653:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949659:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949674:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949681:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949686:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949692:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b7d600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065120.949695:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949701:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949710:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.949714:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b7d600/0x14b4f8542d4f2905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.949752:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260949120:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 22101us (22624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.949758:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10506 00000100:00100000:3.0:1746065120.949776:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260950784 00000100:00100000:3.0:1746065120.949779:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260950784 00002000:00100000:3.0:1746065120.949793:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1335296->2097151) req@ffff88012e8b7100 x1830881260950784/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/0 e 0 to 0 dl 1746065131 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.949800:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7100 with x1830881260950784 ext(1335296->2097151) 00010000:00010000:3.0:1746065120.949805:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 12 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.949812:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 12 pid: 4544 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746065120.949838:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e8b7100 00000100:00100000:3.0:1746065120.949856:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1492 00000100:00100000:3.0:1746065120.949862:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260950784:12345-192.168.202.46@tcp:4:cat.0 00010000:00010000:3.0:1746065120.950480:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950488:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950499:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950505:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950509:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950513:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e26800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065120.950515:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950520:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950532:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950537:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26800/0x14b4f8542d4f2913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.950563:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260949632:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 22546us (23387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.950568:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10508 00010000:00010000:3.0:1746065120.950593:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950598:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950608:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950613:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950617:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950620:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b916400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065120.950622:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950627:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950634:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.950638:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b916400/0x14b4f8542d4f291a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.950661:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881260948992:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 22506us (23475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.950665:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10509 00000100:00100000:2.0:1746065120.950865:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259688704:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.950880:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065120.956049:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.958169:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260951424 00000100:00100000:1.0:1746065120.958179:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260951424 00010000:00010000:1.0:1746065120.958215:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac9 expref: 15 pid: 4544 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065120.958244:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5243 00000100:00100000:1.0:1746065120.958251:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260951424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.958263:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.958283:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac9 expref: 15 pid: 4544 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746065120.958294:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac9 expref: 15 pid: 4544 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746065120.958312:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013047d800/0x14b4f8542d4f283a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aac9 expref: 15 pid: 4544 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746065120.958329:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.958331:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.958335:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958342:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958382:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.958420:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260951424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 169us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.958425:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5243 00010000:00010000:1.0:1746065120.958446:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958453:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958469:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958476:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958481:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958487:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800900c8400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065120.958489:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958496:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958508:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.958512:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900c8400/0x14b4f8542d4f2928 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.958550:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260949504:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 30126us (31337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.958557:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10511 00000100:00100000:2.0:1746065120.960309:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260950016:12345-192.168.202.46@tcp:4:cat.0 Request processed in 11847us (11925us total) trans 17179872752 rc 0/0 00000100:00100000:2.0:1746065120.960318:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1491 00002000:00100000:2.0:1746065120.960327:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1294335) req@ffff88012e8b4000 x1830881260950016/t17179872752(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065120.960335:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4000 with x1830881260950016 ext(1048576->1294335) 00010000:00010000:2.0:1746065120.960343:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 14 pid: 8427 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065120.960365:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 14 pid: 8427 timeout: 820 lvb_type: 0 00002000:00010000:2.0:1746065120.960371:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e8b4000 00000100:00100000:2.0:1746065120.966548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.966713:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260951552 00000100:00100000:1.0:1746065120.966720:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260951552 00010000:00010000:1.0:1746065120.966750:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 14 pid: 8427 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065120.966775:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5244 00000100:00100000:1.0:1746065120.966782:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260951552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.966792:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.966810:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 14 pid: 8427 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065120.966845:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 14 pid: 8427 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065120.966865:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4f2856 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aae5 expref: 14 pid: 8427 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065120.966885:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.966887:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.966890:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.966898:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.966915:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065120.967247:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.967254:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.967270:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.967276:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.967286:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.967291:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec33200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065120.967295:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.967300:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.967308:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.967313:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4f290c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065120.967679:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260951552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 892us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.967686:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5244 00000100:00100000:2.0:1746065120.967738:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881260949376:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 39810us (40578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065120.967745:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10507 00000100:00100000:3.0:1746065120.975284:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260950784:12345-192.168.202.46@tcp:4:cat.0 Request processed in 25411us (25981us total) trans 21474839984 rc 0/0 00000100:00100000:3.0:1746065120.975296:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1492 00002000:00100000:3.0:1746065120.975308:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1335296->2097151) req@ffff88012e8b7100 x1830881260950784/t21474839984(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:36/0 lens 488/448 e 0 to 0 dl 1746065131 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065120.975318:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7100 with x1830881260950784 ext(1335296->2097151) 00010000:00010000:3.0:1746065120.975327:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065120.975342:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746065120.975357:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e8b7100 00000100:00100000:0.0:1746065120.987060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065120.987159:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260951680 00000100:00100000:1.0:1746065120.987166:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260951680 00010000:00010000:1.0:1746065120.987198:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065120.987233:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5245 00000100:00100000:1.0:1746065120.987241:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260951680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065120.987253:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065120.987272:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065120.987283:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065120.987308:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4f282c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aabb expref: 14 pid: 4544 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065120.987337:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.987339:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065120.987343:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.987359:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065120.987388:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065120.987423:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881260951680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 183us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065120.987429:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5245 00010000:00010000:3.0:1746065120.987937:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.987945:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.987963:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.987969:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.987975:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.987980:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093037000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065120.987983:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.987988:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.987997:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065120.988002:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093037000/0x14b4f8542d4f2921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065120.988563:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260949248:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 60277us (61364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065120.988569:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10510 00000100:00100000:0.0:1746065120.992982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065120.993046:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260951936 00000100:00100000:2.0:1746065120.993055:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260951936 00000100:00100000:2.0:1746065120.993109:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8976 00000100:00100000:2.0:1746065120.993118:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:28892:x1830881260951936:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:2.0:1746065120.993160:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065120.993181:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732200/0x14b4f8542d4f28db lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab40 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993212:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065120.993216:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065120.993240:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065120.993251:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 261 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993258:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993265:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 261 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993270:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8f4 expref: 17 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993276:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa59 expref: 261 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993281:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 8/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065120.993304:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa59 expref: 261 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993315:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa59 expref: 261 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.993329:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689216:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.993430:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8f4 expref: 17 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993438:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8f4 expref: 17 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.993445:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689344:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.993468:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 261 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993475:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 261 pid: 24350 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.993481:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689472:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.993515:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993522:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 17 pid: 14643 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.993528:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689600:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065120.993559:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 261 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065120.993571:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 261 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065120.993577:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689728:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065120.993592:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065120.997702:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689216:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.998330:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689344:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.998338:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689472:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.998344:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689600:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065120.998363:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259689728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065120.998390:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065120.999278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065120.999465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.000286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.000300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.000456:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260952064 00000100:00100000:1.0:1746065121.000464:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260952064 00010000:00010000:1.0:1746065121.000499:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa59 expref: 262 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065121.000519:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260952320 00000100:00100000:1.0:1746065121.000522:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260952320 00010000:00010000:1.0:1746065121.000530:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 263 pid: 24350 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065121.000541:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260952576 00000100:00100000:1.0:1746065121.000542:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260952576 00010000:00010000:1.0:1746065121.000549:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 264 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065121.000556:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260952192 00000100:00100000:1.0:1746065121.000558:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260952192 00010000:00010000:1.0:1746065121.000564:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8f4 expref: 18 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065121.000585:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5246 00000100:00100000:1.0:1746065121.000592:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1960:x1830881260952064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065121.000594:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5247 00000100:00100000:2.0:1746065121.000602:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1960:x1830881260952320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065121.000604:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.000607:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065121.000609:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa59 expref: 264 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.000611:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 264 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.000618:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa59 expref: 264 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.000657:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5248 00000100:00100000:3.0:1746065121.000665:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1960:x1830881260952576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.000671:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.000675:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 264 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746065121.000836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065121.000971:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065121.001152:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 264 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.001170:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f23fd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a806 expref: 264 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.001202:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 264 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.001216:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d537000/0x14b4f8542d4f23e1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a7f1 expref: 264 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.001224:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.001228:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.001235:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065121.001250:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.001254:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.001258:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.001266:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1960:x1830881260952320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 666us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.001270:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1960:x1830881260952576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 609us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.001272:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5247 00000100:00100000:3.0:1746065121.001275:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5248 00000100:00100000:3.0:1746065121.001285:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260952448 00000100:00100000:3.0:1746065121.001287:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260952448 00000100:00100000:2.0:1746065121.001287:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5249 00000100:00100000:2.0:1746065121.001292:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260952192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.001296:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 19 pid: 14643 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.001297:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.001300:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8f4 expref: 19 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.001305:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5250 00010000:00010000:2.0:1746065121.001307:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8f4 expref: 19 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.001309:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260952448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.001314:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.001316:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 19 pid: 14643 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.001317:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f255b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a8f4 expref: 19 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.001323:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 18 pid: 14643 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.001331:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00e7600/0x14b4f8542d4f23f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5a80d expref: 18 pid: 14643 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.001332:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.001335:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.001339:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.001339:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065121.001341:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.001345:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.001361:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260952192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.001365:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260952448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.001366:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5249 00000100:00100000:3.0:1746065121.001369:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5250 00010000:00010000:1.0:1746065121.001489:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500000/0x14b4f8542d4f278b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aa59 expref: 260 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.001505:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065121.001508:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.001513:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.001518:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.001888:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065121.001910:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1960:x1830881260952064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1318us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.001916:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5246 00010000:00010000:3.0:1746065121.002026:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.002033:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000040:00080000:3.0:1746065121.002727:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2484, 88 off208408 00000004:00080000:3.0:1746065121.002735:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720293919400ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065121.002789:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2429, 88 off203384 00000004:00080000:3.0:1746065121.002795:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720293979220ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065121.002835:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2430, 88 off203472 00000004:00080000:3.0:1746065121.002839:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720294023215ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065121.002848:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2485, 88 off208496 00000004:00080000:3.0:1746065121.002850:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720294034787ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065121.002856:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2486, 88 off208584 00000004:00080000:3.0:1746065121.002859:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720294043933ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065121.002866:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2431, 88 off203560 00000004:00080000:3.0:1746065121.002868:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720294052557ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065121.002874:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2432, 88 off203648 00000004:00080000:3.0:1746065121.002876:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720294060850ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065121.002882:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2433, 88 off203736 00000004:00080000:3.0:1746065121.002884:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720294068980ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065121.002890:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2487, 88 off208672 00000004:00080000:3.0:1746065121.002892:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720294076756ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065121.002898:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2434, 88 off203824 00000004:00080000:3.0:1746065121.002901:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720294085543ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065121.002906:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2488, 88 off208760 00000004:00080000:3.0:1746065121.002908:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720294092966ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065121.002913:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2435, 88 off203912 00000004:00080000:3.0:1746065121.002916:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720294100277ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065121.002922:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2489, 88 off208848 00000004:00080000:3.0:1746065121.002924:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720294108685ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065121.002930:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2490, 88 off208936 00000004:00080000:3.0:1746065121.002933:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720294117483ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065121.002939:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2491, 88 off209024 00000004:00080000:3.0:1746065121.002941:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720294126096ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065121.002947:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2492, 88 off209112 00000004:00080000:3.0:1746065121.002950:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720294134213ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065121.002956:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2436, 88 off204000 00000004:00080000:3.0:1746065121.002958:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720294143093ns, next at 666938887344ns, rc = 0 00000001:00080000:3.0:1746065121.019123:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943001 is committed 00000001:00080000:3.0:1746065121.019133:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942999 is committed 00000001:00080000:3.0:1746065121.019138:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943020 is committed 00000001:00080000:3.0:1746065121.019143:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943018 is committed 00000001:00080000:3.0:1746065121.019154:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943016 is committed 00000001:00080000:3.0:1746065121.019168:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943021 is committed 00000004:00080000:3.0:1746065121.019171:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1730 committed 00000004:00080000:3.0:1746065121.019177:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1786 committed 00000004:00080000:3.0:1746065121.019181:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1785 committed 00000004:00080000:3.0:1746065121.019183:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1784 committed 00000004:00080000:3.0:1746065121.019184:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1783 committed 00000004:00080000:3.0:1746065121.019185:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1729 committed 00000004:00080000:3.0:1746065121.019186:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1782 committed 00000004:00080000:3.0:1746065121.019188:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1728 committed 00000004:00080000:3.0:1746065121.019190:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1781 committed 00000004:00080000:3.0:1746065121.019191:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1727 committed 00000004:00080000:3.0:1746065121.019192:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1726 committed 00000004:00080000:3.0:1746065121.019194:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1725 committed 00000004:00080000:3.0:1746065121.019195:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1780 committed 00000004:00080000:3.0:1746065121.019196:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1779 committed 00000004:00080000:3.0:1746065121.019197:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1724 committed 00000004:00080000:3.0:1746065121.019199:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1723 committed 00000004:00080000:3.0:1746065121.019200:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1778 committed 00000001:00080000:3.0:1746065121.019203:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943017 is committed 00000100:00100000:3.0:1746065121.019232:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065121.019247:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259690240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.019259:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259690368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.019291:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259689984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.019291:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.019305:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.019320:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065121.019321:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259690368 00000100:00100000:0.0:1746065121.019323:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259690752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.019326:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259690368 00000100:00100000:0.0:1746065121.019335:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.019363:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259690112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.019370:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259689984 00000100:00100000:3.0:1746065121.019373:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259689984 00000100:00100000:0.0:1746065121.019379:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.019384:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259690752 00000100:00100000:3.0:1746065121.019386:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259690752 00000100:00100000:0.0:1746065121.019391:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259690624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.019394:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259690112 00000100:00100000:3.0:1746065121.019395:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259690112 00000100:00100000:0.0:1746065121.019402:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.019406:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259690624 00000100:00100000:3.0:1746065121.019407:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259690624 00000100:00100000:3.0:1746065121.019416:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10512 00000100:00080000:0.0:1746065121.019419:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065121.019422:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3296:x1830881259690368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.019428:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10513 00000100:00100000:0.0:1746065121.019432:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3297:x1830881259689984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.019464:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10514 00000100:00100000:0.0:1746065121.019468:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3296:x1830881259690752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.019539:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10515 00000100:00100000:3.0:1746065121.019543:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3298:x1830881259690112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.019568:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3296:x1830881259690752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (231us total) trans 21474839985 rc 0/0 00000100:00100000:0.0:1746065121.019574:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10514 00000100:00100000:0.0:1746065121.019585:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10516 00000100:00100000:0.0:1746065121.019589:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3298:x1830881259690624:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065121.019612:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd73b80/2, rc 0, transno 21474839985 00000100:00100000:0.0:1746065121.019616:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259690752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.019620:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3298:x1830881259690112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (241us total) trans 21474839987 rc 0/0 00000100:00100000:3.0:1746065121.019626:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10515 00000100:00100000:3.0:1746065121.019644:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259690496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.019659:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.019667:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3297:x1830881259689984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 235us (361us total) trans 21474839988 rc 0/0 00000100:00100000:0.0:1746065121.019672:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10513 00000004:00080000:3.0:1746065121.019677:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd70000/2, rc 0, transno 21474839988 00000100:00100000:0.0:1746065121.019679:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259690496 00000100:00100000:3.0:1746065121.019680:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259689984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.019681:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259690496 00000100:00100000:3.0:1746065121.019690:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.019693:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259690240 00000100:00100000:0.0:1746065121.019694:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259690240 00000100:00100000:3.0:1746065121.019699:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259689856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.019703:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10517 00000100:00100000:0.0:1746065121.019707:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881259690496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.019712:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.019726:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259689856 00000100:00100000:3.0:1746065121.019729:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259689856 00000100:00100000:3.0:1746065121.019739:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10518 00000100:00100000:3.0:1746065121.019743:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830881259690240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065121.019766:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065121.019769:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065121.019771:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065121.019773:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065121.019775:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065121.019795:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3297:x1830881259690496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (134us total) trans 21474839989 rc 0/0 00000100:00100000:0.0:1746065121.019799:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10517 00000100:00100000:0.0:1746065121.019811:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10519 00000100:00100000:3.0:1746065121.019812:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3295:x1830881259690240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (121us total) trans 21474839990 rc 0/0 00000100:00100000:0.0:1746065121.019830:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3295:x1830881259689856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.019831:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10518 00000004:00080000:3.0:1746065121.019851:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd72680/2, rc 0, transno 21474839990 00000100:00100000:3.0:1746065121.019854:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259690240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.019903:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3295:x1830881259689856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (190us total) trans 21474839991 rc 0/0 00000100:00100000:0.0:1746065121.019908:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10519 00000004:00080000:0.0:1746065121.019925:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd73800/2, rc 0, transno 21474839991 00000100:00100000:0.0:1746065121.019928:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259689856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065121.019940:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd71880/2, rc 0, transno 21474839987 00000100:00100000:0.0:1746065121.019943:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259690112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065121.019952:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd70e00/2, rc 0, transno 21474839989 00000100:00100000:0.0:1746065121.019955:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259690496:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065121.019979:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065121.019982:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065121.019984:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065121.019985:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065121.019987:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:0.0:1746065121.020003:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3296:x1830881259690368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 581us (712us total) trans 21474839986 rc 0/0 00000100:00100000:0.0:1746065121.020007:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10512 00000100:00100000:0.0:1746065121.020018:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259691264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020020:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259691136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065121.020033:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.020047:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259691776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020050:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.020060:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259691648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065121.020060:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.020068:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065121.020071:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259690880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020072:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.020081:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065121.020082:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.020084:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259691008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065121.020089:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259691392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020095:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.020100:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.020102:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259691520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020113:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065121.020118:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd70380/2, rc 0, transno 21474839986 00000100:00100000:0.0:1746065121.020121:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259690368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065121.020126:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259691264 00000100:00100000:1.0:1746065121.020128:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259691264 00000100:00100000:1.0:1746065121.020143:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259691136 00000100:00100000:1.0:1746065121.020145:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259691136 00000100:00100000:1.0:1746065121.020150:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259691776 00000100:00100000:1.0:1746065121.020151:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259691776 00000100:00100000:1.0:1746065121.020157:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259691648 00000100:00100000:1.0:1746065121.020158:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259691648 00000100:00100000:1.0:1746065121.020163:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259690880 00000100:00100000:1.0:1746065121.020164:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259690880 00000100:00100000:1.0:1746065121.020169:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259691008 00000100:00100000:1.0:1746065121.020171:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259691008 00000100:00100000:1.0:1746065121.020176:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259691392 00000100:00100000:1.0:1746065121.020177:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259691392 00002000:00010000:0.0:1746065121.020181:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1746065121.020182:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259691520 00002000:00010000:0.0:1746065121.020182:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:1.0:1746065121.020184:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259691520 00002000:00010000:0.0:1746065121.020184:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065121.020186:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065121.020188:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065121.020190:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10520 00000100:00100000:1.0:1746065121.020194:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3295:x1830881259691264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065121.020206:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881259690624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 617us (804us total) trans 21474839992 rc 0/0 00000100:00100000:0.0:1746065121.020211:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10516 00000100:00100000:0.0:1746065121.020219:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10521 00000100:00100000:0.0:1746065121.020223:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881259691136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065121.020272:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065121.020275:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.020276:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.020278:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.020279:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065121.020283:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3298:x1830881259691136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (232us total) trans 17179872754 rc 0/0 00000100:00100000:0.0:1746065121.020288:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10521 00000100:00100000:1.0:1746065121.020294:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881259691264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (261us total) trans 17179872753 rc 0/0 00000100:00100000:0.0:1746065121.020298:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10522 00000100:00100000:1.0:1746065121.020300:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10520 00000100:00100000:0.0:1746065121.020301:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881259691776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020307:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10523 00000100:00100000:1.0:1746065121.020310:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881259691648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020379:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3298:x1830881259691648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (306us total) trans 17179872756 rc 0/0 00000100:00100000:0.0:1746065121.020379:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259691776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (317us total) trans 17179872755 rc 0/0 00000100:00100000:0.0:1746065121.020383:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10522 00000100:00100000:1.0:1746065121.020393:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10523 00000100:00100000:1.0:1746065121.020401:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10524 00000100:00100000:1.0:1746065121.020405:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3295:x1830881259690880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.020431:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10525 00000100:00100000:2.0:1746065121.020438:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881259691008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020477:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881259690880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (395us total) trans 17179872757 rc 0/0 00000100:00100000:1.0:1746065121.020482:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10524 00000100:00100000:1.0:1746065121.020490:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10526 00000100:00100000:1.0:1746065121.020494:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881259691392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.020521:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259691008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (424us total) trans 17179872758 rc 0/0 00000100:00100000:2.0:1746065121.020525:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10525 00000100:00100000:2.0:1746065121.020533:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10527 00000100:00100000:2.0:1746065121.020537:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259691520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065121.020549:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065121.020551:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.020552:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.020554:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.020555:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065121.020571:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881259691392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (470us total) trans 17179872759 rc 0/0 00000100:00100000:1.0:1746065121.020576:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10526 00002000:00010000:2.0:1746065121.020591:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065121.020593:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065121.020595:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065121.020596:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00000004:00080000:1.0:1746065121.020596:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4eb480/2, rc 0, transno 17179872758 00002000:00010000:2.0:1746065121.020598:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065121.020601:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259691008:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065121.020606:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4e8700/2, rc 0, transno 17179872754 00000100:00100000:1.0:1746065121.020609:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259691136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.020613:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259691520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (499us total) trans 17179872760 rc 0/0 00000004:00080000:1.0:1746065121.020614:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4eaa00/2, rc 0, transno 17179872756 00000100:00100000:1.0:1746065121.020616:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259691648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.020618:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10527 00000004:00080000:1.0:1746065121.020622:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd71f80/2, rc 0, transno 21474839992 00000100:00100000:1.0:1746065121.020624:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259690624:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065121.020630:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4ead80/2, rc 0, transno 17179872760 00000100:00100000:1.0:1746065121.020632:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259691520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020659:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259691904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.020674:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.020688:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259691904 00000100:00100000:1.0:1746065121.020690:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259691904 00000100:00100000:0.0:1746065121.020712:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10528 00000100:00100000:0.0:1746065121.020721:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3296:x1830881259691904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065121.020787:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3296:x1830881259691904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (112us total) trans 17179872761 rc 0/0 00000100:00100000:0.0:1746065121.020792:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10528 00000004:00080000:1.0:1746065121.021373:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095350380/2, rc 0, transno 17179872761 00000100:00100000:1.0:1746065121.021378:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259691904:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746065121.021430:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746065121.021444:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4e9f80/2, rc 0, transno 17179872757 00000100:00100000:0.0:1746065121.021448:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259690880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065121.021453:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4e9180/2, rc 0, transno 17179872759 00000100:00100000:0.0:1746065121.021455:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259691392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065121.021460:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4ea680/2, rc 0, transno 17179872753 00000100:00100000:0.0:1746065121.021462:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259691264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065121.021467:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4e8e00/2, rc 0, transno 17179872755 00000100:00100000:0.0:1746065121.021469:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259691776:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746065121.021499:0:16767:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008fd72a00 reply state ffff88009bbc4800 transno 8589943021 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065121.021507:0:16767:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746065121.021564:0:16767:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065121.021585:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28892:x1830881260951936:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 28468us (28610us total) trans 8589943021 rc 0/0 00000100:00100000:3.0:1746065121.021591:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8976 00010000:00010000:2.0:1746065121.021641:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.021648:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.021654:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.021658:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d536a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065121.021662:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.021667:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.021681:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.021684:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065121.021687:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.021691:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d536a00/0x14b4f8542d4f292f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065121.022683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.022769:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260952704 00000100:00100000:3.0:1746065121.022774:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260952704 00000100:00100000:3.0:1746065121.022830:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8977 00000100:00100000:3.0:1746065121.022836:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28892:x1830881260952704:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065121.022849:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746065121.022869:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746065121.022950:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab5c expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.022984:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab5c expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.022993:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab5c expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.023005:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.023007:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065121.023009:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0133400, rc 0) 00000100:00100000:3.0:1746065121.023041:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28892:x1830881260952704:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 205us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.023045:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8977 00000100:00100000:0.0:1746065121.025209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.025303:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260952832 00000100:00100000:2.0:1746065121.025309:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260952832 00000100:00100000:2.0:1746065121.025340:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8978 00000100:00100000:2.0:1746065121.025346:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28892:x1830881260952832:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065121.025365:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.025375:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f293d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab63 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.025423:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae800/0x14b4f8542d4f2944 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.025430:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae800/0x14b4f8542d4f2944 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.025435:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae800/0x14b4f8542d4f2944 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065121.025450:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:2.0:1746065121.025453:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065121.025461:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae800/0x14b4f8542d4f2944 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.025475:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f293d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab63 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.025481:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae800/0x14b4f8542d4f2944 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab63 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.025485:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.025486:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065121.025488:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935ae800, rc 0) 00000100:00100000:2.0:1746065121.025515:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28892:x1830881260952832:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 169us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.025524:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8978 00000100:00100000:0.0:1746065121.026705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.026865:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260952960 00000100:00100000:2.0:1746065121.026869:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260952960 00000100:00100000:2.0:1746065121.026908:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10529 00000100:00100000:2.0:1746065121.026913:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881260952960:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065121.026922:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.026932:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab6a expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065121.027247:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e1, atime: 0x6812d6e1, ctime: 0x6812d6e1, blocks: 0x7f1 00010000:00010000:2.0:1746065121.027262:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.027264:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.027271:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab6a expref: 6 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.027282:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab6a expref: 6 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.027290:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935aea00, rc 0) 00000100:00080000:0.0:1746065121.027396:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065121.027437:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881260952960:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 523us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.027442:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10529 00000100:00100000:0.0:1746065121.028992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.029011:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.029138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.029285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.029386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.029416:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260953088 00000100:00100000:2.0:1746065121.029416:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260953216 00000100:00100000:3.0:1746065121.029421:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260953088 00000100:00100000:2.0:1746065121.029421:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260953216 00000100:00100000:2.0:1746065121.029445:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260953472 00000100:00100000:2.0:1746065121.029448:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260953472 00000100:00100000:3.0:1746065121.029449:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260953344 00000100:00100000:3.0:1746065121.029451:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260953344 00000100:00100000:2.0:1746065121.029460:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10530 00000100:00100000:3.0:1746065121.029465:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10531 00000100:00100000:2.0:1746065121.029466:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260953216:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:3.0:1746065121.029469:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260953088:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:3.0:1746065121.029482:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10532 00010000:00010000:2.0:1746065121.029482:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065121.029486:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260953472:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065121.029494:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.029496:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab78 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.029503:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab86 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065121.029512:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6e1, atime: 0x6812d6e1, ctime: 0x6812d6e1, blocks: 0x821 00002000:00010000:3.0:1746065121.029514:0:25185:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 4974112, mtime: 0x6812d6e1, atime: 0x6812d6e1, ctime: 0x6812d6e1, blocks: 0x1643 00010000:00010000:3.0:1746065121.029523:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.029523:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.029525:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.029525:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.029531:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab86 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.029531:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab78 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.029542:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab86 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.029542:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab78 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.029549:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0132e00, rc 0) 00010000:00010000:2.0:1746065121.029549:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935aee00, rc 0) 00000100:00100000:2.0:1746065121.029575:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260953216:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 109us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.029580:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10530 00000100:00100000:2.0:1746065121.029588:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260953600 00000100:00100000:2.0:1746065121.029591:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260953600 00000100:00100000:2.0:1746065121.029601:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10533 00000100:00100000:2.0:1746065121.029605:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260953344:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065121.029609:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.029615:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab7f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065121.029624:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6e1, atime: 0x6812d6df, ctime: 0x6812d6e1, blocks: 0x821 00010000:00010000:2.0:1746065121.029630:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.029631:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.029634:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab7f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.029641:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab7f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.029647:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935af000, rc 0) 00000100:00100000:1.0:1746065121.029665:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10534 00000100:00100000:1.0:1746065121.029672:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260953600:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.029678:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.029684:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab8d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065121.029697:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6e1, atime: 0x6812d6e0, ctime: 0x6812d6e1, blocks: 0x102b 00010000:00010000:1.0:1746065121.029707:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.029709:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.029713:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab8d expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.029721:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab8d expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.029726:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7c000, rc 0) 00000100:00100000:3.0:1746065121.029867:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260953472:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 379us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.029871:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10532 00010000:00010000:3.0:1746065121.029888:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.029896:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab71 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065121.029905:0:21235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6e1, atime: 0x6812d6e0, ctime: 0x6812d6e0, blocks: 0x81d 00010000:00010000:3.0:1746065121.029911:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.029912:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.029916:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab71 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.029925:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab71 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.029931:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0132800, rc 0) 00000100:00100000:3.0:1746065121.029944:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881260953088:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 475us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.029949:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10531 00000100:00100000:2.0:1746065121.030104:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260953344:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 498us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.030110:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10533 00000100:00100000:1.0:1746065121.030193:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260953600:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 521us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.030197:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10534 00000100:00100000:0.0:1746065121.044682:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.045390:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260954112 00000100:00100000:3.0:1746065121.045398:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260954112 00000100:00100000:3.0:1746065121.045462:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4815 00000100:00100000:3.0:1746065121.045470:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260954112:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065121.045500:0:21488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.045512:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.045514:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.045517:0:21488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.045528:0:21488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.046020:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.046567:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260953984 00000100:00100000:2.0:1746065121.046572:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260953984 00000100:00100000:2.0:1746065121.046601:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4816 00000100:00100000:2.0:1746065121.046606:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260953984:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065121.046623:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.046631:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.046632:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.046635:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.046643:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.047718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.048323:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260954368 00000100:00100000:3.0:1746065121.048329:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260954368 00000100:00100000:3.0:1746065121.048379:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4817 00000100:00100000:3.0:1746065121.048386:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260954368:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065121.048410:0:21485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.048424:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.048426:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.048429:0:21485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.048439:0:21485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.056799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.058228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.058251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.058785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.058895:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260954624 00000100:00100000:2.0:1746065121.058903:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260954624 00000100:00100000:2.0:1746065121.058945:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260955136 00000100:00100000:2.0:1746065121.058947:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260955136 00000100:00100000:2.0:1746065121.058958:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260954752 00000100:00100000:2.0:1746065121.058960:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260954752 00000100:00100000:2.0:1746065121.058969:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260955392 00000100:00100000:2.0:1746065121.058971:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260955392 00000100:00100000:2.0:1746065121.058985:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4818 00000100:00100000:2.0:1746065121.058992:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260954624:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065121.059021:0:21486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.059033:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.059035:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.059039:0:21486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.059050:0:21486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.059170:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4819 00000100:00100000:3.0:1746065121.059178:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260955136:12345-192.168.202.46@tcp:3:lfs.0 00000100:00100000:0.0:1746065121.059263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.059277:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260955520 00000100:00100000:0.0:1746065121.059280:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260955520 00000100:00100000:0.0:1746065121.059298:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4820 00000100:00100000:0.0:1746065121.059302:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260954752:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065121.059314:0:21487:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.059320:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.059321:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.059324:0:21487:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.059331:0:21487:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.059398:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4821 00000100:00100000:1.0:1746065121.059406:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1960:x1830881260955392:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065121.059422:0:21481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.059429:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.059430:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.059433:0:21481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.059440:0:21481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.059524:0:8433:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.059530:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.059532:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.059534:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.059541:0:8433:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.060079:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4822 00000100:00100000:2.0:1746065121.060087:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1960:x1830881260955520:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065121.060105:0:21482:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.060113:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.060114:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.060118:0:21482:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.060132:0:21482:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.063847:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.063862:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.063870:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.063876:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935af400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065121.063880:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.063887:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.063902:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.063908:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935af400/0x14b4f8542d4f297c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.063963:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1960:x1830881260953984:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 17353us (17940us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.063975:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4816 00010000:00010000:1.0:1746065121.066519:0:21485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.066535:0:21485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.066542:0:21485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.066547:0:21485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0133c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065121.066550:0:21485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.066557:0:21485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.066571:0:21485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.066576:0:21485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0133c00/0x14b4f8542d4f2983 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.066632:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881260954368:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 18244us (18912us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.066641:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4817 00010000:00010000:2.0:1746065121.070471:0:21488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.070485:0:21488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.070492:0:21488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.070498:0:21488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0132400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065121.070502:0:21488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.070508:0:21488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.070524:0:21488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.070529:0:21488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f2975 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.070584:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1960:x1830881260954112:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 25111us (25905us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.070592:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4815 00010000:00010000:3.0:1746065121.082344:0:8433:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.082369:0:8433:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.082376:0:8433:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.082383:0:8433:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0132200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065121.082387:0:8433:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.082393:0:8433:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.082408:0:8433:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.082413:0:8433:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0132200/0x14b4f8542d4f299f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.083189:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260955136:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 23818us (24771us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.083199:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4819 00010000:00010000:1.0:1746065121.086229:0:21487:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.086247:0:21487:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.086254:0:21487:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.086260:0:21487:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cdcc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065121.086264:0:21487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.086270:0:21487:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.086284:0:21487:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.086290:0:21487:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cdcc00/0x14b4f8542d4f2991 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.086380:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260954752:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 27073us (28124us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.086388:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4820 00010000:00010000:1.0:1746065121.092287:0:21481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.092301:0:21481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.092313:0:21481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.092319:0:21481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090b1de00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065121.092323:0:21481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.092329:0:21481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.092344:0:21481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.092360:0:21481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f2998 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.093026:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881260955392:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 33617us (34236us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.093035:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4821 00010000:00010000:2.0:1746065121.093243:0:21486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.093254:0:21486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.093260:0:21486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.093266:0:21486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935afe00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065121.093268:0:21486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.093274:0:21486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.093285:0:21486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.093291:0:21486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935afe00/0x14b4f8542d4f298a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.093339:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260954624:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 34346us (36546us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.093346:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4818 00010000:00010000:0.0:1746065121.102307:0:21482:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.102323:0:21482:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.102331:0:21482:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.102336:0:21482:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935ae600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065121.102340:0:21482:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.102347:0:21482:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.102379:0:21482:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.102385:0:21482:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f29a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.102483:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260955520:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 42393us (43215us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065121.102493:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4822 00000100:00100000:0.0:1746065121.114918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.115266:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260955904 00000100:00100000:2.0:1746065121.115274:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260955904 00000100:00100000:2.0:1746065121.115308:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8979 00000100:00100000:2.0:1746065121.115315:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28892:x1830881260955904:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:2.0:1746065121.115369:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.115389:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae800/0x14b4f8542d4f2944 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab63 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.115406:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.115410:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065121.115438:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.115448:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.115455:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00010000:2.0:1746065121.115601:0:16767:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d7fed80 reply state ffff88009469f000 transno 8589943022 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065121.115607:0:16767:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065121.115676:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28892:x1830881260955904:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 360us (764us total) trans 8589943022 rc 0/0 00000100:00100000:2.0:1746065121.115691:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8979 00010000:00010000:2.0:1746065121.117574:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.117605:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.117611:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.117615:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935ae400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065121.117620:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.117626:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.117636:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.117639:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065121.117642:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.117646:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29ad lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065121.117796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.117845:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260956032 00000100:00100000:1.0:1746065121.117851:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260956032 00000100:00100000:1.0:1746065121.117881:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10535 00000100:00100000:1.0:1746065121.117887:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28892:x1830881260956032:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.117898:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.117908:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab94 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.117939:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab6a expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.117945:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.117947:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.117950:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 9 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.117972:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab6a expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.117986:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab6a expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065121.117996:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259692032:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.118072:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.120009:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259692032:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.120035:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 9 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.120048:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1d600, rc 0) 00000100:00100000:1.0:1746065121.120179:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28892:x1830881260956032:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2291us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.120187:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10535 00000100:00100000:0.0:1746065121.120344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.120441:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260956160 00000100:00100000:1.0:1746065121.120446:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260956160 00010000:00010000:1.0:1746065121.120464:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab6a expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065121.120485:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5251 00000100:00100000:1.0:1746065121.120490:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260956160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065121.120499:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065121.120515:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab6a expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746065121.120524:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab6a expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746065121.120540:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935aea00/0x14b4f8542d4f294b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab6a expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746065121.120748:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.120750:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.120756:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 8 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.120764:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 8 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.120785:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 8 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.120795:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259692160:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065121.121113:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.122344:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259692160:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065121.122370:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065121.122408:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260956160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1917us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.122416:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5251 00000100:00100000:0.0:1746065121.122546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.122707:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260956288 00000100:00100000:1.0:1746065121.122713:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260956288 00000100:00100000:1.0:1746065121.123196:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10536 00000100:00100000:1.0:1746065121.123204:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28892:x1830881260956288:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.123222:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.123238:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ab9b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.123260:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab71 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.123266:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.123268:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.123270:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.123289:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab71 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.123299:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab71 expref: 13 pid: 21235 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065121.123428:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259692288:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.123633:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.126087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.126354:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260956416 00000100:00100000:0.0:1746065121.126361:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260956416 00010000:00010000:0.0:1746065121.126384:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab71 expref: 14 pid: 21235 timeout: 820 lvb_type: 1 00000100:00100000:0.0:1746065121.126458:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5252 00000100:00100000:0.0:1746065121.126465:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881260956416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.126475:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065121.126492:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab71 expref: 14 pid: 21235 timeout: 820 lvb_type: 1 00010000:00010000:0.0:1746065121.126503:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab71 expref: 14 pid: 21235 timeout: 820 lvb_type: 1 00010000:00010000:0.0:1746065121.126521:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.126522:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.126527:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.126534:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.126556:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.126565:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259692416:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065121.126601:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0132800/0x14b4f8542d4f296e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab71 expref: 14 pid: 21235 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065121.126617:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259692288:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065121.126628:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be300 going to sleep for 11 seconds 00010000:00010000:1.0:1746065121.126642:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.126654:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1d400, rc 0) 00000100:00100000:1.0:1746065121.126676:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28892:x1830881260956288:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3473us (4131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.126682:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10536 00000100:00100000:0.0:1746065121.129159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.129493:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259692416:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065121.129508:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.129549:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260956416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3083us (3466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.129558:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5252 00000100:00100000:1.0:1746065121.129561:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260956544 00000100:00100000:1.0:1746065121.129565:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260956544 00000100:00100000:1.0:1746065121.129589:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10537 00000100:00100000:1.0:1746065121.129594:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28892:x1830881260956544:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.129607:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.129619:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aba2 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.129640:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab78 expref: 13 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.129651:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.129653:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.129656:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.129676:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab78 expref: 13 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.129686:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab78 expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065121.129694:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259692544:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.129728:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.132374:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259692544:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.132399:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.132412:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1d200, rc 0) 00000100:00100000:1.0:1746065121.132440:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28892:x1830881260956544:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2846us (3289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.132447:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10537 00000100:00100000:0.0:1746065121.134878:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.134919:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260956672 00000100:00100000:2.0:1746065121.134926:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260956672 00010000:00010000:2.0:1746065121.134953:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab78 expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746065121.134987:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5253 00000100:00100000:2.0:1746065121.134993:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881260956672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.135005:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.135021:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab78 expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:2.0:1746065121.135036:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab78 expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:2.0:1746065121.135052:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2952 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab78 expref: 13 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:2.0:1746065121.135076:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.135077:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.135083:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.135090:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.135115:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.135124:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259692672:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.135545:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.136644:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259692672:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065121.136656:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.136687:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881260956672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1693us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.136694:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5253 00000100:00100000:0.0:1746065121.136958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.137146:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260956800 00000100:00100000:1.0:1746065121.137150:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260956800 00000100:00100000:1.0:1746065121.137181:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10538 00000100:00100000:1.0:1746065121.137186:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28892:x1830881260956800:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.137199:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.137211:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aba9 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.137230:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab7f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.137236:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.137238:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.137240:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 9 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.137256:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab7f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.137264:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab7f expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065121.137273:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259692800:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.138634:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.143870:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259692800:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.143899:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 9 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.143915:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1d000, rc 0) 00000100:00100000:1.0:1746065121.143961:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28892:x1830881260956800:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6773us (7002us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.143969:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10538 00000100:00100000:0.0:1746065121.144842:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.144969:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260956928 00000100:00100000:3.0:1746065121.144975:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260956928 00010000:00010000:3.0:1746065121.144999:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab7f expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065121.145020:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5254 00000100:00100000:3.0:1746065121.145026:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260956928:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.145037:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.145052:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab7f expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065121.145063:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab7f expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065121.145076:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935af000/0x14b4f8542d4f2960 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab7f expref: 9 pid: 21998 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065121.145178:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.145180:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.145186:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 8 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.145194:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 8 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.145219:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 8 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.145229:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259692928:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.145303:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d609c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.148410:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.148455:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259692928:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.148470:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.148515:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260956928:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3488us (3673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.148525:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5254 00000100:00100000:1.0:1746065121.148615:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260957056 00000100:00100000:1.0:1746065121.148621:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260957056 00000100:00100000:1.0:1746065121.148645:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10539 00000100:00100000:1.0:1746065121.148651:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28892:x1830881260957056:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.148663:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.148674:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abb0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.148693:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab86 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.148699:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.148701:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.148704:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 9 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.148723:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab86 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.148733:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab86 expref: 9 pid: 25185 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065121.148742:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259693056:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.148793:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.151012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.151244:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260957184 00000100:00100000:3.0:1746065121.151250:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260957184 00010000:00010000:3.0:1746065121.151276:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab86 expref: 10 pid: 25185 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065121.151299:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5255 00000100:00100000:3.0:1746065121.151305:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260957184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.151315:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.151332:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab86 expref: 10 pid: 25185 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065121.151341:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab86 expref: 10 pid: 25185 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065121.151370:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.151373:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.151378:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 10 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.151385:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 10 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.151408:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 10 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.151417:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259693184:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.151480:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d600c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065121.151545:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0132e00/0x14b4f8542d4f2959 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab86 expref: 10 pid: 25185 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065121.151559:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259693056:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.151577:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 9 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.151584:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1ce00, rc 0) 00000100:00100000:1.0:1746065121.151602:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28892:x1830881260957056:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2951us (3198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.151608:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10539 00000100:00100000:0.0:1746065121.154544:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.154668:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259693184:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065121.154673:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260957312 00000100:00100000:1.0:1746065121.154678:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260957312 00010000:00010000:3.0:1746065121.154685:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.154716:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260957184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3411us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.154724:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5255 00000100:00100000:1.0:1746065121.154724:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10540 00000100:00100000:1.0:1746065121.154730:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28892:x1830881260957312:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.154744:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.155372:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abb7 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.155396:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab8d expref: 13 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.155402:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.155403:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.155406:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.155427:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab8d expref: 13 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.155438:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab8d expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746065121.155448:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259693312:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.155492:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.156969:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259693312:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.156991:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.157002:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1cc00, rc 0) 00000100:00100000:1.0:1746065121.157028:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28892:x1830881260957312:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2298us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.157035:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10540 00000100:00100000:0.0:1746065121.159133:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.159195:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260957440 00000100:00100000:3.0:1746065121.159202:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260957440 00010000:00010000:3.0:1746065121.159226:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab8d expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746065121.159246:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5256 00000100:00100000:3.0:1746065121.159253:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260957440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.159262:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.159278:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab8d expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065121.159287:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab8d expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065121.159304:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f2967 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab8d expref: 13 pid: 8427 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746065121.159327:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.159328:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.159334:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.159340:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.159372:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.159381:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259693440:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.159432:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d600c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.160488:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259693440:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.160499:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.160686:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260957440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1431us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.160693:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5256 00000100:00100000:0.0:1746065121.161563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.161626:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260957568 00000100:00100000:1.0:1746065121.161632:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260957568 00000100:00100000:1.0:1746065121.161874:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10541 00000100:00100000:1.0:1746065121.161881:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260957568:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065121.162071:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065121.162074:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.162076:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.162078:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065121 -> 1746065122 00002000:00010000:1.0:1746065121.162079:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:1.0:1746065121.162116:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260957568:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 235us (554us total) trans 17179872762 rc 0/0 00000100:00100000:1.0:1746065121.162121:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10541 00000100:00100000:0.0:1746065121.163029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.163045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.163055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.163067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.163099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.163266:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260957696 00000100:00100000:3.0:1746065121.163272:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260957696 00000100:00100000:3.0:1746065121.163292:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260957824 00000100:00100000:3.0:1746065121.163294:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260957824 00000100:00100000:3.0:1746065121.163303:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260958080 00000100:00100000:3.0:1746065121.163304:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260958080 00000100:00100000:3.0:1746065121.163312:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260957952 00000100:00100000:3.0:1746065121.163314:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260957952 00000100:00100000:3.0:1746065121.163321:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260958208 00000100:00100000:3.0:1746065121.163322:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260958208 00000100:00100000:3.0:1746065121.163331:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10542 00000100:00100000:3.0:1746065121.163336:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260957696:12345-192.168.202.46@tcp:2:lfs.0 00000100:00100000:1.0:1746065121.163529:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10543 00000100:00100000:1.0:1746065121.163536:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260957824:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065121.163614:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065121.163617:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.163619:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.163620:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065121 -> 1746065122 00002000:00010000:1.0:1746065121.163622:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065121.163646:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1961:x1830881260957824:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 111us (600us total) trans 21474839993 rc 0/0 00000100:00100000:1.0:1746065121.163651:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10543 00000100:00100000:1.0:1746065121.163661:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10544 00000100:00100000:1.0:1746065121.163666:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260958080:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065121.163729:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 4974112 -> 4974112 00002000:00010000:1.0:1746065121.163731:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.163733:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.163734:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065121 -> 1746065122 00002000:00010000:1.0:1746065121.163736:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5699 -> 5699 00000100:00100000:1.0:1746065121.163751:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260958080:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 84us (694us total) trans 17179872763 rc 0/0 00000100:00100000:1.0:1746065121.163755:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10544 00000100:00100000:1.0:1746065121.163764:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10545 00000100:00100000:1.0:1746065121.163768:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260957952:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065121.163841:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065121.163843:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.163845:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065119 -> 1746065121 00002000:00010000:1.0:1746065121.163846:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065121 -> 1746065122 00002000:00010000:1.0:1746065121.163848:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065121.163863:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881260957952:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 94us (794us total) trans 17179872764 rc 0/0 00000100:00100000:1.0:1746065121.163868:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10545 00000100:00100000:1.0:1746065121.163877:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10546 00000100:00100000:1.0:1746065121.163881:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260958208:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065121.163935:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065121.163938:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.163939:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065120 -> 1746065121 00002000:00010000:1.0:1746065121.163941:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065121 -> 1746065122 00002000:00010000:1.0:1746065121.163942:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746065121.163957:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1961:x1830881260958208:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 75us (858us total) trans 21474839994 rc 0/0 00000100:00100000:1.0:1746065121.163962:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10546 00002000:00010000:3.0:1746065121.164663:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065121.164667:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:3.0:1746065121.164668:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065120 -> 1746065121 00002000:00010000:3.0:1746065121.164670:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065120 -> 1746065122 00002000:00010000:3.0:1746065121.164672:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065121.164689:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1961:x1830881260957696:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 1352us (1661us total) trans 21474839995 rc 0/0 00000100:00100000:3.0:1746065121.164693:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10542 00000100:00100000:0.0:1746065121.166957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.168227:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260958464 00000100:00100000:2.0:1746065121.168235:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260958464 00000100:00100000:2.0:1746065121.168325:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3653 00000100:00100000:2.0:1746065121.168332:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28892:x1830881260958464:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:2.0:1746065121.168389:0:1385:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x309:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732e00/0x14b4f8542d4f28f7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab55 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.168423:0:1385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065121.168432:0:1385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab5c expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.168438:0:1385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065121.168460:0:1385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab5c expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.168469:0:1385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab5c expref: 9 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.168480:0:1385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:1385:1830881259693568:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.168865:0:1385:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.172207:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.172529:0:1385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:1385:1830881259693568:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.172548:0:1385:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00000100:00100000:3.0:1746065121.172900:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260958592 00000100:00100000:3.0:1746065121.172906:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260958592 00010000:00010000:3.0:1746065121.172931:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab5c expref: 10 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.172952:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5257 00000100:00100000:3.0:1746065121.172958:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260958592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.172968:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.172973:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab5c expref: 10 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.172982:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab5c expref: 10 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.172999:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f2936 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab5c expref: 10 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.173443:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.173449:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00010000:00010000:3.0:1746065121.173457:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1385 initiator: MDT0 00010000:00010000:3.0:1746065121.173463:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 1385 initiator: MDT0 00010000:00010000:3.0:1746065121.173490:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.173532:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260958592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 573us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.173538:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5257 00010000:00010000:2.0:1746065121.173592:0:1385:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065121.173601:0:1385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00000040:00080000:2.0:1746065121.174611:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2493, 88 off209200 00000004:00080000:2.0:1746065121.174617:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720465801162ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.174653:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2437, 88 off204088 00000004:00080000:2.0:1746065121.174657:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720465841592ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.174667:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2438, 88 off204176 00000004:00080000:2.0:1746065121.174669:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720465853976ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.174676:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2494, 88 off209288 00000004:00080000:2.0:1746065121.174678:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720465863161ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.174684:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2495, 88 off209376 00000004:00080000:2.0:1746065121.174688:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720465872704ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.174694:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2439, 88 off204264 00000004:00080000:2.0:1746065121.174697:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720465881254ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.174702:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2440, 88 off204352 00000004:00080000:2.0:1746065121.174705:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720465889504ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.174711:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2441, 88 off204440 00000004:00080000:2.0:1746065121.174713:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720465897626ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.174719:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2496, 88 off209464 00000004:00080000:2.0:1746065121.174721:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720465905886ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.174727:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2442, 88 off204528 00000004:00080000:2.0:1746065121.174729:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720465913945ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.174735:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2497, 88 off209552 00000004:00080000:2.0:1746065121.174737:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720465922031ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.174743:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2443, 88 off204616 00000004:00080000:2.0:1746065121.174746:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720465930969ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.174752:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2498, 88 off209640 00000004:00080000:2.0:1746065121.174754:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720465938564ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.174759:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2499, 88 off209728 00000004:00080000:2.0:1746065121.174761:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720465946322ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.174767:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2500, 88 off209816 00000004:00080000:2.0:1746065121.174770:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720465954475ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.174775:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2501, 88 off209904 00000004:00080000:2.0:1746065121.174777:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720465961944ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.174783:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2444, 88 off204704 00000004:00080000:2.0:1746065121.174785:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720465970001ns, next at 666938887344ns, rc = 0 00000004:00010000:2.0:1746065121.197806:0:1385:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b87b850 reply state ffff880094cb7800 transno 8589943023 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00000100:00100000:2.0:1746065121.197840:0:1385:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065121.197848:0:1385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.197850:0:1385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065121.197858:0:1385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732e00/0x14b4f8542d4f28f7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab55 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.197940:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28892:x1830881260958464:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 29607us (30987us total) trans 8589943023 rc 0/0 00000100:00100000:2.0:1746065121.197947:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3653 00000001:00080000:3.0:1746065121.198031:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943023 is committed 00000004:00080000:3.0:1746065121.198036:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1738 committed 00000004:00080000:3.0:1746065121.198041:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1795 committed 00000004:00080000:3.0:1746065121.198045:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1794 committed 00000004:00080000:3.0:1746065121.198046:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1793 committed 00000004:00080000:3.0:1746065121.198048:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1792 committed 00000004:00080000:3.0:1746065121.198049:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1737 committed 00000004:00080000:3.0:1746065121.198050:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1791 committed 00000004:00080000:3.0:1746065121.198051:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1736 committed 00000004:00080000:3.0:1746065121.198052:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1790 committed 00000004:00080000:3.0:1746065121.198053:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1735 committed 00000004:00080000:3.0:1746065121.198054:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1734 committed 00000004:00080000:3.0:1746065121.198056:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1733 committed 00000004:00080000:3.0:1746065121.198057:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1789 committed 00000004:00080000:3.0:1746065121.198058:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1788 committed 00000004:00080000:3.0:1746065121.198060:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1732 committed 00000004:00080000:3.0:1746065121.198061:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1731 committed 00000004:00080000:3.0:1746065121.198062:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1787 committed 00000100:00100000:1.0:1746065121.198252:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259693696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.198283:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.198320:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259694208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.198331:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.198342:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746065121.198345:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259693824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.198366:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.198373:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259694336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.198382:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.198395:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259694080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.198406:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.198414:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259694592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.198423:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.198431:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065121.198434:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259693952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.198443:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.198450:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259694464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.198458:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.198477:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259693696 00000100:00100000:1.0:1746065121.198482:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259693696 00000100:00100000:1.0:1746065121.198500:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259694208 00000100:00100000:1.0:1746065121.198502:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259694208 00000100:00100000:1.0:1746065121.198509:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259693824 00000100:00100000:1.0:1746065121.198510:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259693824 00000100:00100000:1.0:1746065121.198514:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259694336 00000100:00100000:1.0:1746065121.198516:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259694336 00000100:00100000:1.0:1746065121.198520:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259694080 00000100:00100000:1.0:1746065121.198521:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259694080 00000100:00100000:1.0:1746065121.198525:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259694592 00000100:00100000:1.0:1746065121.198526:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259694592 00000100:00100000:1.0:1746065121.198531:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259693952 00000100:00100000:1.0:1746065121.198532:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259693952 00000100:00100000:1.0:1746065121.198536:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259694464 00000100:00100000:1.0:1746065121.198537:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259694464 00000100:00100000:1.0:1746065121.198543:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10547 00000100:00100000:1.0:1746065121.198548:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3297:x1830881259693696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065121.198594:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259694976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.198618:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.198628:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259695488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.198639:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.198646:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065121.198650:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259695104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.198660:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.198666:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259695616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.198675:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065121.198683:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065121.198686:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.198689:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.198691:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:1.0:1746065121.198692:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:3.0:1746065121.198843:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259694976 00000100:00100000:3.0:1746065121.198846:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259694976 00000100:00100000:3.0:1746065121.198858:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259695488 00000100:00100000:3.0:1746065121.198859:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259695488 00000100:00100000:3.0:1746065121.198864:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259695104 00000100:00100000:3.0:1746065121.198866:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259695104 00000100:00100000:3.0:1746065121.198870:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259695616 00000100:00100000:3.0:1746065121.198871:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259695616 00000100:00100000:3.0:1746065121.198878:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10548 00000100:00100000:3.0:1746065121.198881:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881259694208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065121.198943:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065121.198945:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065121.198947:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065121.198948:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065121.198950:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:2.0:1746065121.199326:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065121.199333:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065121.199339:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065121.199345:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935ae400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065121.199356:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065121.199362:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065121.199373:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.199375:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065121.199377:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065121.199381:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae400/0x14b4f8542d4f29de lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1385 initiator: MDT0 00000100:00100000:2.0:1746065121.199400:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10549 00000100:00100000:2.0:1746065121.199405:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881259693824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065121.199473:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065121.199475:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:2.0:1746065121.199477:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:2.0:1746065121.199478:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:2.0:1746065121.199480:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065121.200064:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10550 00000100:00100000:0.0:1746065121.200072:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3297:x1830881259694336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065121.200150:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065121.200153:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065121.200155:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065121.200157:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065121.200158:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065121.200320:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3297:x1830881259694208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1436us (1986us total) trans 17179872766 rc 0/0 00000100:00100000:3.0:1746065121.200327:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10548 00000100:00100000:3.0:1746065121.200341:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10551 00000100:00100000:3.0:1746065121.200354:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3296:x1830881259694080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.200486:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3297:x1830881259693824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1081us (2118us total) trans 17179872767 rc 0/0 00000100:00100000:0.0:1746065121.200489:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3297:x1830881259694336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 418us (2105us total) trans 17179872768 rc 0/0 00000100:00100000:2.0:1746065121.200491:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10549 00000100:00100000:0.0:1746065121.200495:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10550 00000100:00100000:2.0:1746065121.200501:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10552 00000100:00100000:0.0:1746065121.200506:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10553 00000100:00100000:2.0:1746065121.200507:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881259694592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065121.200511:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881259693952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.200519:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10554 00000100:00100000:0.0:1746065121.200524:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259694848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065121.200525:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881259694464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065121.200545:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.200561:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259695360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.200576:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.200585:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065121.200589:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259694720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.200600:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.200606:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259695232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.200615:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065121.200641:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c127100/2, rc 0, transno 17179872767 00000100:00100000:1.0:1746065121.200694:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881259693696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2144us (2408us total) trans 17179872765 rc 0/0 00000100:00100000:1.0:1746065121.200700:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10547 00000100:00100000:0.0:1746065121.200704:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259693824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.200710:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259694848 00000100:00100000:1.0:1746065121.200713:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259694848 00000004:00080000:0.0:1746065121.200715:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095351500/2, rc 0, transno 17179872768 00000100:00100000:0.0:1746065121.200718:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259694336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065121.200724:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c126d80/2, rc 0, transno 17179872765 00000100:00100000:1.0:1746065121.200725:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259695360 00000100:00100000:0.0:1746065121.200726:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259693696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.200727:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259695360 00000100:00100000:1.0:1746065121.200732:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259694720 00000004:00080000:0.0:1746065121.200732:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095351c00/2, rc 0, transno 17179872766 00000100:00100000:1.0:1746065121.200733:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259694720 00000100:00100000:0.0:1746065121.200734:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259694208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.200738:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259695232 00000100:00100000:1.0:1746065121.200739:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259695232 00000100:00100000:1.0:1746065121.200746:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10555 00000100:00100000:1.0:1746065121.200750:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881259694976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.200764:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065121.200768:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259695744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065121.200782:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065121.200866:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065121.200869:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.200870:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.200872:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:1.0:1746065121.200873:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746065121.200896:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881259694976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (2277us total) trans 21474839996 rc 0/0 00000100:00100000:1.0:1746065121.200900:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10555 00000004:00080000:0.0:1746065121.200906:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc59500/2, rc 0, transno 21474839996 00000100:00100000:1.0:1746065121.200909:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259695744 00000100:00100000:0.0:1746065121.200910:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259694976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065121.200911:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259695744 00000100:00100000:1.0:1746065121.200921:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10556 00000100:00100000:1.0:1746065121.200924:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881259695488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065121.200978:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065121.200981:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.200982:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.200983:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.200985:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065121.201022:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881259695488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (2381us total) trans 21474839997 rc 0/0 00000100:00100000:1.0:1746065121.201027:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10556 00000100:00100000:1.0:1746065121.201036:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10557 00000100:00100000:1.0:1746065121.201041:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881259695104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.201045:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10558 00000100:00100000:3.0:1746065121.201052:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881259695616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065121.201109:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881259695104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (2447us total) trans 21474839998 rc 0/0 00000100:00100000:1.0:1746065121.201113:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10557 00000100:00100000:1.0:1746065121.201120:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10559 00000100:00100000:1.0:1746065121.201123:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881259694848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065121.201172:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065121.201174:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.201176:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.201177:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:1.0:1746065121.201179:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065121.201196:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3298:x1830881259694848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (650us total) trans 21474839999 rc 0/0 00000100:00100000:1.0:1746065121.201203:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10559 00000100:00100000:1.0:1746065121.201212:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10560 00000100:00100000:1.0:1746065121.201216:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881259695360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065121.201271:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065121.201272:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.201274:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.201275:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.201277:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:0.0:1746065121.201277:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc58380/2, rc 0, transno 21474839998 00000100:00100000:0.0:1746065121.201281:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259695104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065121.201288:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc59f80/2, rc 0, transno 21474839997 00000100:00100000:0.0:1746065121.201291:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259695488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065121.201294:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3298:x1830881259695360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (717us total) trans 21474840000 rc 0/0 00000100:00100000:1.0:1746065121.201299:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10560 00000004:00080000:0.0:1746065121.201301:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc5aa00/2, rc 0, transno 21474839999 00000100:00100000:0.0:1746065121.201304:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259694848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065121.201308:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10561 00000004:00080000:0.0:1746065121.201309:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc59180/2, rc 0, transno 21474840000 00000100:00100000:1.0:1746065121.201312:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881259694720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065121.201312:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259695360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.201392:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10562 00000100:00100000:3.0:1746065121.201398:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3298:x1830881259695232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.201451:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10563 00000100:00100000:3.0:1746065121.201457:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3298:x1830881259695744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065121.201487:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065121.201489:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065121.201491:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065121.201492:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065121.201493:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065121.201572:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881259694080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1225us (3163us total) trans 17179872769 rc 0/0 00000100:00100000:3.0:1746065121.201580:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10551 00000004:00080000:0.0:1746065121.201622:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4e8380/2, rc 0, transno 17179872769 00000100:00100000:0.0:1746065121.201626:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259694080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065121.201733:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881259694592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1226us (3307us total) trans 17179872770 rc 0/0 00000100:00100000:3.0:1746065121.201739:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10552 00000004:00080000:0.0:1746065121.201794:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095350a80/2, rc 0, transno 17179872770 00000100:00100000:0.0:1746065121.201798:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259694592:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065121.201888:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 4974112 -> 4974112 00002000:00010000:0.0:1746065121.201890:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:0.0:1746065121.201893:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:0.0:1746065121.201894:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:0.0:1746065121.201896:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5699 -> 5699 00000100:00100000:0.0:1746065121.201919:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881259693952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1408us (3474us total) trans 17179872771 rc 0/0 00000100:00100000:0.0:1746065121.201924:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10553 00000004:00080000:0.0:1746065121.201944:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4eb800/2, rc 0, transno 17179872771 00000100:00100000:0.0:1746065121.201947:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259693952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.202002:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881259694464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1476us (3541us total) trans 17179872772 rc 0/0 00000100:00100000:2.0:1746065121.202008:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10554 00000100:00100000:3.0:1746065121.202050:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3298:x1830881259695744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 593us (1266us total) trans 17179872773 rc 0/0 00000100:00100000:3.0:1746065121.202054:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10563 00000004:00080000:0.0:1746065121.202101:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d509180/2, rc 0, transno 17179872773 00000100:00100000:0.0:1746065121.202104:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259695744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065121.202117:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095350e00/2, rc 0, transno 17179872772 00000100:00100000:0.0:1746065121.202119:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259694464:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065121.202492:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065121.202495:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.202496:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.202498:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:1.0:1746065121.202500:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746065121.202524:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3298:x1830881259694720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1211us (1922us total) trans 21474840002 rc 0/0 00000100:00100000:1.0:1746065121.202530:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10561 00000100:00100000:3.0:1746065121.202751:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881259695616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1700us (4073us total) trans 21474840001 rc 0/0 00000100:00100000:3.0:1746065121.202757:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10558 00000004:00080000:3.0:1746065121.202779:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d508000/2, rc 0, transno 21474840001 00000100:00100000:3.0:1746065121.202783:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259695616:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065121.202871:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:2.0:1746065121.202873:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065121.202875:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065121.202877:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065121.202879:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:2.0:1746065121.202899:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3298:x1830881259695232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1501us (2282us total) trans 21474840003 rc 0/0 00000100:00100000:2.0:1746065121.202904:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10562 00000100:00100000:0.0:1746065121.202986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:0.0:1746065121.203012:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc58a80/2, rc 0, transno 21474840002 00000100:00100000:0.0:1746065121.203016:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259694720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065121.203022:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc59880/2, rc 0, transno 21474840003 00000100:00100000:0.0:1746065121.203024:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259695232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065121.203052:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260958720 00000100:00100000:1.0:1746065121.203056:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260958720 00000100:00100000:1.0:1746065121.203495:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8980 00000100:00100000:1.0:1746065121.203502:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:28892:x1830881260958720:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.203516:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.203528:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abbe expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.203565:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abbe expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.203574:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abbe expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.203587:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065121.203590:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065121.203592:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1de00, rc 0) 00000100:00100000:1.0:1746065121.203633:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28892:x1830881260958720:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 131us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.203637:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8980 00000100:00100000:0.0:1746065121.209008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.209056:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260958976 00000100:00100000:2.0:1746065121.209064:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260958976 00000100:00100000:0.0:1746065121.209249:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3654 00000100:00100000:0.0:1746065121.209261:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28892:x1830881260958976:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1746065121.209959:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28892:x1830881260958976:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 701us (955us total) trans 8589943024 rc 0/0 00000100:00100000:0.0:1746065121.209967:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3654 00000100:00100000:0.0:1746065121.233598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.233685:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260959360 00000100:00100000:2.0:1746065121.233693:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260959360 00000100:00100000:0.0:1746065121.234381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.235803:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260959488 00000100:00100000:2.0:1746065121.235810:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260959488 00000100:00100000:1.0:1746065121.235832:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8981 00000100:00100000:1.0:1746065121.235843:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+7:28905:x1830881260959360:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065121.235855:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8982 00000100:00100000:2.0:1746065121.235861:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:28904:x1830881260959488:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.235876:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.235889:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f29ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abcc expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.235981:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.235992:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236001:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236011:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236015:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236020:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236106:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236113:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236118:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065121.236125:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065121.236192:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236197:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236469:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236476:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdd1800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065121.236479:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236485:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236493:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065121.236495:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065121.236498:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236502:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f29f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.236541:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.236549:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c000/0x14b4f8542d4f2a0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abc5 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.236590:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236597:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236604:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236612:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236617:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236622:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236667:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236673:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236678:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065121.236683:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:1.0:1746065121.236716:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236721:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236725:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236729:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090b1da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065121.236731:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236736:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236742:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065121.236745:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065121.236747:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236751:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1da00/0x14b4f8542d4f2a16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236763:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236768:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236773:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236776:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090b1c400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065121.236778:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236783:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236787:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205000) 00010000:00010000:1.0:1746065121.236789:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065121.236791:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236795:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.236837:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c000/0x14b4f8542d4f2a0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abc5 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.236931:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236937:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236941:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236945:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdd0400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065121.236947:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236951:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236957:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205000) 00010000:00010000:2.0:1746065121.236959:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065121.236961:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236965:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0400/0x14b4f8542d4f29fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.236989:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f29ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abcc expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.236998:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abcc expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.237003:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.237005:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065121.237007:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35c400, rc 0) 00000100:00100000:2.0:1746065121.237248:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28904:x1830881260959488:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1386us (2867us total) trans 8589943025 rc 0/0 00000100:00100000:2.0:1746065121.237255:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8982 00010000:00010000:1.0:1746065121.237462:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abc5 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.237471:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065121.237473:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065121.237475:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1dc00, rc 0) 00000100:00100000:1.0:1746065121.237512:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:28905:x1830881260959360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1671us (3921us total) trans 8589943026 rc 0/0 00000100:00100000:1.0:1746065121.237518:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8981 00000100:00100000:2.0:1746065121.240258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.240295:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260959616 00000100:00100000:3.0:1746065121.240304:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260959616 00000100:00100000:3.0:1746065121.240355:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10564 00000100:00100000:3.0:1746065121.240363:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28904:x1830881260959616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.240379:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.240392:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abd3 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.240425:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 10 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.240430:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065121.240431:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065121.240434:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.240457:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 10 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.240468:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 10 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.240477:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259695872:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.240483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.240522:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260959872 00000100:00100000:0.0:1746065121.240526:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260959872 00000100:00100000:3.0:1746065121.240548:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.240551:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8983 00000100:00100000:0.0:1746065121.240557:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28902:x1830881260959872:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065121.240568:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.240593:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935aea00/0x14b4f8542d4f2a39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abda expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.240665:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065121.240675:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abcc expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.240681:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abc5 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.240685:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065121.240700:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abc5 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.240707:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abc5 expref: 8 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.240719:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259696000:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.240763:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abcc expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.240770:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abcc expref: 250 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.240777:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259696128:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.240793:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.241618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.241659:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260960128 00000100:00100000:2.0:1746065121.241662:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260960128 00000100:00100000:2.0:1746065121.241696:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3655 00000100:00100000:2.0:1746065121.241702:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:28905:x1830881260960128:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065121.241847:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:28905:x1830881260960128:12345-192.168.202.46@tcp:35:cat.0 Request processed in 144us (229us total) trans 8589943027 rc 0/0 00000100:00100000:2.0:1746065121.241853:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3655 00000100:00100000:3.0:1746065121.243109:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259695872:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.243127:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.243139:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935af800, rc 0) 00000100:00100000:3.0:1746065121.243159:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:28904:x1830881260959616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2797us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.243164:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10564 00000100:00100000:3.0:1746065121.243197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.243290:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260960256 00000100:00100000:2.0:1746065121.243293:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260960256 00010000:00010000:2.0:1746065121.243309:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 11 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746065121.243365:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5258 00000100:00100000:0.0:1746065121.243373:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881260960256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.243386:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065121.243405:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 11 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.243419:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 11 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.243436:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b1d600/0x14b4f8542d4f29b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab94 expref: 11 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.243458:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.243460:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.243466:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.243473:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.243495:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.243504:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013026b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259696256:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065121.243567:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.245540:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259696000:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.245547:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.245550:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259696128:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.245566:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065121.245871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.245921:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260960384 00000100:00100000:3.0:1746065121.245927:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260960384 00000100:00100000:2.0:1746065121.245945:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260960896 00010000:00010000:3.0:1746065121.245947:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abcc expref: 251 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.245950:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260960896 00000100:00100000:2.0:1746065121.245973:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8984 00000100:00100000:3.0:1746065121.245975:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5259 00000100:00100000:2.0:1746065121.245979:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:28901:x1830881260960896:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:3.0:1746065121.245980:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1961:x1830881260960384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.245990:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.245995:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abcc expref: 251 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.245996:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.246003:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abcc expref: 251 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.246008:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f2a47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abe8 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.246018:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c400/0x14b4f8542d4f2a01 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abcc expref: 251 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.246031:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.246035:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065121.246041:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065121.246046:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065121.246419:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246428:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246435:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246443:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065121.246560:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1961:x1830881260960384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.246567:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5259 00010000:00010000:2.0:1746065121.246616:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246624:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246713:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f2a5c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246721:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f2a5c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246726:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f2a5c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065121.246737:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:2.0:1746065121.246807:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246832:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246839:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246843:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdd1e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065121.246847:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246852:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246860:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065121.246862:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065121.246865:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246869:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1e00/0x14b4f8542d4f2a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246876:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246882:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246886:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246892:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4a5e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065121.246894:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246898:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246903:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205e00) 00010000:00010000:2.0:1746065121.246905:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065121.246907:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246910:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4f2a55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.246938:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1800/0x14b4f8542d4f2a47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe8 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.246947:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f2a5c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe8 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.246952:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.246954:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065121.246955:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a4c00, rc 0) 00000100:00100000:2.0:1746065121.246991:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:28901:x1830881260960896:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1010us (1444us total) trans 8589943028 rc 0/0 00000100:00100000:2.0:1746065121.246996:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8984 00000100:00100000:1.0:1746065121.247413:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.247444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.247470:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.247686:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260960640 00000100:00100000:3.0:1746065121.247691:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260960640 00010000:00010000:3.0:1746065121.247707:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abc5 expref: 12 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.247733:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5260 00000100:00100000:3.0:1746065121.247738:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881260960640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.247745:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.247749:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abc5 expref: 12 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.247758:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abc5 expref: 12 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.247769:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1dc00/0x14b4f8542d4f2a24 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abc5 expref: 12 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.247779:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.247782:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065121.247787:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065121.247792:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065121.247806:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.247842:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881260960640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 103us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.247847:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5260 00000100:00100000:3.0:1746065121.247861:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260960512 00000100:00100000:3.0:1746065121.247864:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260960512 00000100:00100000:3.0:1746065121.247891:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8985 00000100:00100000:3.0:1746065121.247896:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28904:x1830881260960512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.247904:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.247911:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abe1 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.247940:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe1 expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.247947:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe1 expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.248148:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260961024 00000100:00100000:1.0:1746065121.248152:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260961024 00000100:00100000:1.0:1746065121.248228:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8986 00000100:00100000:1.0:1746065121.248235:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:28905:x1830881260961024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.248242:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.248250:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c000/0x14b4f8542d4f2a71 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abef expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.248287:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065121.248293:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.248298:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065121.248308:0:24350:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065121.248314:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065121.248637:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013026b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259696256:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065121.248659:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.248686:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260960256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5312us (5485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.248695:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5258 00010000:00010000:3.0:1746065121.248955:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.248958:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065121.248960:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935af600, rc 0) 00000100:00100000:3.0:1746065121.248995:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28904:x1830881260960512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1098us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.249000:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8985 00010000:00010000:3.0:1746065121.249018:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065121.249024:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065121.249036:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065121.249121:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935aea00/0x14b4f8542d4f2a39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abda expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.249134:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abda expref: 251 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.249141:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abda expref: 251 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.249146:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935af000, rc 0) 00000100:00100000:3.0:1746065121.249176:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28902:x1830881260959872:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8619us (8693us total) trans 8589943029 rc 0/0 00000100:00100000:3.0:1746065121.249181:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8983 00000100:00100000:0.0:1746065121.250457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.251559:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260961280 00000100:00100000:3.0:1746065121.251567:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260961280 00000100:00100000:3.0:1746065121.251612:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8987 00000100:00100000:3.0:1746065121.251618:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:28901:x1830881260961280:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065121.251633:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.251635:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065121.251654:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4a4c00/0x14b4f8542d4f2a5c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe8 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.251666:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.251671:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.251677:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.251681:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.251685:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065121.251694:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2a86 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abf6 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.251733:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.251741:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abbe expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.251747:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe1 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.251752:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.251756:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 6/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.251769:0:16767:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.251786:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe1 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.251794:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe1 expref: 250 pid: 14643 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.251805:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259696384:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065121.252319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065121.253068:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abbe expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.253080:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abbe expref: 7 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.253088:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259696512:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.253251:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260961408 00000100:00100000:2.0:1746065121.253255:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260961408 00010000:00010000:2.0:1746065121.253272:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abda expref: 251 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.253292:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5261 00000100:00100000:2.0:1746065121.253297:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881260961408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.253305:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.253309:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abda expref: 251 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.253316:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abda expref: 251 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.253329:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af000/0x14b4f8542d4f2a40 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abda expref: 251 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.253338:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.253342:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065121.253357:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065121.253363:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065121.253371:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.253376:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.253387:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.253404:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1960:x1830881260961408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.253409:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5261 00000100:00100000:3.0:1746065121.253460:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11da80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065121.253547:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065121.253553:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065121.253581:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:1.0:1746065121.253584:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065121.253595:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065121.253617:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c000/0x14b4f8542d4f2a71 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abef expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.253631:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abef expref: 13 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.253636:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abef expref: 13 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.253641:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1c400, rc 0) 00000100:00100000:1.0:1746065121.253662:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:28905:x1830881260961024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5428us (6192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.253668:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8986 00000100:00100000:0.0:1746065121.254404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.254449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.254589:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259696384:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.254598:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259696512:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.254612:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065121.254659:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260961536 00000100:00100000:2.0:1746065121.254663:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260961536 00010000:00010000:2.0:1746065121.254676:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe1 expref: 250 pid: 14643 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.254689:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260961664 00000100:00100000:2.0:1746065121.254690:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260961664 00010000:00010000:2.0:1746065121.254698:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abbe expref: 8 pid: 14644 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.254710:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5262 00000100:00100000:2.0:1746065121.254715:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1960:x1830881260961536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.254722:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.254725:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe1 expref: 250 pid: 14643 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.254731:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe1 expref: 250 pid: 14643 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.254746:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af600/0x14b4f8542d4f2a6a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abe1 expref: 250 pid: 14643 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.254754:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.254757:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.254762:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.254766:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.254786:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:1960:x1830881260961536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.254791:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5262 00000100:00100000:2.0:1746065121.254800:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5263 00000100:00100000:2.0:1746065121.254805:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260961664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.254810:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.254835:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abbe expref: 8 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.254841:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abbe expref: 8 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.254850:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1de00/0x14b4f8542d4f29e5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abbe expref: 8 pid: 14644 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.254858:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.254861:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.254865:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.254869:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.254883:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881260961664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.254887:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5263 00000100:00100000:0.0:1746065121.256202:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.256433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.256658:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260961920 00000100:00100000:1.0:1746065121.256662:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260961920 00000100:00100000:3.0:1746065121.256756:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260961792 00000100:00100000:3.0:1746065121.256759:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260961792 00010000:00010000:3.0:1746065121.256774:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abef expref: 14 pid: 24350 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.256802:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5264 00000100:00100000:3.0:1746065121.256808:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260961792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.256834:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.256839:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abef expref: 14 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.256849:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abef expref: 14 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.256862:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1c400/0x14b4f8542d4f2a78 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abef expref: 14 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.256877:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.256881:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.256887:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.256892:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.256907:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065121.257035:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.257042:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:02000000:2.0:1746065121.257076:0:16767:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:1.0:1746065121.257307:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8988 00000100:00100000:1.0:1746065121.257314:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:28905:x1830881260961920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.257331:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.257341:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5abfd expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.257382:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.257388:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.257399:0:24350:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.257408:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.257416:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065121.257418:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065121.257421:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.257426:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1d600, rc 0) 00000100:00100000:3.0:1746065121.257492:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881260961792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 682us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.257492:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:28905:x1830881260961920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 177us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.257498:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5264 00000100:00100000:1.0:1746065121.257498:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8988 00000040:00080000:2.0:1746065121.257891:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2502, 88 off209992 00000004:00080000:2.0:1746065121.257897:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720549080811ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.258270:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2446, 88 off204888 00000004:00080000:2.0:1746065121.258274:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720549459104ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.258296:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2447, 88 off204976 00000004:00080000:2.0:1746065121.258299:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720549483769ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.258307:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2503, 88 off210080 00000004:00080000:2.0:1746065121.258309:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720549493776ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.258315:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2504, 88 off210168 00000004:00080000:2.0:1746065121.258318:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720549502289ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.258324:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2448, 88 off205064 00000004:00080000:2.0:1746065121.258326:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720549510829ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.258333:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2449, 88 off205152 00000004:00080000:2.0:1746065121.258336:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720549520607ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.258390:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2450, 88 off205240 00000004:00080000:2.0:1746065121.258394:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720549578831ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.258403:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2505, 88 off210256 00000004:00080000:2.0:1746065121.258405:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720549589919ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.258426:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2451, 88 off205328 00000004:00080000:2.0:1746065121.258429:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720549613419ns, next at 666938887344ns, rc = 0 00000100:00100000:1.0:1746065121.258641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.258740:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260962176 00000100:00100000:0.0:1746065121.258746:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260962176 00000040:00080000:2.0:1746065121.258981:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2506, 88 off210344 00000004:00080000:2.0:1746065121.258985:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720550169242ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.258997:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2452, 88 off205416 00000004:00080000:2.0:1746065121.259000:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720550184717ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065121.259006:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2507, 88 off210432 00000004:00080000:2.0:1746065121.259009:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720550193431ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.259015:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2508, 88 off210520 00000004:00080000:2.0:1746065121.259017:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720550201722ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.259023:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2509, 88 off210608 00000004:00080000:2.0:1746065121.259025:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720550209710ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.259031:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2510, 88 off210696 00000004:00080000:2.0:1746065121.259033:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720550217656ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065121.259038:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2453, 88 off205504 00000004:00080000:2.0:1746065121.259043:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 720550227469ns, next at 666938887344ns, rc = 0 00002000:00100000:0.0:1746065121.259231:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094a11c00 x1830881260962176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065121.259239:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11c00 with x1830881260962176 ext(0->1048575) 00002000:00010000:0.0:1746065121.259243:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11c00 00000100:00100000:0.0:1746065121.259270:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4823 00000100:00100000:0.0:1746065121.259277:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881260962176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065121.270564:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881260962176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11280us (11916us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.270575:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4823 00002000:00100000:2.0:1746065121.270586:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094a11c00 x1830881260962176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.270601:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11c00 with x1830881260962176 ext(0->1048575) 00002000:00010000:2.0:1746065121.270606:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11c00 00000100:00100000:1.0:1746065121.283778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.283976:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260962304 00000100:00100000:3.0:1746065121.283983:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260962304 00000100:00100000:2.0:1746065121.285409:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10565 00000100:00100000:2.0:1746065121.285420:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:28904:x1830881260962304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.285435:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.285450:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac04 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.285475:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.285482:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.285483:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.285487:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.285510:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.285520:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.285530:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259696640:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.285601:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.287651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.287836:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259696640:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.287858:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.287871:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd0000, rc 0) 00000100:00100000:2.0:1746065121.288786:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:28904:x1830881260962304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3367us (5011us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.288793:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10565 00000100:00100000:2.0:1746065121.289448:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260962432 00000100:00100000:2.0:1746065121.289453:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260962432 00010000:00010000:2.0:1746065121.289474:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.289491:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5265 00000100:00100000:2.0:1746065121.289496:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1960:x1830881260962432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.289505:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.289521:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.289531:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.289548:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f29bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ab9b expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.289558:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.289559:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.289564:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.289572:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.289592:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.289601:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259696768:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.289648:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.292480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.292501:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260962560 00000100:00100000:0.0:1746065121.292506:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260962560 00000100:00100000:0.0:1746065121.292533:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8989 00000100:00100000:0.0:1746065121.292538:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28904:x1830881260962560:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065121.292555:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065121.292568:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac0b expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.292609:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.292619:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.292628:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065121.292631:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065121.292634:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.292644:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3b5600, rc 0) 00000100:00100000:0.0:1746065121.292671:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28904:x1830881260962560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 133us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.292677:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8989 00000100:00100000:0.0:1746065121.292750:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259696768:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065121.292763:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.292785:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881260962432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3284us (5133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.292792:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5265 00000001:00080000:3.0:1746065121.299759:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943024 is committed 00000001:00080000:3.0:1746065121.299772:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943026 is committed 00000001:00080000:3.0:1746065121.299776:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943030 is committed 00000004:00080000:3.0:1746065121.299779:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1746 committed 00000004:00080000:3.0:1746065121.299785:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1804 committed 00000004:00080000:3.0:1746065121.299798:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1803 committed 00000004:00080000:3.0:1746065121.299799:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1802 committed 00000004:00080000:3.0:1746065121.299801:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1801 committed 00000004:00080000:3.0:1746065121.299802:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1745 committed 00000004:00080000:3.0:1746065121.299804:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1800 committed 00000004:00080000:3.0:1746065121.299805:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1744 committed 00000004:00080000:3.0:1746065121.299807:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1799 committed 00000004:00080000:3.0:1746065121.299808:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1743 committed 00000004:00080000:3.0:1746065121.299809:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1742 committed 00000004:00080000:3.0:1746065121.299811:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1741 committed 00000004:00080000:3.0:1746065121.299813:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1798 committed 00000004:00080000:3.0:1746065121.299828:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1797 committed 00000004:00080000:3.0:1746065121.299830:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1740 committed 00000004:00080000:3.0:1746065121.299831:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1739 committed 00000004:00080000:3.0:1746065121.299833:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1796 committed 00000001:00080000:3.0:1746065121.299839:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943025 is committed 00000001:00080000:3.0:1746065121.299843:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943029 is committed 00000100:00100000:2.0:1746065121.299915:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259696896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.299917:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259697024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.300147:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065121.300148:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259697280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065121.300165:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.300177:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259697536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.300180:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259697792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065121.300194:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065121.300198:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259697152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.300288:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259698048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.300304:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.300581:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259698560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.300595:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.300866:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259697024 00000100:00100000:1.0:1746065121.300873:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259697024 00000100:00100000:1.0:1746065121.300896:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259697280 00000100:00100000:1.0:1746065121.300897:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259697280 00000100:00100000:1.0:1746065121.300905:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259697536 00000100:00100000:1.0:1746065121.300906:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259697536 00000100:00100000:1.0:1746065121.300918:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259698048 00000100:00100000:1.0:1746065121.300920:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259698048 00000100:00100000:1.0:1746065121.300927:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259698560 00000100:00100000:1.0:1746065121.300928:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259698560 00000100:00100000:1.0:1746065121.300938:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10566 00000100:00100000:1.0:1746065121.300943:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3295:x1830881259697024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065121.301072:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065121.301075:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.301077:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.301079:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:1.0:1746065121.301080:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065121.301104:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881259697024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (958us total) trans 21474840004 rc 0/0 00000100:00100000:1.0:1746065121.301109:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10566 00000100:00100000:1.0:1746065121.301120:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10567 00000100:00100000:1.0:1746065121.301123:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3297:x1830881259697280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065121.301193:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3297:x1830881259697280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1027us total) trans 21474840005 rc 0/0 00000100:00100000:1.0:1746065121.301200:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10567 00000100:00100000:1.0:1746065121.301208:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10568 00000100:00100000:1.0:1746065121.301211:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881259697536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065121.301285:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065121.301287:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.301288:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.301290:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:1.0:1746065121.301292:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065121.301308:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3295:x1830881259697536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1113us total) trans 17179872774 rc 0/0 00000100:00100000:1.0:1746065121.301313:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10568 00000100:00100000:1.0:1746065121.301321:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10569 00000100:00100000:1.0:1746065121.301325:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3295:x1830881259698048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065121.301394:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065121.301397:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.301398:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.301400:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.301401:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065121.301419:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881259698048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1113us total) trans 21474840006 rc 0/0 00000100:00100000:1.0:1746065121.301429:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10569 00000100:00100000:1.0:1746065121.301438:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10570 00000100:00100000:1.0:1746065121.301442:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3295:x1830881259698560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.301508:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.301523:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259697408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065121.301544:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.301554:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259697920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065121.301560:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259696896 00000100:00100000:2.0:1746065121.301564:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259696896 00000100:00100000:3.0:1746065121.301567:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.301571:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3295:x1830881259698560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (974us total) trans 21474840007 rc 0/0 00000100:00100000:3.0:1746065121.301576:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259698432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.301577:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10570 00000100:00100000:1.0:1746065121.301585:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259697408 00000100:00100000:3.0:1746065121.301587:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.301588:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259697408 00000100:00100000:2.0:1746065121.301593:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259697920 00000100:00100000:1.0:1746065121.301595:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259698432 00000100:00100000:2.0:1746065121.301596:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259697920 00000100:00100000:1.0:1746065121.301597:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259698432 00000100:00100000:1.0:1746065121.301603:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10571 00000100:00100000:1.0:1746065121.301608:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3298:x1830881259696896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.301653:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10572 00000100:00100000:2.0:1746065121.301658:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10573 00000100:00100000:3.0:1746065121.301659:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3298:x1830881259697408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.301664:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3298:x1830881259698432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065121.301673:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065121.301675:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.301677:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.301679:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:1.0:1746065121.301680:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746065121.301701:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3298:x1830881259696896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (192us total) trans 21474840008 rc 0/0 00000100:00100000:1.0:1746065121.301706:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10571 00000100:00100000:1.0:1746065121.301715:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10574 00000100:00100000:1.0:1746065121.301719:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3298:x1830881259697920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065121.301725:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065121.301728:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:3.0:1746065121.301729:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:3.0:1746065121.301731:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:3.0:1746065121.301732:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00002000:00010000:2.0:1746065121.301745:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065121.301747:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:3.0:1746065121.301749:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3298:x1830881259697408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (204us total) trans 17179872775 rc 0/0 00002000:00010000:2.0:1746065121.301749:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065121.301750:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065121.301752:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065121.301753:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10572 00000100:00100000:2.0:1746065121.301774:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881259698432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (186us total) trans 17179872776 rc 0/0 00002000:00010000:1.0:1746065121.301777:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00000100:00100000:2.0:1746065121.301779:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10573 00002000:00010000:1.0:1746065121.301779:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00000004:00080000:3.0:1746065121.301780:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5882680/2, rc 0, transno 21474840008 00002000:00010000:1.0:1746065121.301781:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.301782:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00000100:00100000:3.0:1746065121.301784:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259696896:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065121.301784:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000004:00080000:3.0:1746065121.301791:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b7b80/2, rc 0, transno 17179872775 00000100:00100000:2.0:1746065121.301794:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.301797:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259697408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.301800:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3298:x1830881259697920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (232us total) trans 21474840009 rc 0/0 00000004:00080000:3.0:1746065121.301803:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880380/2, rc 0, transno 21474840009 00000100:00100000:1.0:1746065121.301805:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10574 00000100:00100000:3.0:1746065121.301806:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259697920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065121.301809:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259697664:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065121.301812:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b7480/2, rc 0, transno 17179872776 00000100:00100000:1.0:1746065121.301827:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259697152 00000100:00100000:3.0:1746065121.301828:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259698432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.301830:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259697152 00000100:00100000:2.0:1746065121.301843:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.301843:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10575 00000100:00100000:1.0:1746065121.301847:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3296:x1830881259697152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065121.301855:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259698176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065121.301857:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259697664 00000100:00100000:3.0:1746065121.301860:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259697664 00000100:00100000:2.0:1746065121.301868:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.301870:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10576 00000100:00100000:3.0:1746065121.301874:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3296:x1830881259697664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.301875:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259698688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065121.301887:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065121.301902:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065121.301909:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746065121.301910:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259698304:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065121.301911:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.301913:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:1.0:1746065121.301914:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:1.0:1746065121.301916:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746065121.301923:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065121.301928:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 4974112 -> 4974112 00002000:00010000:3.0:1746065121.301930:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065121 -> 1746065121 00000100:00100000:2.0:1746065121.301931:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259698816:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065121.301932:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065121 -> 1746065121 00002000:00010000:3.0:1746065121.301933:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065122 -> 1746065122 00002000:00010000:3.0:1746065121.301935:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5699 -> 5699 00000100:00100000:1.0:1746065121.301937:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3296:x1830881259697152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (142us total) trans 21474840010 rc 0/0 00000100:00100000:2.0:1746065121.301941:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.301942:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10575 00000100:00100000:3.0:1746065121.301950:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3296:x1830881259697664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (107us total) trans 17179872777 rc 0/0 00000100:00100000:1.0:1746065121.301951:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259698176 00000100:00100000:1.0:1746065121.301953:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259698176 00000100:00100000:3.0:1746065121.301954:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10576 00000004:00080000:2.0:1746065121.301955:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5881500/2, rc 0, transno 21474840005 00000100:00100000:2.0:1746065121.301958:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259697280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065121.301960:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259698688 00000100:00100000:3.0:1746065121.301961:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259697792 00000100:00100000:2.0:1746065121.301961:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065121.301962:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259697792 00000100:00100000:1.0:1746065121.301962:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259698688 00000100:00100000:2.0:1746065121.301965:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259698944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.301967:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259698304 00000100:00100000:3.0:1746065121.301968:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259698816 00000100:00100000:1.0:1746065121.301968:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259698304 00000100:00100000:3.0:1746065121.301969:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259698816 00000100:00100000:1.0:1746065121.301975:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10577 00000100:00100000:2.0:1746065121.301976:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.301977:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10578 00000100:00100000:1.0:1746065121.301978:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3296:x1830881259698176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065121.301980:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3296:x1830881259698688:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065121.301989:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5882d80/2, rc 0, transno 21474840010 00000100:00100000:2.0:1746065121.301992:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259697152:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065121.301997:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b4e00/2, rc 0, transno 17179872777 00000100:00100000:1.0:1746065121.301997:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259698944 00000100:00100000:2.0:1746065121.301999:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259697664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.302000:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259698944 00000100:00100000:2.0:1746065121.302008:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10579 00000100:00100000:1.0:1746065121.302012:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10580 00000100:00100000:2.0:1746065121.302013:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3297:x1830881259697792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.302016:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3297:x1830881259698304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065121.302057:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3296:x1830881259698688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (168us total) trans 17179872778 rc 0/0 00000100:00100000:3.0:1746065121.302062:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10578 00002000:00010000:1.0:1746065121.302069:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065121.302070:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:3.0:1746065121.302071:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10581 00002000:00010000:1.0:1746065121.302072:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.302073:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:3.0:1746065121.302074:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3297:x1830881259698816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065121.302075:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065121.302094:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3297:x1830881259698304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (170us total) trans 21474840011 rc 0/0 00000100:00100000:1.0:1746065121.302099:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10580 00000100:00100000:1.0:1746065121.302108:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10582 00000100:00100000:1.0:1746065121.302111:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3297:x1830881259698944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065121.302140:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3297:x1830881259698816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (198us total) trans 17179872779 rc 0/0 00000100:00100000:3.0:1746065121.302145:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10581 00000004:00080000:3.0:1746065121.302165:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5883b80/2, rc 0, transno 21474840004 00000100:00100000:3.0:1746065121.302169:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259697024:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065121.302175:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5180/2, rc 0, transno 17179872774 00000100:00100000:1.0:1746065121.302176:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3297:x1830881259698944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (199us total) trans 17179872780 rc 0/0 00000100:00100000:3.0:1746065121.302178:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259697536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065121.302180:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10582 00000004:00080000:3.0:1746065121.302183:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880e00/2, rc 0, transno 21474840006 00000100:00100000:3.0:1746065121.302185:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259698048:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065121.302190:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5882a00/2, rc 0, transno 21474840007 00000100:00100000:3.0:1746065121.302192:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259698560:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065121.302223:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.302234:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00002000:00010000:1.0:1746065121.302235:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1746065121.302237:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00002000:00010000:1.0:1746065121.302237:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.302239:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1746065121.302240:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065121.302240:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065121.302242:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:3.0:1746065121.302249:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.302255:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.302257:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3296:x1830881259698176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 278us (388us total) trans 17179872781 rc 0/0 00010000:00010000:3.0:1746065121.302261:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 247 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.302261:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10577 00010000:00010000:3.0:1746065121.302267:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 247 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.302272:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 247 pid: 14644 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065121.302283:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065121.302286:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065121.302287:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065121.302289:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065121.302290:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:3.0:1746065121.302292:0:16767:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 247 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.302300:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259699072:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.302307:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3297:x1830881259697792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 294us (404us total) trans 17179872782 rc 0/0 00000100:00100000:2.0:1746065121.302312:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10579 00010000:00010000:3.0:1746065121.302359:0:16767:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.302370:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259699200:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.302384:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dcc0 going to sleep for 11 seconds 00000004:00080000:2.0:1746065121.302413:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd71c00/2, rc 0, transno 17179872780 00000100:00100000:2.0:1746065121.302417:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259698944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065121.302424:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5500/2, rc 0, transno 17179872782 00000100:00100000:2.0:1746065121.302427:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259697792:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065121.302433:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5881180/2, rc 0, transno 21474840011 00000100:00100000:2.0:1746065121.302435:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259698304:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065121.302441:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b6d80/2, rc 0, transno 17179872779 00000100:00100000:2.0:1746065121.302443:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259698816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065121.302455:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b6680/2, rc 0, transno 17179872781 00000100:00100000:2.0:1746065121.302458:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259698176:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065121.302463:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5f80/2, rc 0, transno 17179872778 00000100:00100000:2.0:1746065121.302465:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259698688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065121.308874:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259699072:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065121.309204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.309450:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260962688 00000100:00100000:2.0:1746065121.309456:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260962688 00000100:00100000:2.0:1746065121.309496:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3656 00000100:00100000:2.0:1746065121.309503:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28904:x1830881260962688:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:2.0:1746065121.309594:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28904:x1830881260962688:12345-192.168.202.46@tcp:49:cat.0 Request processed in 91us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.309600:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3656 00000100:00100000:0.0:1746065121.312852:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.312957:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260962816 00000100:00100000:2.0:1746065121.312968:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260962816 00000100:00100000:2.0:1746065121.312995:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3657 00000100:00100000:2.0:1746065121.313001:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:28905:x1830881260962816:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:3.0:1746065121.313037:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259699200:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.313069:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2a86 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 11 pid: 16767 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1746065121.313173:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:28905:x1830881260962816:12345-192.168.202.46@tcp:49:cat.0 Request processed in 171us (326us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065121.313174:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.313179:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3657 00010000:00010000:3.0:1746065121.313192:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935ae600, rc 0) 00000100:00100000:3.0:1746065121.313212:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:28901:x1830881260961280:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 61594us (62757us total) trans 8589943030 rc 0/0 00000100:00100000:3.0:1746065121.313219:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8987 00000100:00100000:0.0:1746065121.317138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.317280:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260963072 00000100:00100000:2.0:1746065121.317287:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260963072 00002000:00100000:2.0:1746065121.317325:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012bd3d180 x1830881260963072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.317334:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3d180 with x1830881260963072 ext(1048576->2097151) 00002000:00010000:2.0:1746065121.317338:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3d180 00000100:00100000:2.0:1746065121.317382:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4824 00000100:00100000:2.0:1746065121.317389:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881260963072:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065121.318341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.318384:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.318446:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260963200 00000100:00100000:3.0:1746065121.318450:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260963200 00000100:00100000:3.0:1746065121.318482:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260963328 00000100:00100000:3.0:1746065121.318485:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260963328 00000100:00100000:3.0:1746065121.318496:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10583 00000100:00100000:3.0:1746065121.318502:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:28905:x1830881260963200:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065121.318502:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10584 00000100:00100000:1.0:1746065121.318510:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:28901:x1830881260963328:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065121.318512:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.318517:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.318526:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac12 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.318526:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac19 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.318543:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.318545:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.318545:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 9 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.318551:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac12 expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.318552:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.318553:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.318556:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3899392->3940351] (req 3899392->3940351) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.318562:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac12 expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.318571:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1400, rc 0) 00010000:00010000:1.0:1746065121.318578:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 9 pid: 9716 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746065121.318582:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746065121.318588:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 9 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065121.318597:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259699328:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.318600:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+16:28905:x1830881260963200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 98us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.318605:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10583 00000100:00100000:1.0:1746065121.318683:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.322184:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259699328:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.322208:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3899392->3940351] (req 3899392->3940351) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.322222:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b267e00, rc 0) 00000100:00100000:1.0:1746065121.322314:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:28901:x1830881260963328:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3803us (3927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.322321:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10584 00000100:00100000:0.0:1746065121.324853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.324894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.324916:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260963456 00000100:00100000:2.0:1746065121.324924:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260963456 00010000:00010000:2.0:1746065121.324951:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 10 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.324977:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5266 00000100:00100000:2.0:1746065121.324984:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881260963456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.324995:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.325012:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 10 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.325022:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 10 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.325041:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b1ce00/0x14b4f8542d4f29d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb0 expref: 10 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.325047:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260963712 00000100:00100000:3.0:1746065121.325052:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260963712 00010000:00010000:2.0:1746065121.325057:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.325059:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.325064:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.325071:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065121.325078:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012bd3ea00 x1830881260963712/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.325087:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3ea00 with x1830881260963712 ext(0->1048575) 00002000:00010000:3.0:1746065121.325090:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3ea00 00010000:00010000:2.0:1746065121.325095:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.325104:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4825 00000100:00100000:2.0:1746065121.325105:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259699456:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.325109:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260963712:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.325154:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.326050:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881260963072:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8660us (8916us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.326057:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4824 00002000:00100000:2.0:1746065121.326064:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012bd3d180 x1830881260963072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.326071:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3d180 with x1830881260963072 ext(1048576->2097151) 00002000:00010000:2.0:1746065121.326075:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3d180 00000100:00100000:2.0:1746065121.331687:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259699456:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065121.331709:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.331754:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260963456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6768us (6945us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.331763:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5266 00000100:00100000:3.0:1746065121.332185:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260963712:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 6945us (7160us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.332193:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4825 00002000:00100000:3.0:1746065121.332203:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012bd3ea00 x1830881260963712/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.332212:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3ea00 with x1830881260963712 ext(0->1048575) 00002000:00010000:3.0:1746065121.332216:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3ea00 00000100:00100000:2.0:1746065121.332453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.332682:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260963968 00000100:00100000:3.0:1746065121.332688:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260963968 00002000:00100000:3.0:1746065121.332714:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (3899392->3903487) req@ffff88012d7fce00 x1830881260963968/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.332722:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fce00 with x1830881260963968 ext(3899392->3903487) 00002000:00010000:3.0:1746065121.332725:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fce00 00000100:00100000:3.0:1746065121.332752:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4826 00000100:00100000:3.0:1746065121.332759:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260963968:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065121.334075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.334084:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260963968:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1325us (1630us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065121.334091:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4826 00002000:00100000:3.0:1746065121.334097:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (3899392->3903487) req@ffff88012d7fce00 x1830881260963968/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.334105:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fce00 with x1830881260963968 ext(3899392->3903487) 00002000:00010000:3.0:1746065121.334109:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fce00 00000100:00100000:1.0:1746065121.334140:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260964096 00000100:00100000:1.0:1746065121.334145:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260964096 00000100:00100000:1.0:1746065121.334576:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10585 00000100:00100000:1.0:1746065121.334582:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:28904:x1830881260964096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.334594:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.334608:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac20 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.334631:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.334638:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.334639:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.334643:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.334668:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.334678:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 13 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065121.334688:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259699584:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.335058:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.336288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.336996:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260964352 00000100:00100000:3.0:1746065121.337002:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260964352 00002000:00100000:3.0:1746065121.337032:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (3936256->3940351) req@ffff88012bd3e680 x1830881260964352/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.337041:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e680 with x1830881260964352 ext(3936256->3940351) 00002000:00010000:3.0:1746065121.337046:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3e680 00000100:00100000:3.0:1746065121.337073:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4827 00000100:00100000:3.0:1746065121.337080:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260964352:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065121.337200:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260964352:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 120us (912us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065121.337207:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4827 00002000:00100000:3.0:1746065121.337212:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (3936256->3940351) req@ffff88012bd3e680 x1830881260964352/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.337218:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e680 with x1830881260964352 ext(3936256->3940351) 00002000:00010000:3.0:1746065121.337221:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3e680 00000100:00100000:1.0:1746065121.337384:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259699584:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.337404:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.337417:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b267a00, rc 0) 00000100:00100000:1.0:1746065121.337453:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:28904:x1830881260964096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2871us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.337459:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10585 00000100:00100000:0.0:1746065121.340160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.340212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.340278:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260964480 00000100:00100000:2.0:1746065121.340285:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260964480 00010000:00010000:2.0:1746065121.340314:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.340336:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5267 00000100:00100000:2.0:1746065121.340342:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881260964480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.340363:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.340379:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.340390:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.340408:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d200/0x14b4f8542d4f29c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba2 expref: 14 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.340446:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.340448:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.340453:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.340460:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.340487:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.340496:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259699712:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.340552:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.340622:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260964608 00000100:00100000:1.0:1746065121.340626:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260964608 00000100:00100000:1.0:1746065121.340665:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10586 00000100:00100000:1.0:1746065121.340671:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:28905:x1830881260964608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.340681:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.340691:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac27 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.340711:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.340712:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.340717:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac27 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.340727:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac27 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.340734:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b267c00, rc 0) 00000100:00100000:1.0:1746065121.340757:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:28905:x1830881260964608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 87us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.340763:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10586 00000100:00080000:0.0:1746065121.342001:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065121.342027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.342066:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260964864 00000100:00100000:0.0:1746065121.342071:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260964864 00000100:00100000:0.0:1746065121.342106:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3658 00000100:00100000:0.0:1746065121.342111:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:28901:x1830881260964864:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065121.342306:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:28901:x1830881260964864:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 194us (280us total) trans 8589943031 rc 0/0 00000100:00100000:0.0:1746065121.342311:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3658 00000100:00100000:3.0:1746065121.343134:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259699712:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.343150:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.343184:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881260964480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2841us (2971us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.343191:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5267 00000100:00100000:0.0:1746065121.346494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.346541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.346586:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260965120 00000100:00100000:3.0:1746065121.346594:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260965120 00000100:00100000:2.0:1746065121.346610:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260965376 00000100:00100000:2.0:1746065121.346618:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260965376 00002000:00100000:3.0:1746065121.346628:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a90afb80 x1830881260965120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.346637:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90afb80 with x1830881260965120 ext(1048576->2097151) 00002000:00100000:2.0:1746065121.346637:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a90ac000 x1830881260965376/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:3.0:1746065121.346641:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90afb80 00002000:00100000:2.0:1746065121.346645:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ac000 with x1830881260965376 ext(1048576->2097151) 00002000:00010000:2.0:1746065121.346648:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ac000 00000100:00100000:3.0:1746065121.346658:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4828 00000100:00100000:3.0:1746065121.346665:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260965120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065121.347000:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4829 00000100:00100000:2.0:1746065121.347007:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260965376:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.368072:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260965376:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 21056us (21522us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.368072:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260965120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21399us (21577us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.368083:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4828 00000100:00100000:2.0:1746065121.368087:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4829 00002000:00100000:2.0:1746065121.368093:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a90ac000 x1830881260965376/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.368093:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a90afb80 x1830881260965120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.368102:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ac000 with x1830881260965376 ext(1048576->2097151) 00002000:00100000:1.0:1746065121.368102:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90afb80 with x1830881260965120 ext(1048576->2097151) 00002000:00010000:2.0:1746065121.368107:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ac000 00002000:00010000:1.0:1746065121.368107:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90afb80 00000100:00100000:0.0:1746065121.370621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.370685:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260965504 00000100:00100000:1.0:1746065121.370692:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260965504 00000100:00100000:1.0:1746065121.370728:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10587 00000100:00100000:1.0:1746065121.370733:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:28904:x1830881260965504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.370745:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.370756:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac2e expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.370776:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 8 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.370781:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.370782:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.370784:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.370801:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 8 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.370807:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 8 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065121.370833:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259699840:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.370908:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.373613:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.373846:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260965632 00000100:00100000:1.0:1746065121.373846:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259699840:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.373852:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260965632 00010000:00010000:1.0:1746065121.373868:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.373874:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 9 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.373886:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b266a00, rc 0) 00000100:00100000:3.0:1746065121.373900:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5268 00000100:00100000:3.0:1746065121.373906:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260965632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.373915:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065121.373918:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:28904:x1830881260965504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3185us (3303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.373924:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10587 00010000:00010000:3.0:1746065121.373931:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 9 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.373939:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 9 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.373956:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b1d000/0x14b4f8542d4f29c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aba9 expref: 9 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.373970:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.373972:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.373977:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.373984:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.374006:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.374015:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259699968:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.374319:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.374472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.374530:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260965760 00000100:00100000:1.0:1746065121.374533:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260965760 00000100:00100000:1.0:1746065121.374611:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10588 00000100:00100000:1.0:1746065121.374617:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:28905:x1830881260965760:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.374628:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.374639:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac35 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.374655:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.374657:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.374661:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac35 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.374670:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac35 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.374677:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b266800, rc 0) 00000100:00100000:1.0:1746065121.374693:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:28905:x1830881260965760:12345-192.168.202.46@tcp:101:cat.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.374698:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10588 00000100:00100000:3.0:1746065121.375848:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259699968:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.375859:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.375895:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260965632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1988us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.375905:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5268 00000100:00100000:0.0:1746065121.377104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.377425:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260966016 00000100:00100000:2.0:1746065121.377431:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260966016 00002000:00100000:2.0:1746065121.377459:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a90ae680 x1830881260966016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.377468:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ae680 with x1830881260966016 ext(1048576->2097151) 00002000:00010000:2.0:1746065121.377471:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ae680 00000100:00100000:2.0:1746065121.377590:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4830 00000100:00100000:2.0:1746065121.377595:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260966016:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065121.377779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.377867:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260966272 00000100:00100000:1.0:1746065121.377870:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260966272 00002000:00100000:1.0:1746065121.377889:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a90af100 x1830881260966272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.377894:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90af100 with x1830881260966272 ext(1048576->2097151) 00002000:00010000:1.0:1746065121.377896:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90af100 00000100:00100000:1.0:1746065121.377904:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4831 00000100:00100000:1.0:1746065121.377906:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260966272:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.389029:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260966016:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11426us (11918us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.389038:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4830 00002000:00100000:2.0:1746065121.389048:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a90ae680 x1830881260966016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.389056:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ae680 with x1830881260966016 ext(1048576->2097151) 00002000:00010000:2.0:1746065121.389061:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ae680 00000100:00100000:1.0:1746065121.390055:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260966272:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12144us (12274us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.390063:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4831 00002000:00100000:1.0:1746065121.390069:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a90af100 x1830881260966272/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.390077:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90af100 with x1830881260966272 ext(1048576->2097151) 00002000:00010000:1.0:1746065121.390080:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90af100 00000100:00100000:0.0:1746065121.395152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.395225:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260966400 00000100:00100000:3.0:1746065121.395233:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260966400 00000100:00100000:3.0:1746065121.395280:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10589 00000100:00100000:3.0:1746065121.395287:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+15:28905:x1830881260966400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.395301:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.395316:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac3c expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.395336:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.395337:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.395343:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac3c expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.395370:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac3c expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.395379:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f40ca00, rc 0) 00000100:00100000:3.0:1746065121.395430:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:28905:x1830881260966400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 143us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.395436:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10589 00000100:00100000:0.0:1746065121.396166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.396204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.396266:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260966528 00000100:00100000:1.0:1746065121.396271:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260966528 00000100:00100000:1.0:1746065121.396305:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260966656 00000100:00100000:1.0:1746065121.396308:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260966656 00000100:00100000:1.0:1746065121.396322:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10590 00000100:00100000:1.0:1746065121.396327:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881260966528:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.396338:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065121.396355:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10591 00010000:00010000:1.0:1746065121.396360:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b266200/0x14b4f8542d4f2ada lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac43 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.396363:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260966656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.396373:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.396386:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935aec00/0x14b4f8542d4f2ae1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac4a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.396395:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259700096:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.396410:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259700224:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.396467:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.396499:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.399374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065121.399414:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065121 -> 1746065122 00002000:00010000:1.0:1746065121.399418:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065121 -> 1746065122 00000100:00100000:1.0:1746065121.399436:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259700096:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065121.399461:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b266200/0x14b4f8542d4f2ada lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac43 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.399462:0:8428:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.399473:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b266200/0x14b4f8542d4f2ada lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac43 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065121.399480:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259700224:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065121.399497:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935aec00/0x14b4f8542d4f2ae1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac4a expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.399506:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935aec00/0x14b4f8542d4f2ae1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac4a expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.399525:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b266200, rc 0) 00010000:00010000:2.0:1746065121.399528:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935aec00, rc 0) 00000100:00100000:1.0:1746065121.399567:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881260966528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3238us (3401us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065121.399574:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10590 00000100:00100000:1.0:1746065121.399612:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260966912 00000100:00100000:1.0:1746065121.399617:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260966912 00002000:00100000:1.0:1746065121.399644:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88013026a300 x1830881260966912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.399652:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026a300 with x1830881260966912 ext(1048576->2097151) 00002000:00010000:1.0:1746065121.399656:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013026a300 00000100:00100000:1.0:1746065121.399670:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4832 00000100:00100000:1.0:1746065121.399675:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260966912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.399718:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881260966656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3356us (3512us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065121.399724:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10591 00000100:00100000:0.0:1746065121.402022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.402174:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260967040 00000100:00100000:3.0:1746065121.402181:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260967040 00000100:00100000:3.0:1746065121.402223:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10592 00000100:00100000:3.0:1746065121.402230:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:28904:x1830881260967040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.402246:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.402260:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac51 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.402283:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.402290:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065121.402292:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065121.402294:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.402318:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.402328:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 17 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.402338:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259700352:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.402426:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.406692:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.406714:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259700352:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.406738:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.406752:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f40ce00, rc 0) 00000100:00100000:3.0:1746065121.406801:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:28904:x1830881260967040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4570us (4783us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.406809:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10592 00000100:00100000:2.0:1746065121.407149:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260967168 00000100:00100000:2.0:1746065121.407154:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260967168 00002000:00100000:2.0:1746065121.407182:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3899392->3940351) req@ffff880130269880 x1830881260967168/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.407191:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130269880 with x1830881260967168 ext(3899392->3940351) 00010000:00010000:2.0:1746065121.407198:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 18 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.407209:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 18 pid: 9716 timeout: 820 lvb_type: 0 00002000:00010000:2.0:1746065121.407216:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130269880 00000100:00100000:2.0:1746065121.407236:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1493 00000100:00100000:2.0:1746065121.407242:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260967168:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065121.409319:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260967168:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 2070us (2628us total) trans 17179872783 rc 0/0 00000100:00100000:3.0:1746065121.409328:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1493 00002000:00100000:3.0:1746065121.409336:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3899392->3940351) req@ffff880130269880 x1830881260967168/t17179872783(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/448 e 0 to 0 dl 1746065132 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.409343:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130269880 with x1830881260967168 ext(3899392->3940351) 00010000:00010000:3.0:1746065121.409360:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 20 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.409371:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 20 pid: 9716 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746065121.409376:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130269880 00000100:00100000:1.0:1746065121.410378:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260966912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10700us (11007us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.410386:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4832 00002000:00100000:1.0:1746065121.410392:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88013026a300 x1830881260966912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.410399:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026a300 with x1830881260966912 ext(1048576->2097151) 00002000:00010000:1.0:1746065121.410402:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013026a300 00000100:00100000:0.0:1746065121.411418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.411497:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260967296 00000100:00100000:3.0:1746065121.411503:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260967296 00010000:00010000:3.0:1746065121.411523:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 18 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.411550:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5269 00000100:00100000:3.0:1746065121.411554:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260967296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.411563:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.411574:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 18 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.411585:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 18 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.411601:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b267e00/0x14b4f8542d4f2ab0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->3940351) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac19 expref: 18 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.411618:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.411620:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.411628:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.411636:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.411660:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.411670:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259700480:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.411732:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.414803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.414870:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260967424 00000100:00100000:3.0:1746065121.414877:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260967424 00000100:00100000:0.0:1746065121.414912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.414914:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10593 00000100:00100000:3.0:1746065121.414921:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881260967424:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065121.414927:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260967552 00000100:00100000:0.0:1746065121.414931:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260967552 00010000:00010000:3.0:1746065121.414935:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.414947:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac58 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.414963:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10594 00010000:00010000:3.0:1746065121.414966:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.414968:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065121.414969:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260967552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.414974:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac58 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065121.414977:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.414986:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac58 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065121.414987:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090b1d800/0x14b4f8542d4f2af6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac5f expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.414995:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f40d600, rc 0) 00000100:00100000:0.0:1746065121.415022:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259700608:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.415031:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260967424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 110us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.415037:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10593 00000100:00100000:0.0:1746065121.415068:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.418262:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259700480:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.418278:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.418310:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260967296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6753us (6893us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.418318:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5269 00000100:00100000:0.0:1746065121.419008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.419092:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260967680 00000100:00100000:2.0:1746065121.419102:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260967680 00000100:00100000:2.0:1746065121.419518:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10595 00000100:00100000:2.0:1746065121.419526:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:28902:x1830881260967680:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065121.419538:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065121.419541:0:21235:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.419552:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac66 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.419562:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259700608:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065121.419574:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.419581:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac35 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.419581:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090b1d800/0x14b4f8542d4f2af6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac5f expref: 16 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.419587:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.419588:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.419590:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d800/0x14b4f8542d4f2af6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac5f expref: 16 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.419592:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1269760->2097151] (req 1269760->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.419609:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1d800, rc 0) 00010000:00010000:2.0:1746065121.419619:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac35 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.419628:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260967552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4659us (4716us total) trans 0 rc 301/301 00010000:00010000:2.0:1746065121.419629:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac35 expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746065121.419633:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10594 00000100:00100000:2.0:1746065121.419639:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259700736:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.419690:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.419697:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.419704:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259700864:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.419723:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.421044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.421128:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259700736:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.421137:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259700864:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.421142:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260967936 00000100:00100000:1.0:1746065121.421147:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260967936 00010000:00010000:2.0:1746065121.421156:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1269760->2097151] (req 1269760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.421167:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1c00, rc 0) 00002000:00100000:1.0:1746065121.421172:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012bd3f100 x1830881260967936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.421180:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f100 with x1830881260967936 ext(2097152->3145727) 00002000:00010000:1.0:1746065121.421184:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3f100 00000100:00100000:1.0:1746065121.421502:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4833 00000100:00100000:1.0:1746065121.421508:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260967936:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.421629:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:28902:x1830881260967680:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2103us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.421637:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10595 00000100:00100000:0.0:1746065121.422602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.422644:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260968064 00000100:00100000:3.0:1746065121.422648:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260968064 00010000:00010000:3.0:1746065121.422669:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac35 expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.422688:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5270 00000100:00100000:3.0:1746065121.422693:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260968064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.422701:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.422716:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac35 expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.422725:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac35 expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.422741:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b266800/0x14b4f8542d4f2acc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac35 expref: 15 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.422768:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.422791:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881260968064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.422796:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5270 00000100:00100000:2.0:1746065121.424938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.424958:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260968192 00000100:00100000:0.0:1746065121.424964:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260968192 00000100:00100000:2.0:1746065121.424981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065121.424985:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746065121.425005:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5271 00000100:00100000:0.0:1746065121.425012:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260968192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.425021:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065121.425036:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.425046:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.425050:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260968448 00000100:00100000:3.0:1746065121.425053:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260968448 00010000:00010000:0.0:1746065121.425061:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b267a00/0x14b4f8542d4f2ab7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac20 expref: 21 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.425072:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.425073:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746065121.425075:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012d7fd500 x1830881260968448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746065121.425079:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065121.425084:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fd500 with x1830881260968448 ext(2097152->3145727) 00010000:00010000:0.0:1746065121.425086:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065121.425087:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fd500 00000100:00100000:3.0:1746065121.425099:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4834 00000100:00100000:3.0:1746065121.425103:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260968448:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:0.0:1746065121.425109:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.425118:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259700992:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065121.425162:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.427768:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259700992:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.427770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065121.427785:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.428509:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881260968192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3495us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.428518:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5271 00000100:00100000:2.0:1746065121.430156:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260968704 00000100:00100000:2.0:1746065121.430165:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260968704 00002000:00100000:2.0:1746065121.430199:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37a:0x0] (1269760->1273855) req@ffff88008fc5ad80 x1830881260968704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.430209:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5ad80 with x1830881260968704 ext(1269760->1273855) 00002000:00010000:2.0:1746065121.430214:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5ad80 00000100:00100000:2.0:1746065121.430244:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4835 00000100:00100000:2.0:1746065121.430251:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881260968704:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.430403:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881260968704:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 152us (2634us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065121.430409:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4835 00002000:00100000:2.0:1746065121.430414:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x37a:0x0] (1269760->1273855) req@ffff88008fc5ad80 x1830881260968704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.430421:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5ad80 with x1830881260968704 ext(1269760->1273855) 00002000:00010000:2.0:1746065121.430424:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5ad80 00000100:00100000:3.0:1746065121.438317:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260968448:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13201us (13323us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.438328:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4834 00002000:00100000:3.0:1746065121.438338:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012d7fd500 x1830881260968448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.438364:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fd500 with x1830881260968448 ext(2097152->3145727) 00002000:00010000:3.0:1746065121.438369:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fd500 00000100:00100000:1.0:1746065121.443932:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260967936:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 22414us (22880us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.443945:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4833 00002000:00100000:1.0:1746065121.443956:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012bd3f100 x1830881260967936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.443965:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f100 with x1830881260967936 ext(2097152->3145727) 00002000:00010000:1.0:1746065121.443970:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3f100 00000100:00100000:0.0:1746065121.445619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.445673:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260968832 00000100:00100000:2.0:1746065121.445682:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260968832 00000100:00100000:2.0:1746065121.445748:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10596 00000100:00100000:2.0:1746065121.445756:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+14:28905:x1830881260968832:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.445769:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.445782:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac6d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.445807:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.446014:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.446017:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.446021:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.446048:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.446458:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 12 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.446469:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259701120:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.446757:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.447646:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259701120:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.447665:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.447678:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1800, rc 0) 00000100:00100000:2.0:1746065121.447705:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+15:28905:x1830881260968832:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1949us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.447712:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10596 00000100:00100000:0.0:1746065121.448117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.448364:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260968960 00000100:00100000:2.0:1746065121.448369:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260968960 00010000:00010000:2.0:1746065121.448391:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 13 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.448455:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5272 00000100:00100000:2.0:1746065121.448462:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260968960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.448472:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.448491:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 13 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.448500:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 13 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.448518:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f29d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abb7 expref: 13 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746065121.448539:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.448544:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.448549:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.448556:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.448579:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.448680:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259701248:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.448739:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.449246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.449373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.449450:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260969088 00000100:00100000:2.0:1746065121.449453:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260969088 00000100:00100000:2.0:1746065121.449470:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260969216 00000100:00100000:2.0:1746065121.449472:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260969216 00000100:00100000:2.0:1746065121.449583:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10597 00000100:00100000:2.0:1746065121.449589:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:28902:x1830881260969088:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065121.449600:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.449611:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac74 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.449630:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.449637:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac3c expref: 17 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.449642:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.449643:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.449646:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1241087] (req 1048576->1241087) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.449662:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac3c expref: 17 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.449676:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac3c expref: 17 pid: 21998 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.449685:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259701376:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.449731:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.449738:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 28 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.449745:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259701504:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.449761:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.449852:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10598 00000100:00100000:0.0:1746065121.449859:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:28904:x1830881260969216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065121.449866:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065121.449875:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac7b expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.449885:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.449886:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.449891:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac7b expref: 21 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.449900:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac7b expref: 21 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.449907:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935aee00, rc 0) 00000100:00100000:0.0:1746065121.449924:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:28904:x1830881260969216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 66us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.449928:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10598 00000100:00100000:0.0:1746065121.451474:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259701248:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065121.451488:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.451511:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260968960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3049us (3396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.451520:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5272 00000100:00100000:2.0:1746065121.452028:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259701376:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.452036:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259701504:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.452050:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1241087] (req 1048576->1241087) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.452061:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1000, rc 0) 00000100:00100000:2.0:1746065121.452080:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:28902:x1830881260969088:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2491us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.452085:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10597 00000100:00100000:1.0:1746065121.458096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.458131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.458161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.458467:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260969856 00000100:00100000:2.0:1746065121.458475:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260969856 00000100:00100000:0.0:1746065121.458689:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260969344 00000100:00100000:0.0:1746065121.458693:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260969344 00000100:00100000:1.0:1746065121.458697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065121.458712:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac3c expref: 18 pid: 21998 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.458721:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260969472 00000100:00100000:3.0:1746065121.458725:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260969472 00010000:00010000:3.0:1746065121.458740:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 28 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746065121.458744:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5273 00000100:00100000:0.0:1746065121.458751:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260969344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065121.458759:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5274 00000100:00100000:3.0:1746065121.458763:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881260969472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.458764:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.458768:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.458781:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 28 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.458781:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac3c expref: 18 pid: 21998 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.458790:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 28 pid: 9716 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065121.458859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.458871:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260969984 00000100:00100000:1.0:1746065121.458874:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260969984 00002000:00100000:1.0:1746065121.458892:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880094a11180 x1830881260969984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.458899:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11180 with x1830881260969984 ext(3145728->4194303) 00002000:00010000:1.0:1746065121.458903:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a11180 00000100:00100000:1.0:1746065121.458912:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260970240 00000100:00100000:1.0:1746065121.458914:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260970240 00002000:00100000:1.0:1746065121.458930:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094a13b80 x1830881260970240/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.458936:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13b80 with x1830881260970240 ext(3145728->4194303) 00002000:00010000:1.0:1746065121.458938:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13b80 00000100:00100000:1.0:1746065121.458954:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4836 00000100:00100000:1.0:1746065121.458959:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260969984:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:0.0:1746065121.459061:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac3c expref: 19 pid: 21998 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.459083:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f40ca00/0x14b4f8542d4f2ad3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac3c expref: 19 pid: 21998 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.459099:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.459130:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260969344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 380us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.459135:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5273 00010000:00010000:3.0:1746065121.459304:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b266a00/0x14b4f8542d4f2ac5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac2e expref: 28 pid: 9716 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.459326:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.459328:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.459334:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.459341:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.459371:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4837 00000100:00100000:3.0:1746065121.459377:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260970240:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065121.459978:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.459990:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259701632:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.460032:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00002000:00100000:2.0:1746065121.460103:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880094a12d80 x1830881260969856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.460112:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a12d80 with x1830881260969856 ext(2097152->3145727) 00002000:00010000:2.0:1746065121.460116:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a12d80 00000100:00100000:2.0:1746065121.460142:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4838 00000100:00100000:2.0:1746065121.460149:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260969856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065121.464465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.464504:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.464518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.464611:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260970880 00000100:00100000:0.0:1746065121.464619:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260970880 00002000:00100000:0.0:1746065121.464655:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009baa2a00 x1830881260970880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065121.464664:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2a00 with x1830881260970880 ext(3145728->4194303) 00002000:00010000:0.0:1746065121.464669:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2a00 00000100:00100000:0.0:1746065121.464689:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260970752 00000100:00100000:0.0:1746065121.464692:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260970752 00002000:00100000:0.0:1746065121.464702:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009baa0700 x1830881260970752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065121.464709:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0700 with x1830881260970752 ext(2097152->3145727) 00002000:00010000:0.0:1746065121.464711:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa0700 00000100:00100000:0.0:1746065121.464718:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260970624 00000100:00100000:0.0:1746065121.464720:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260970624 00002000:00100000:0.0:1746065121.464728:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009baa3480 x1830881260970624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065121.464734:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3480 with x1830881260970624 ext(3145728->4194303) 00002000:00010000:0.0:1746065121.464736:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa3480 00000100:00100000:0.0:1746065121.464752:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4839 00000100:00100000:0.0:1746065121.464758:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260970880:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065121.465061:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4840 00000100:00100000:1.0:1746065121.465070:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881260970752:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065121.465877:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4841 00000100:00100000:0.0:1746065121.465884:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260970624:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065121.467268:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259701632:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.467287:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.467318:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260969472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8553us (9156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.467326:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5274 00000100:00100000:2.0:1746065121.470218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.471267:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260971264 00000100:00100000:3.0:1746065121.471276:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260971264 00000100:00100000:2.0:1746065121.471277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.471295:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260971520 00000100:00100000:2.0:1746065121.471298:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260971520 00000100:00100000:3.0:1746065121.471311:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8990 00000100:00100000:3.0:1746065121.471317:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:28908:x1830881260971264:12345-192.168.202.46@tcp:101:multiop.0 00002000:00100000:2.0:1746065121.471325:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1236992->1241087) req@ffff88008fc5bb80 x1830881260971520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746065121.471333:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.471354:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d000/0x14b4f8542d4f2b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac82 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065121.471400:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5bb80 with x1830881260971520 ext(1236992->1241087) 00002000:00010000:2.0:1746065121.471404:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5bb80 00000100:00100000:2.0:1746065121.471425:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4842 00000100:00100000:2.0:1746065121.471431:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881260971520:12345-192.168.202.46@tcp:3:multiop.0 00010000:00010000:3.0:1746065121.471459:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471470:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471479:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471548:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471555:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065121.471557:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881260971520:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 126us (282us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746065121.471561:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065121.471564:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4842 00002000:00100000:2.0:1746065121.471569:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1236992->1241087) req@ffff88008fc5bb80 x1830881260971520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.471576:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5bb80 with x1830881260971520 ext(1236992->1241087) 00002000:00010000:2.0:1746065121.471579:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5bb80 00010000:00010000:3.0:1746065121.471646:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471652:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471657:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065121.471663:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065121.471718:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471723:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471727:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471732:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f40d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065121.471734:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471740:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471748:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065121.471750:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065121.471753:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471757:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d200/0x14b4f8542d4f2b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471781:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471785:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471790:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471793:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f40d800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065121.471794:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471798:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471802:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2c000) 00010000:00010000:3.0:1746065121.471804:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065121.471805:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471809:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d800/0x14b4f8542d4f2b27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065121.471847:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40d000/0x14b4f8542d4f2b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac82 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.471855:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac82 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.471861:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.471862:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065121.471864:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f40da00, rc 0) 00000100:00100000:3.0:1746065121.471878:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:28908:x1830881260971264:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 562us (1670us total) trans 8589943032 rc 0/0 00000100:00100000:3.0:1746065121.471883:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8990 00000100:00100000:1.0:1746065121.474716:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260969984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15749us (16010us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.474726:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4836 00002000:00100000:1.0:1746065121.474735:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880094a11180 x1830881260969984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.474743:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11180 with x1830881260969984 ext(3145728->4194303) 00002000:00010000:1.0:1746065121.474748:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a11180 00000100:00100000:3.0:1746065121.475117:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881260969856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14967us (16983us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.475124:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4838 00002000:00100000:3.0:1746065121.475129:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880094a12d80 x1830881260969856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.475136:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a12d80 with x1830881260969856 ext(2097152->3145727) 00002000:00010000:3.0:1746065121.475139:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a12d80 00000100:00100000:3.0:1746065121.481950:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260970240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22565us (23082us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.481962:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4837 00002000:00100000:3.0:1746065121.481972:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094a13b80 x1830881260970240/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.481986:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13b80 with x1830881260970240 ext(3145728->4194303) 00002000:00010000:3.0:1746065121.481990:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13b80 00000100:00100000:2.0:1746065121.485329:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260970880:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 20561us (20862us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.485341:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4839 00002000:00100000:2.0:1746065121.485362:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009baa2a00 x1830881260970880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.485372:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2a00 with x1830881260970880 ext(3145728->4194303) 00002000:00010000:2.0:1746065121.485376:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2a00 00000100:00100000:1.0:1746065121.488051:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260970752:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 22973us (23536us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.488062:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4840 00002000:00100000:1.0:1746065121.488072:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009baa0700 x1830881260970752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.488082:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0700 with x1830881260970752 ext(2097152->3145727) 00002000:00010000:1.0:1746065121.488088:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa0700 00000100:00100000:0.0:1746065121.489611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.489682:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260970624:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 23797us (25161us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.489691:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4841 00002000:00100000:2.0:1746065121.489699:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009baa3480 x1830881260970624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.489707:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3480 with x1830881260970624 ext(3145728->4194303) 00002000:00010000:2.0:1746065121.489712:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa3480 00000100:00100000:0.0:1746065121.489869:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.490244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.490297:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260972032 00000100:00100000:1.0:1746065121.490303:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260972032 00000100:00100000:1.0:1746065121.490329:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3659 00000100:00100000:1.0:1746065121.490335:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28902:x1830881260972032:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065121.490384:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260971648 00000100:00100000:2.0:1746065121.490390:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260971648 00000100:00100000:2.0:1746065121.490415:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260971776 00000100:00100000:2.0:1746065121.490418:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260971776 00000100:00100000:2.0:1746065121.490432:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10599 00000100:00100000:2.0:1746065121.490436:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260971648:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.490445:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.490459:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0c00/0x14b4f8542d4f2b3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac89 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.490485:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28902:x1830881260972032:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 149us (241us total) trans 8589943033 rc 0/0 00000100:00100000:1.0:1746065121.490490:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3659 00000100:00100000:2.0:1746065121.490497:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259701760:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065121.490509:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10600 00000100:00100000:1.0:1746065121.490513:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881260971776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.490519:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.490527:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd8d400/0x14b4f8542d4f2b43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac90 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.490549:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259701888:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.490550:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.490568:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b540 going to sleep for 11 seconds 00002000:00010000:2.0:1746065121.505328:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime: 1746065121 -> 1746065122 00002000:00010000:2.0:1746065121.505336:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime: 1746065121 -> 1746065122 00000100:00100000:2.0:1746065121.505371:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259701760:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065121.505403:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0c00/0x14b4f8542d4f2b3c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac89 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.505419:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0c00/0x14b4f8542d4f2b3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac89 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.505449:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc0c00, rc 0) 00000100:00100000:2.0:1746065121.505799:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881260971648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 15356us (16186us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065121.505807:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10599 00002000:00010000:3.0:1746065121.511933:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065121 -> 1746065122 00002000:00010000:3.0:1746065121.511941:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065121 -> 1746065122 00000100:00100000:3.0:1746065121.511965:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259701888:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065121.511997:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd8d400/0x14b4f8542d4f2b43 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac90 expref: 18 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.512012:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd8d400/0x14b4f8542d4f2b43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac90 expref: 18 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.512050:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd8d400, rc 0) 00000100:00100000:3.0:1746065121.512123:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881260971776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 21605us (22250us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065121.512131:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10600 00000100:00100000:0.0:1746065121.512176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.514975:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260972288 00000100:00100000:2.0:1746065121.514986:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260972288 00002000:00100000:2.0:1746065121.515026:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009baa1500 x1830881260972288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.515036:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1500 with x1830881260972288 ext(4194304->4976639) 00002000:00010000:2.0:1746065121.515042:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa1500 00000100:00100000:2.0:1746065121.515069:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4843 00000100:00100000:2.0:1746065121.515076:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260972288:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065121.523642:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.524414:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260972544 00000100:00100000:1.0:1746065121.524422:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260972544 00002000:00100000:1.0:1746065121.524457:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009baa2d80 x1830881260972544/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.524472:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2d80 with x1830881260972544 ext(4194304->4976639) 00002000:00010000:1.0:1746065121.524476:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa2d80 00000100:00100000:1.0:1746065121.524508:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4844 00000100:00100000:1.0:1746065121.524515:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260972544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065121.525018:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260972288:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9940us (12841us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746065121.525025:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4843 00002000:00100000:2.0:1746065121.525031:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009baa1500 x1830881260972288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.525039:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1500 with x1830881260972288 ext(4194304->4976639) 00002000:00010000:2.0:1746065121.525042:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa1500 00000100:00100000:1.0:1746065121.540789:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260972544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16266us (17146us total) trans 0 rc 782336/782336 00000100:00100000:1.0:1746065121.540798:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4844 00002000:00100000:1.0:1746065121.540808:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4976639) req@ffff88009baa2d80 x1830881260972544/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.540838:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2d80 with x1830881260972544 ext(4194304->4976639) 00002000:00010000:1.0:1746065121.540843:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa2d80 00000100:00100000:0.0:1746065121.549561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.549799:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260972800 00000100:00100000:2.0:1746065121.549807:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260972800 00000100:00100000:2.0:1746065121.549885:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3660 00000100:00100000:2.0:1746065121.549893:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28904:x1830881260972800:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065121.550077:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28904:x1830881260972800:12345-192.168.202.46@tcp:35:cat.0 Request processed in 185us (524us total) trans 8589943034 rc 0/0 00000100:00100000:2.0:1746065121.550083:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3660 00000100:00100000:0.0:1746065121.551668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.551708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.551730:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260972928 00000100:00100000:3.0:1746065121.551737:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260972928 00000100:00100000:3.0:1746065121.551776:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260973056 00000100:00100000:3.0:1746065121.551779:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260973056 00000100:00100000:3.0:1746065121.551884:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10601 00000100:00100000:3.0:1746065121.551891:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260972928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.551904:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.551918:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133261c00/0x14b4f8542d4f2b4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac97 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.551963:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259702016:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.552061:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.552087:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10602 00000100:00100000:2.0:1746065121.552095:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260973056:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.552102:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.552110:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0600/0x14b4f8542d4f2b51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ac9e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.552334:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259702144:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.552365:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.556604:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259702144:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.556631:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259702016:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065121.556632:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0600/0x14b4f8542d4f2b51 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac9e expref: 18 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.556642:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0600/0x14b4f8542d4f2b51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac9e expref: 18 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.556644:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133261c00/0x14b4f8542d4f2b4a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac97 expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.556652:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133261c00/0x14b4f8542d4f2b4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac97 expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.556661:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133261c00, rc 0) 00010000:00010000:2.0:1746065121.556668:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc0600, rc 0) 00000100:00100000:3.0:1746065121.556895:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881260972928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5003us (5227us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065121.556903:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10601 00000100:00100000:2.0:1746065121.558390:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260973056:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6294us (6678us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065121.558396:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10602 00000100:00100000:0.0:1746065121.561462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.562027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.562236:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260973312 00000100:00100000:3.0:1746065121.562244:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260973312 00000100:00100000:3.0:1746065121.562283:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260973184 00000100:00100000:3.0:1746065121.562284:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260973184 00000100:00100000:3.0:1746065121.562301:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10603 00000100:00100000:3.0:1746065121.562307:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260973312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.562320:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.562332:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133261400/0x14b4f8542d4f2b58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5acac expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.562389:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259702272:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.562411:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10604 00000100:00100000:2.0:1746065121.562417:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260973184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.562424:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.562432:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f2b5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aca5 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.562452:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.562456:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259702400:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.562475:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.566953:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259702400:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065121.566983:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f2b5f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aca5 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.566995:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f2b5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aca5 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.567018:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc0a00, rc 0) 00000100:00100000:2.0:1746065121.567067:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881260973184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4649us (5039us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065121.567074:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10604 00000100:00100000:3.0:1746065121.567959:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259702272:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065121.567978:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133261400/0x14b4f8542d4f2b58 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acac expref: 18 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.567988:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133261400/0x14b4f8542d4f2b58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acac expref: 18 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.568012:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133261400, rc 0) 00000100:00100000:3.0:1746065121.568046:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260973312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5737us (6589us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065121.568052:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10603 00000100:00100000:0.0:1746065121.585790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.587951:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260973440 00000100:00100000:2.0:1746065121.587961:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260973440 00000100:00100000:2.0:1746065121.588002:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10605 00000100:00100000:2.0:1746065121.588010:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:28908:x1830881260973440:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065121.588025:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.588040:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5acb3 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.588063:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.588071:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.588072:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.588076:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1138688->1912831] (req 1138688->1912831) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.588099:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.588110:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 20 pid: 21998 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746065121.588120:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259702528:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.588199:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.591357:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259702528:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.591381:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1138688->1912831] (req 1138688->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.591397:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1e00, rc 0) 00000100:00100000:2.0:1746065121.591426:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:28908:x1830881260973440:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3416us (5643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.591432:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10605 00000100:00100000:0.0:1746065121.592114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.592188:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260973568 00000100:00100000:1.0:1746065121.592194:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260973568 00002000:00100000:1.0:1746065121.592220:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1269760->2097151) req@ffff880134d84000 x1830881260973568/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.592225:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84000 with x1830881260973568 ext(1269760->2097151) 00010000:00010000:1.0:1746065121.592230:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 21 pid: 21998 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.592238:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 21 pid: 21998 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746065121.592246:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d84000 00000100:00100000:1.0:1746065121.592266:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1494 00000100:00100000:1.0:1746065121.592271:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881260973568:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065121.602893:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260973568:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10612us (10771us total) trans 21474840012 rc 0/0 00000100:00100000:1.0:1746065121.602904:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1494 00002000:00100000:1.0:1746065121.602913:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1269760->2097151) req@ffff880134d84000 x1830881260973568/t21474840012(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/448 e 0 to 0 dl 1746065132 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.602921:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84000 with x1830881260973568 ext(1269760->2097151) 00010000:00010000:1.0:1746065121.602929:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 23 pid: 21998 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.602943:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 23 pid: 21998 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746065121.602949:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d84000 00000100:00100000:0.0:1746065121.609038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.609233:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260973696 00000100:00100000:3.0:1746065121.609242:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260973696 00010000:00010000:3.0:1746065121.609273:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 23 pid: 21998 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.609309:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5275 00000100:00100000:3.0:1746065121.609317:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260973696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.609328:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.609358:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 23 pid: 21998 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.609370:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 23 pid: 21998 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.609395:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1c00/0x14b4f8542d4f2afd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac66 expref: 23 pid: 21998 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746065121.609423:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.609424:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.609431:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.609439:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.609465:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.609475:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259702656:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.609546:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.611416:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.611482:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260973952 00000100:00100000:1.0:1746065121.611488:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260973952 00002000:00100000:1.0:1746065121.611520:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1138688->1142783) req@ffff880134d86a00 x1830881260973952/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.611528:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86a00 with x1830881260973952 ext(1138688->1142783) 00002000:00010000:1.0:1746065121.611531:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d86a00 00000100:00100000:3.0:1746065121.611613:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259702656:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.611627:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.611654:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881260973696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2337us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.611661:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5275 00000100:00100000:1.0:1746065121.611739:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4845 00000100:00100000:1.0:1746065121.611745:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260973952:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065121.611900:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260973952:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 156us (489us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065121.611910:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4845 00002000:00100000:1.0:1746065121.611916:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1138688->1142783) req@ffff880134d86a00 x1830881260973952/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.611922:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86a00 with x1830881260973952 ext(1138688->1142783) 00002000:00010000:1.0:1746065121.611925:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d86a00 00000100:00100000:0.0:1746065121.618980:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.619754:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260974208 00000100:00100000:2.0:1746065121.619762:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260974208 00002000:00100000:2.0:1746065121.619799:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1908736->1912831) req@ffff880134d86300 x1830881260974208/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.619807:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86300 with x1830881260974208 ext(1908736->1912831) 00002000:00010000:2.0:1746065121.619812:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d86300 00000100:00100000:2.0:1746065121.620158:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4846 00000100:00100000:0.0:1746065121.620159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.620165:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260974208:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.620312:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260974208:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 146us (1340us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065121.620318:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4846 00002000:00100000:2.0:1746065121.620323:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1908736->1912831) req@ffff880134d86300 x1830881260974208/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.620330:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86300 with x1830881260974208 ext(1908736->1912831) 00002000:00010000:2.0:1746065121.620337:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d86300 00000100:00100000:3.0:1746065121.620414:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260974464 00000100:00100000:3.0:1746065121.620418:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260974464 00000100:00100000:3.0:1746065121.620455:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8991 00000100:00100000:3.0:1746065121.620461:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28913:x1830881260974464:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065121.620476:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.620490:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133261200/0x14b4f8542d4f2b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5acba expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.620567:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620577:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620586:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620596:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620601:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620606:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620695:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620702:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620708:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065121.620715:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065121.620779:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620789:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620794:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620799:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133261000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065121.620802:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620807:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620833:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065121.620836:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065121.620839:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620844:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620923:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620929:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620934:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620937:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133260c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065121.620940:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620947:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620953:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2c900) 00010000:00010000:3.0:1746065121.620955:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065121.620957:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620961:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260c00/0x14b4f8542d4f2b7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.620991:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133261200/0x14b4f8542d4f2b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acba expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.621001:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acba expref: 252 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.621006:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.621008:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065121.621009:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133260a00, rc 0) 00000100:00100000:3.0:1746065121.621697:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:28913:x1830881260974464:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1234us (1536us total) trans 8589943035 rc 0/0 00000100:00100000:3.0:1746065121.621704:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8991 00000100:00100000:0.0:1746065121.624733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.624921:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260974720 00000100:00100000:1.0:1746065121.624929:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260974720 00000100:00100000:1.0:1746065121.624964:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3661 00000100:00100000:1.0:1746065121.624971:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:28908:x1830881260974720:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065121.626640:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:28908:x1830881260974720:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1662us (1909us total) trans 8589943036 rc 0/0 00000100:00100000:1.0:1746065121.626649:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3661 00000100:00100000:0.0:1746065121.643749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.644079:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260974848 00000100:00100000:3.0:1746065121.644089:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260974848 00000100:00100000:3.0:1746065121.644138:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8992 00000100:00100000:3.0:1746065121.644148:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:28915:x1830881260974848:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065121.644173:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.644192:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2b90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5acc1 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.644255:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644267:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644277:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644292:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644297:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644302:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644427:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644435:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644441:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065121.644482:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:3.0:1746065121.644487:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065121.644501:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644510:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644518:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644523:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644528:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644533:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133260600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065121.644537:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644543:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644553:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065121.644555:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065121.644559:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644563:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2b97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644581:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644587:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644591:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644594:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133260400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065121.644597:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644602:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644608:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2c900) 00010000:00010000:3.0:1746065121.644611:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065121.644613:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644617:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2b9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.644644:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2b90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc1 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.644656:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc1 expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.644661:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.645769:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065121.645776:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133260200, rc 0) 00000100:00100000:3.0:1746065121.645853:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28915:x1830881260974848:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1706us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.645859:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8992 00000100:00100000:0.0:1746065121.650218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.650802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.650874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.650906:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260974976 00000100:00100000:1.0:1746065121.650918:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260974976 00000100:00100000:1.0:1746065121.650952:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260975104 00000100:00100000:1.0:1746065121.650954:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260975104 00000100:00100000:1.0:1746065121.650964:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260975232 00000100:00100000:1.0:1746065121.650966:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260975232 00000100:00100000:1.0:1746065121.650978:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10606 00000100:00100000:1.0:1746065121.650985:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881260974976:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.651000:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.651013:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5acc8 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.651028:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10607 00010000:00010000:1.0:1746065121.651034:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065121.651035:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1958:x1830881260975104:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.651036:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.651041:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.651044:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc8 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.651049:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5accf expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.651056:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc8 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.651057:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.651059:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.651062:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5accf expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.651064:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cdd000, rc 0) 00010000:00010000:2.0:1746065121.651070:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5accf expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.651075:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc0400, rc 0) 00000100:00100000:1.0:1746065121.651103:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881260974976:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 119us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.651109:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10606 00000100:00100000:1.0:1746065121.651122:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10608 00000100:00100000:1.0:1746065121.651127:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881260975232:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.651132:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.651138:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099cdde00/0x14b4f8542d4f2bba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5acd6 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.651168:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259702784:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.651212:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1958:x1830881260975104:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 177us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.651217:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10607 00000100:00100000:3.0:1746065121.651236:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.651250:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260975360 00000100:00100000:2.0:1746065121.651253:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260975360 00000100:00100000:1.0:1746065121.651389:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.651466:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10609 00000100:00100000:2.0:1746065121.651475:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881260975360:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065121.651483:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.651493:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f2bc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5acdd expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.651525:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259702912:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.651557:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.652008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.652059:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.652105:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260975488 00000100:00100000:1.0:1746065121.652108:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260975488 00000100:00100000:0.0:1746065121.652118:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260975616 00000100:00100000:0.0:1746065121.652121:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260975616 00000100:00100000:1.0:1746065121.652124:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10610 00000100:00100000:1.0:1746065121.652128:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881260975488:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:0.0:1746065121.652133:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10611 00010000:00010000:1.0:1746065121.652134:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065121.652138:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1958:x1830881260975616:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065121.652140:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ace4 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.652142:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065121.652146:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aceb expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.652149:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.652151:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.652153:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.652155:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ace4 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065121.652155:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.652158:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aceb expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.652164:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ace4 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065121.652165:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aceb expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.652170:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd8dc00, rc 0) 00010000:00010000:0.0:1746065121.652171:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1cc00, rc 0) 00000100:00100000:1.0:1746065121.652188:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881260975488:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 59us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.652193:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10610 00000100:00100000:3.0:1746065121.653157:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1958:x1830881260975616:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1015us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.653166:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10611 00000100:00100000:1.0:1746065121.654961:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259702784:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065121.654991:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099cdde00/0x14b4f8542d4f2bba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acd6 expref: 15 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.655004:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cdde00/0x14b4f8542d4f2bba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acd6 expref: 15 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.655031:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cdde00, rc 0) 00000100:00100000:1.0:1746065121.655071:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881260975232:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3942us (4194us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065121.655078:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10608 00000100:00100000:2.0:1746065121.655729:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259702912:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065121.655750:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f2bc1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acdd expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.655761:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f2bc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acdd expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.655784:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1a00, rc 0) 00000100:00100000:2.0:1746065121.655844:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260975360:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4369us (4605us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065121.655850:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10609 00000100:00100000:0.0:1746065121.660620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.660728:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260975872 00000100:00100000:3.0:1746065121.660735:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260975872 00000100:00100000:3.0:1746065121.660776:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8993 00000100:00100000:3.0:1746065121.660783:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28915:x1830881260975872:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065121.660799:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.660829:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260000/0x14b4f8542d4f2bd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5acf2 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.660902:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.660913:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac82 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.660919:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acba expref: 251 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.660925:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc1 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.660930:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 6/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.660952:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc1 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.660961:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc1 expref: 8 pid: 24350 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.660974:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259703040:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.661040:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acba expref: 251 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.661047:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acba expref: 251 pid: 24350 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.661053:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259703168:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.661069:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac82 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.661075:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac82 expref: 12 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.661081:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259703296:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.661091:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.663253:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259703040:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.663263:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259703168:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.663270:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259703296:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.663287:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065121.667513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.667570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.667639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.667667:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260976000 00000100:00100000:0.0:1746065121.667675:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260976000 00010000:00010000:0.0:1746065121.667709:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc1 expref: 9 pid: 24350 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746065121.667737:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260976256 00000100:00100000:0.0:1746065121.667741:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260976256 00010000:00010000:0.0:1746065121.667757:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac82 expref: 13 pid: 16767 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746065121.667774:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260976128 00000100:00100000:0.0:1746065121.667777:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260976128 00010000:00010000:0.0:1746065121.667789:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acba expref: 252 pid: 24350 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746065121.667808:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5276 00000100:00100000:0.0:1746065121.667868:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881260976000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.667883:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065121.667891:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc1 expref: 9 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.667901:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc1 expref: 9 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.667921:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260200/0x14b4f8542d4f2ba5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc1 expref: 9 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.667951:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065121.667956:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065121.667964:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065121.667969:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.668014:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881260976000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 198us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.668020:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5276 00000100:00100000:0.0:1746065121.668043:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5277 00000100:00100000:0.0:1746065121.668050:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881260976256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.668058:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065121.668063:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac82 expref: 13 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.668070:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac82 expref: 13 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.668085:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f40da00/0x14b4f8542d4f2b2e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac82 expref: 13 pid: 16767 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.668094:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065121.668096:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065121.668101:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065121.668105:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.668125:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881260976256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.668131:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5277 00000100:00100000:0.0:1746065121.668144:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5278 00000100:00100000:0.0:1746065121.668150:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:1960:x1830881260976128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.668157:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065121.668161:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acba expref: 252 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.668170:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acba expref: 252 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.668181:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260a00/0x14b4f8542d4f2b82 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acba expref: 252 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746065121.668189:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065121.668192:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065121.668198:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065121.668203:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065121.668224:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.668245:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881260976128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 94us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.668250:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5278 00010000:00010000:3.0:1746065121.668466:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.668476:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065121.668491:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065121.668607:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260000/0x14b4f8542d4f2bd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf2 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.668622:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf2 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.668628:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.668630:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065121.668632:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133260800, rc 0) 00000100:00100000:3.0:1746065121.668665:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28915:x1830881260975872:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 7883us (8051us total) trans 8589943037 rc 0/0 00000100:00100000:3.0:1746065121.668671:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8993 00000100:00100000:0.0:1746065121.672131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.674208:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260976384 00000100:00100000:3.0:1746065121.674219:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260976384 00000100:00100000:3.0:1746065121.674267:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8994 00000100:00100000:3.0:1746065121.674277:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28915:x1830881260976384:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065121.674302:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.674320:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2beb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5acf9 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.674411:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.674425:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf2 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.674432:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.674463:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf2 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.674474:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf2 expref: 9 pid: 24350 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746065121.674485:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259703424:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.674587:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.675950:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259703424:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.675965:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065121.680851:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.680942:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260976512 00000100:00100000:1.0:1746065121.680950:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260976512 00010000:00010000:1.0:1746065121.680980:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf2 expref: 10 pid: 24350 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746065121.681011:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5279 00000100:00100000:1.0:1746065121.681018:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260976512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065121.681028:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065121.681033:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf2 expref: 10 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.681042:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf2 expref: 10 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.681059:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2bdd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf2 expref: 10 pid: 24350 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746065121.681081:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065121.681085:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065121.681092:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065121.681097:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065121.681111:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065121.681142:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260976512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 125us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.681147:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5279 00010000:00010000:3.0:1746065121.683638:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.683650:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065121.683689:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00000004:00200000:3.0:1746065121.683693:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065121.683709:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.683746:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133261000/0x14b4f8542d4f2beb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf9 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.683764:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf9 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.683770:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.683772:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065121.683775:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133261800, rc 0) 00000100:00100000:3.0:1746065121.683861:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28915:x1830881260976384:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 9584us (11737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.683870:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8994 00000100:00100000:1.0:1746065121.686499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.686535:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.686587:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260976768 00000100:00100000:2.0:1746065121.686593:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260976768 00000100:00100000:2.0:1746065121.686716:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260976640 00000100:00100000:2.0:1746065121.686718:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260976640 00000100:00100000:2.0:1746065121.687043:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10612 00000100:00100000:2.0:1746065121.687052:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260976768:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065121.687068:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.687084:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1600/0x14b4f8542d4f2bf9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad07 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.687136:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259703552:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.688077:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.688332:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10613 00000100:00100000:3.0:1746065121.688356:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1958:x1830881260976640:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065121.688367:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.688380:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133261c00/0x14b4f8542d4f2c00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad00 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.688415:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259703680:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.688455:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.691264:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259703552:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065121.691291:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1600/0x14b4f8542d4f2bf9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad07 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.691303:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1600/0x14b4f8542d4f2bf9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad07 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.691321:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1600, rc 0) 00000100:00100000:2.0:1746065121.691456:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881260976768:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4404us (4959us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065121.691463:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10612 00000100:00100000:3.0:1746065121.691531:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259703680:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065121.691546:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133261c00/0x14b4f8542d4f2c00 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad00 expref: 15 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.691555:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133261c00/0x14b4f8542d4f2c00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad00 expref: 15 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.691566:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133261c00, rc 0) 00000100:00100000:3.0:1746065121.691580:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1958:x1830881260976640:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3241us (5044us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065121.691585:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10613 00000100:00100000:0.0:1746065121.693938:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.694614:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260977024 00000100:00100000:3.0:1746065121.694622:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260977024 00000100:00100000:1.0:1746065121.694793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.695037:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260977280 00000100:00100000:3.0:1746065121.695040:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260977280 00000100:00100000:3.0:1746065121.695066:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8995 00000100:00100000:3.0:1746065121.695073:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28918:x1830881260977024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.695091:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.695104:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad0e expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.695186:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695197:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695205:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695215:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695220:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695224:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695304:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695311:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695316:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065121.695323:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9168416 00010000:00010000:3.0:1746065121.695403:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695409:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695413:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695418:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133260400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065121.695421:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695427:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695435:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065121.695438:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065121.695441:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695445:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260400/0x14b4f8542d4f2c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695461:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695465:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695470:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695474:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133260600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065121.695476:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695480:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695486:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2c700) 00010000:00010000:3.0:1746065121.695488:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065121.695490:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695493:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260600/0x14b4f8542d4f2c15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695522:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260800/0x14b4f8542d4f2c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad0e expref: 254 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.695532:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad0e expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.695537:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.695540:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065121.695542:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133260e00, rc 0) 00000100:00100000:3.0:1746065121.695578:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:28918:x1830881260977024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 506us (1646us total) trans 8589943038 rc 0/0 00000100:00100000:3.0:1746065121.695584:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8995 00000100:00100000:3.0:1746065121.695598:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8996 00000100:00100000:3.0:1746065121.695603:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28915:x1830881260977280:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065121.695609:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.695614:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133261200/0x14b4f8542d4f2c2a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad15 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.695641:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695648:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695653:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695660:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695664:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695669:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695672:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133261600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065121.695674:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695679:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695684:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065121.695686:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065121.695688:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695692:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133261600/0x14b4f8542d4f2c31 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065121.695706:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133261200/0x14b4f8542d4f2c2a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad15 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.695712:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133261200/0x14b4f8542d4f2c2a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad15 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.695718:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133261200, rc 0) 00000100:00100000:3.0:1746065121.695738:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28915:x1830881260977280:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 136us (946us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065121.695743:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8996 00000100:00100000:0.0:1746065121.701302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.703276:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260977408 00000100:00100000:3.0:1746065121.703289:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260977408 00000100:00100000:1.0:1746065121.703466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.703491:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260977664 00000100:00100000:1.0:1746065121.703497:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260977664 00000100:00100000:3.0:1746065121.703777:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10614 00000100:00100000:3.0:1746065121.703789:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881260977408:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.703808:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.703869:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133261c00/0x14b4f8542d4f2c38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad1c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.703934:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259703808:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.704024:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.704571:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3662 00000100:00100000:1.0:1746065121.704581:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28915:x1830881260977664:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1746065121.704776:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28915:x1830881260977664:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 195us (1312us total) trans 8589943039 rc 0/0 00000100:00100000:1.0:1746065121.704784:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3662 00000100:00100000:2.0:1746065121.710491:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259703808:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065121.710527:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133261c00/0x14b4f8542d4f2c38 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad1c expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.710539:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133261c00/0x14b4f8542d4f2c38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad1c expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.710551:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133261c00, rc 0) 00000100:00100000:2.0:1746065121.710588:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881260977408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6802us (9296us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065121.710594:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10614 00000100:00100000:3.0:1746065121.715946:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3295:1830881259703936:0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.715999:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065121.716318:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1830881259704064:0@lo:400:kworker.0 00000100:00100000:2.0:1746065121.716357:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.716451:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259704064 00000100:00100000:0.0:1746065121.716458:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259704064 00000100:00100000:0.0:1746065121.716500:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1746065121.716506:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830881259704064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065121.716655:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830881259704064:12345-0@lo:400:kworker.0 Request processed in 148us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.716661:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1746065121.716683:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065121.716776:0:14641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259703936 00000100:00100000:3.0:1746065121.716779:0:14641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259703936 00000100:00100000:3.0:1746065121.716799:0:14641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1746065121.716803:0:14641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3295:x1830881259703936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.716847:0:14641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3295:x1830881259703936:12345-0@lo:400:kworker.0 Request processed in 44us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.716851:0:14641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1746065121.716880:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3295:1830881259703936:0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.716941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.717069:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260977920 00000100:00100000:0.0:1746065121.717072:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260977920 00002000:00100000:0.0:1746065121.717093:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094ff6680 x1830881260977920/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065121.717101:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6680 with x1830881260977920 ext(0->1048575) 00002000:00010000:0.0:1746065121.717105:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff6680 00000100:00100000:0.0:1746065121.717116:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4847 00000100:00100000:0.0:1746065121.717120:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260977920:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065121.718172:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1830881259704192:0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.718198:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065121.718309:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259704192 00000100:00100000:1.0:1746065121.718313:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259704192 00000100:00100000:1.0:1746065121.718335:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1746065121.718340:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830881259704192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065121.718379:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830881259704192:12345-0@lo:400:kworker.0 Request processed in 39us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.718384:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1746065121.719083:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259704320:0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.719104:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.719137:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1830881259704192:0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.719149:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259704448:0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.719161:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.719171:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065121.719174:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830881259704576:0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.719189:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065121.719204:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259704320 00000100:00100000:3.0:1746065121.719206:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259704320 00000100:00100000:3.0:1746065121.719222:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259704448 00000100:00100000:3.0:1746065121.719223:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259704448 00000100:00100000:3.0:1746065121.719234:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1746065121.719237:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3298:x1830881259704320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.719259:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3298:x1830881259704320:12345-0@lo:400:kworker.0 Request processed in 21us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.719263:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1746065121.719270:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1746065121.719273:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3295:x1830881259704448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.719288:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3295:x1830881259704448:12345-0@lo:400:kworker.0 Request processed in 14us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.719292:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1746065121.719304:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259704320:0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.719316:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259704448:0@lo:400:kworker.0 00000100:00100000:2.0:1746065121.719399:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259704576 00000100:00100000:2.0:1746065121.719402:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259704576 00000100:00100000:2.0:1746065121.719418:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1746065121.719422:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830881259704576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065121.719445:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830881259704576:12345-0@lo:400:kworker.0 Request processed in 23us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.719449:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1746065121.719471:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1830881259704064:0@lo:400:kworker.0 00000100:00100000:3.0:1746065121.722456:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830881259704576:0@lo:400:kworker.0 00000100:00080000:0.0:1746065121.722566:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065121.732003:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259704704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746065121.732059:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065121.732227:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259704704 00000100:00100000:0.0:1746065121.732234:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259704704 00000100:00100000:0.0:1746065121.732261:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1746065121.732267:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3297:x1830881259704704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065121.732295:0:8430:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 415825920 pending 13631488 free 3850371072 avail 3848273920 00000100:00100000:0.0:1746065121.732332:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3297:x1830881259704704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.732338:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1746065121.732410:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259704704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065121.743739:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881260977920:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26603us (26784us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.743753:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4847 00002000:00100000:2.0:1746065121.743765:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094ff6680 x1830881260977920/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.743774:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6680 with x1830881260977920 ext(0->1048575) 00002000:00010000:2.0:1746065121.743780:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff6680 00000100:00100000:0.0:1746065121.745262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.745338:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260978048 00000100:00100000:2.0:1746065121.745354:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260978048 00000100:00100000:2.0:1746065121.745388:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10615 00000100:00100000:2.0:1746065121.745394:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:28918:x1830881260978048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.745408:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.745423:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad23 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.745446:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.745453:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.745454:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.745457:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 23 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.745482:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.745497:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 15 pid: 9716 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065121.745507:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259704832:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.747122:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.747337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.747480:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260978176 00000100:00100000:0.0:1746065121.747485:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260978176 00000100:00100000:0.0:1746065121.747510:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10616 00000100:00100000:0.0:1746065121.747516:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28913:x1830881260978176:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065121.747525:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065121.747536:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad2a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.747555:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.747563:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aceb expref: 13 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065121.747574:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac7b expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.747579:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.747581:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.747584:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.747603:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac7b expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.747611:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac7b expref: 25 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065121.747620:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259704960:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065121.747679:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aceb expref: 13 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065121.747687:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aceb expref: 13 pid: 9716 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746065121.747695:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259705088:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065121.747719:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.747729:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 15 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065121.747736:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259705216:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065121.747750:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.748586:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259704832:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.748603:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.748612:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc0e00, rc 0) 00000100:00100000:2.0:1746065121.748647:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:28918:x1830881260978048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3252us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.748653:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10615 00000100:00100000:2.0:1746065121.749329:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259704960:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.749336:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259705088:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065121.750910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.751061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.751110:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260978304 00000100:00100000:2.0:1746065121.751116:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260978304 00002000:00100000:2.0:1746065121.751147:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1138688->1912831) req@ffff88009f15f100 x1830881260978304/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.751157:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15f100 with x1830881260978304 ext(1138688->1912831) 00010000:00010000:2.0:1746065121.751164:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 16 pid: 9716 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.751178:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 16 pid: 9716 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065121.751184:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f15f100 00000100:00100000:2.0:1746065121.751197:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1495 00000100:00100000:2.0:1746065121.751202:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260978304:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065121.751840:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260978432 00000100:00100000:3.0:1746065121.751844:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260978432 00010000:00010000:3.0:1746065121.751866:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aceb expref: 14 pid: 9716 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746065121.751895:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5280 00000100:00100000:3.0:1746065121.751900:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1958:x1830881260978432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.751908:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.751926:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aceb expref: 14 pid: 9716 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065121.751934:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aceb expref: 14 pid: 9716 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065121.751951:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090b1cc00/0x14b4f8542d4f2bcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aceb expref: 14 pid: 9716 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065121.751966:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.751984:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1958:x1830881260978432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.751990:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5280 00000100:00100000:3.0:1746065121.752016:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259705216:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.752042:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.752050:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090b1d400, rc 0) 00000100:00100000:3.0:1746065121.752065:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28913:x1830881260978176:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4550us (4730us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.752074:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10616 00000100:00100000:0.0:1746065121.754620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.754662:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.756235:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260978560 00000100:00100000:1.0:1746065121.756243:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260978688 00000100:00100000:3.0:1746065121.756244:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260978560 00000100:00100000:1.0:1746065121.756246:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260978688 00010000:00010000:3.0:1746065121.756281:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac7b expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065121.756281:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 18 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065121.756315:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5281 00000100:00100000:3.0:1746065121.756322:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260978560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.756334:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.756361:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac7b expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065121.756372:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac7b expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065121.756373:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5282 00000100:00100000:1.0:1746065121.756378:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881260978688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065121.756384:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.756392:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935aee00/0x14b4f8542d4f2b12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac7b expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065121.756392:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 18 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065121.756399:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 18 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065121.756997:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1800/0x14b4f8542d4f2b04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac6d expref: 18 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065121.757018:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065121.757019:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.757025:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065121.757025:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.757032:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.757060:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.757071:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259705344:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065121.757133:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.757364:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260978560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 945us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.757448:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5281 00000100:00100000:1.0:1746065121.760645:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259705344:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065121.760646:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065121.760661:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.760665:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260978944 00000100:00100000:0.0:1746065121.760670:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260978944 00000100:00100000:1.0:1746065121.760693:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881260978688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4314us (6030us total) trans 0 rc 0/0 00002000:00100000:0.0:1746065121.760697:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (4145152->4149247) req@ffff88009f15ed80 x1830881260978944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065121.760701:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5282 00002000:00100000:0.0:1746065121.760705:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ed80 with x1830881260978944 ext(4145152->4149247) 00002000:00010000:0.0:1746065121.760709:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15ed80 00000100:00100000:0.0:1746065121.760735:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4848 00000100:00100000:0.0:1746065121.760741:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260978944:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065121.761074:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260978944:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 332us (431us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065121.761080:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4848 00002000:00100000:0.0:1746065121.761085:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (4145152->4149247) req@ffff88009f15ed80 x1830881260978944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065121.761097:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ed80 with x1830881260978944 ext(4145152->4149247) 00002000:00010000:0.0:1746065121.761099:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15ed80 00000100:00100000:1.0:1746065121.762660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.763395:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260979072 00000100:00100000:3.0:1746065121.763403:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260979072 00000100:00100000:3.0:1746065121.763440:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10617 00000100:00100000:3.0:1746065121.763445:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:28913:x1830881260979072:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065121.763459:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.763472:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad31 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.763493:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.763500:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ace4 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.763506:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac58 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.763511:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.763512:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.763515:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->5029887] (req 4194304->5029887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.763538:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac58 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.763546:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac58 expref: 16 pid: 8428 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746065121.763555:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259705472:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.763633:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260978304:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 12429us (12724us total) trans 21474840013 rc 0/0 00000100:00100000:2.0:1746065121.763641:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1495 00002000:00100000:2.0:1746065121.763649:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1138688->1912831) req@ffff88009f15f100 x1830881260978304/t21474840013(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/448 e 0 to 0 dl 1746065132 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746065121.763654:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ace4 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746065121.763656:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15f100 with x1830881260978304 ext(1138688->1912831) 00010000:00010000:3.0:1746065121.763661:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ace4 expref: 9 pid: 21998 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065121.763662:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 17 pid: 9716 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065121.763669:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259705600:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.763670:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 17 pid: 9716 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065121.763675:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f15f100 00010000:00010000:3.0:1746065121.763690:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.763696:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 28 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065121.763703:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259705728:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.763717:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.765304:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259705472:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.765312:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259705600:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.765319:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259705728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.765339:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->5029887] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.765363:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133261a00, rc 0) 00000100:00100000:3.0:1746065121.765420:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:28913:x1830881260979072:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1974us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.765426:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10617 00000100:00100000:2.0:1746065121.768296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.768340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.768428:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260979200 00000100:00100000:1.0:1746065121.768435:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260979200 00010000:00010000:1.0:1746065121.768462:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ace4 expref: 10 pid: 21998 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746065121.768488:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260979328 00000100:00100000:1.0:1746065121.768490:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260979328 00010000:00010000:1.0:1746065121.768500:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 28 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065121.768512:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5283 00000100:00100000:1.0:1746065121.768519:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881260979200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065121.768530:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065121.768551:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ace4 expref: 10 pid: 21998 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065121.768560:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ace4 expref: 10 pid: 21998 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065121.768580:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd8dc00/0x14b4f8542d4f2bc8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ace4 expref: 10 pid: 21998 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065121.768608:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065121.768640:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260979200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 121us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.768646:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5283 00000100:00100000:1.0:1746065121.768659:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5284 00000100:00100000:1.0:1746065121.768663:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260979328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065121.768669:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065121.768677:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 28 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065121.768684:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 28 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065121.768694:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f40ce00/0x14b4f8542d4f2ae8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac51 expref: 28 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065121.768703:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065121.768716:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881260979328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.768721:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5284 00000100:00100000:0.0:1746065121.769298:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.769577:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260979456 00000100:00100000:2.0:1746065121.769581:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260979456 00010000:00010000:2.0:1746065121.769596:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac58 expref: 17 pid: 8428 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746065121.769841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.770110:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260979584 00000100:00100000:2.0:1746065121.770114:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260979584 00010000:00010000:2.0:1746065121.770129:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 17 pid: 9716 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065121.770146:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5285 00000100:00100000:2.0:1746065121.770152:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260979456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.770158:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.770170:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac58 expref: 17 pid: 8428 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065121.770178:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac58 expref: 17 pid: 8428 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746065121.770187:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5286 00010000:00010000:2.0:1746065121.770192:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f40d600/0x14b4f8542d4f2aef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac58 expref: 17 pid: 8428 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746065121.770193:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260979584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.770201:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.770205:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.770207:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.770212:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.770212:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 17 pid: 9716 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.770219:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.770220:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 17 pid: 9716 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065121.770230:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2b66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1912831) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acb3 expref: 17 pid: 9716 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.770246:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.770246:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.770247:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.770251:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 22 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.770256:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259705856:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065121.770256:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 22 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.770271:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 22 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.770278:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259705984:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065121.770312:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.770456:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.774922:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259705856:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.774941:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.774978:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881260979456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4826us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.774988:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5285 00000100:00100000:0.0:1746065121.775240:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259705984:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065121.775251:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.775265:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881260979584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5072us (5424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.775271:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5286 00000100:00100000:0.0:1746065121.775319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.775409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.775424:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260979840 00000100:00100000:0.0:1746065121.775429:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260979840 00002000:00100000:0.0:1746065121.775458:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f15d180 x1830881260979840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065121.775468:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15d180 with x1830881260979840 ext(1048576->2097151) 00002000:00010000:0.0:1746065121.775472:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15d180 00000100:00100000:0.0:1746065121.775482:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260980096 00000100:00100000:0.0:1746065121.775485:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260980096 00002000:00100000:0.0:1746065121.775494:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1241088->2097151) req@ffff88009f15ce00 x1830881260980096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065121.775500:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ce00 with x1830881260980096 ext(1241088->2097151) 00002000:00010000:0.0:1746065121.775503:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15ce00 00000100:00100000:0.0:1746065121.775512:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4849 00000100:00100000:0.0:1746065121.775518:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260979840:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065121.776940:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4850 00000100:00100000:3.0:1746065121.776952:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260980096:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.780997:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259706112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065121.781049:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065121.781122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.781139:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260980352 00000100:00100000:2.0:1746065121.781145:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260980352 00000100:00100000:2.0:1746065121.781173:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3663 00000100:00100000:2.0:1746065121.781179:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:28913:x1830881260980352:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065121.781462:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28913:x1830881260980352:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 282us (339us total) trans 8589943040 rc 0/0 00000100:00100000:2.0:1746065121.781468:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3663 00000100:00100000:1.0:1746065121.782192:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259706112 00000100:00100000:1.0:1746065121.782197:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259706112 00000100:00100000:0.0:1746065121.782249:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1746065121.782255:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3298:x1830881259706112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065121.782279:0:8430:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 429326336 pending 11927552 free 3849322496 avail 3847225344 00000100:00100000:0.0:1746065121.782309:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3298:x1830881259706112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.782314:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1746065121.782444:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259706112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065121.784392:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260979840:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8867us (9066us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.784401:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4849 00002000:00100000:2.0:1746065121.784411:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f15d180 x1830881260979840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.784420:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15d180 with x1830881260979840 ext(1048576->2097151) 00002000:00010000:2.0:1746065121.784425:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15d180 00000100:00100000:3.0:1746065121.788182:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260980096:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11226us (12764us total) trans 0 rc 856064/856064 00000100:00100000:3.0:1746065121.788192:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4850 00002000:00100000:3.0:1746065121.788202:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1241088->2097151) req@ffff88009f15ce00 x1830881260980096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 856064/856064 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.788210:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ce00 with x1830881260980096 ext(1241088->2097151) 00002000:00010000:3.0:1746065121.788216:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15ce00 00000100:00100000:0.0:1746065121.799597:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.799653:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260981248 00000100:00100000:3.0:1746065121.799662:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260981248 00000100:00100000:0.0:1746065121.799677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065121.799699:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4145151) req@ffff88009f15c700 x1830881260981248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065121.799706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065121.799709:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15c700 with x1830881260981248 ext(3145728->4145151) 00002000:00010000:3.0:1746065121.799713:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15c700 00000100:00100000:0.0:1746065121.799719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.799771:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260981632 00000100:00100000:1.0:1746065121.799775:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260981632 00000100:00100000:1.0:1746065121.799807:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8997 00000100:00100000:1.0:1746065121.799831:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:28924:x1830881260981632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.799848:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.799863:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e600/0x14b4f8542d4f2c54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad38 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065121.799929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065121.799948:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.799959:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.799968:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.799980:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.799985:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.799990:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065121.800024:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260980608 00000100:00100000:3.0:1746065121.800027:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260980608 00000100:00100000:0.0:1746065121.800039:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260980864 00000100:00100000:0.0:1746065121.800041:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260980864 00002000:00100000:3.0:1746065121.800042:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f15ea00 x1830881260980608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.800049:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ea00 with x1830881260980608 ext(2097152->3145727) 00002000:00010000:3.0:1746065121.800052:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15ea00 00002000:00100000:0.0:1746065121.800052:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009f15ca80 x1830881260980864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065121.800058:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ca80 with x1830881260980864 ext(3145728->4194303) 00002000:00010000:0.0:1746065121.800060:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15ca80 00000100:00100000:3.0:1746065121.800061:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260981120 00000100:00100000:3.0:1746065121.800062:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260981120 00000100:00100000:0.0:1746065121.800069:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4851 00002000:00100000:3.0:1746065121.800071:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009f15c380 x1830881260981120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065121.800074:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260981248:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065121.800077:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15c380 with x1830881260981120 ext(2097152->3145727) 00002000:00010000:3.0:1746065121.800079:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15c380 00000100:00100000:3.0:1746065121.800087:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4852 00000100:00100000:3.0:1746065121.800090:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881260980608:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065121.800121:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4853 00000100:00100000:3.0:1746065121.800125:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881260980864:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065121.801684:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4854 00000100:00100000:2.0:1746065121.801693:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260981120:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:1.0:1746065121.802531:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802546:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802556:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:1.0:1746065121.802564:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065121.802634:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802640:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802646:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802651:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f36e800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065121.802654:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802660:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802670:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065121.802673:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065121.802676:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802680:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e800/0x14b4f8542d4f2c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802712:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802717:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802721:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802724:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f36ea00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065121.802727:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802730:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802737:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008fc91100) 00010000:00010000:1.0:1746065121.802738:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065121.802740:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802745:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ea00/0x14b4f8542d4f2c62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.802782:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36e600/0x14b4f8542d4f2c54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad38 expref: 15 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.802794:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad38 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.802799:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065121.802801:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065121.802803:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f36ec00, rc 0) 00000100:00100000:1.0:1746065121.802841:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:28924:x1830881260981632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3027us (3163us total) trans 8589943041 rc 0/0 00000100:00100000:1.0:1746065121.802853:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8997 00000100:00100000:2.0:1746065121.809087:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881260981248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9003us (9617us total) trans 0 rc 999424/999424 00000100:00100000:2.0:1746065121.809098:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4851 00002000:00100000:2.0:1746065121.809106:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4145151) req@ffff88009f15c700 x1830881260981248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.809115:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15c700 with x1830881260981248 ext(3145728->4145151) 00002000:00010000:2.0:1746065121.809120:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15c700 00000100:00100000:3.0:1746065121.816213:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260980608:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16112us (16497us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.816226:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4852 00002000:00100000:3.0:1746065121.816236:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f15ea00 x1830881260980608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.816245:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ea00 with x1830881260980608 ext(2097152->3145727) 00002000:00010000:3.0:1746065121.816251:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15ea00 00000100:00100000:3.0:1746065121.818560:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260980864:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18426us (18833us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.818569:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4853 00002000:00100000:3.0:1746065121.818577:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009f15ca80 x1830881260980864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.818585:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ca80 with x1830881260980864 ext(3145728->4194303) 00002000:00010000:3.0:1746065121.818589:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15ca80 00000100:00100000:2.0:1746065121.819158:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260981120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17466us (19227us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065121.819165:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4854 00002000:00100000:2.0:1746065121.819170:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009f15c380 x1830881260981120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.819181:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15c380 with x1830881260981120 ext(2097152->3145727) 00002000:00010000:2.0:1746065121.819184:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15c380 00000100:00100000:0.0:1746065121.820408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.820471:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260981888 00000100:00100000:1.0:1746065121.820478:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260981888 00000100:00100000:1.0:1746065121.820528:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3664 00000100:00100000:1.0:1746065121.820535:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:28924:x1830881260981888:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065121.820707:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:28924:x1830881260981888:12345-192.168.202.46@tcp:35:cat.0 Request processed in 172us (301us total) trans 8589943042 rc 0/0 00000100:00100000:1.0:1746065121.820713:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3664 00010000:00010000:3.0:1746065121.821941:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065121.825098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.825127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.825148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.825179:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260982016 00000100:00100000:2.0:1746065121.825186:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260982016 00000100:00100000:0.0:1746065121.825198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.825217:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260982144 00000100:00100000:2.0:1746065121.825219:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260982144 00000100:00100000:0.0:1746065121.825223:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260982400 00000100:00100000:0.0:1746065121.825227:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260982400 00000100:00100000:2.0:1746065121.825638:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260982272 00000100:00100000:2.0:1746065121.825641:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260982272 00000100:00100000:0.0:1746065121.825669:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10618 00000100:00100000:0.0:1746065121.825676:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260982016:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065121.825682:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10619 00010000:00010000:0.0:1746065121.825690:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065121.825704:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad3f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.825715:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260982144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.825723:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065121.825723:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.825725:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065121.825732:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad3f expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.825733:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f36e400/0x14b4f8542d4f2c7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad46 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.825745:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad3f expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065121.825754:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136674600, rc 0) 00000100:00100000:1.0:1746065121.825769:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259706240:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065121.825790:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881260982016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 114us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.825835:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.825954:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10620 00000100:00100000:3.0:1746065121.825963:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881260982400:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065121.825964:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10618 00010000:00010000:3.0:1746065121.825970:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065121.825972:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10621 00010000:00010000:3.0:1746065121.825977:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133261000/0x14b4f8542d4f2c85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad54 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.825978:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881260982272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.825984:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.825991:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090450e00/0x14b4f8542d4f2c8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad4d expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.826000:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259706368:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065121.826023:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259706496:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.826027:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.826046:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f240 going to sleep for 11 seconds 00002000:00010000:1.0:1746065121.828518:0:21235:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size: 4974112 -> 5029568 00000100:00100000:1.0:1746065121.828536:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259706496:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065121.828558:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090450e00/0x14b4f8542d4f2c8c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad4d expref: 19 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.828569:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090450e00/0x14b4f8542d4f2c8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad4d expref: 19 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.828589:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090450e00, rc 0) 00000100:00100000:1.0:1746065121.828617:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881260982272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2640us (3418us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065121.828623:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10621 00002000:00010000:3.0:1746065121.828855:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065121 -> 1746065122 00002000:00010000:3.0:1746065121.828858:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065121 -> 1746065122 00000100:00100000:3.0:1746065121.828869:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259706368:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065121.828883:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133261000/0x14b4f8542d4f2c85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad54 expref: 18 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.828892:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133261000/0x14b4f8542d4f2c85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad54 expref: 18 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.828902:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133261000, rc 0) 00000100:00100000:3.0:1746065121.828918:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260982400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2958us (3769us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065121.828922:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10620 00000100:00100000:2.0:1746065121.828997:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259706240:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065121.829011:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f36e400/0x14b4f8542d4f2c7e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad46 expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.829019:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f36e400/0x14b4f8542d4f2c7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad46 expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065121.829030:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f36e400, rc 0) 00000100:00100000:2.0:1746065121.829044:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881260982144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3333us (3917us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065121.829049:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10619 00000100:00100000:0.0:1746065121.834459:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.834831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.834920:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260982528 00000100:00100000:3.0:1746065121.834929:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260982528 00000100:00100000:0.0:1746065121.834933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.834958:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260982784 00000100:00100000:3.0:1746065121.834960:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260982784 00000100:00100000:0.0:1746065121.834965:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260982656 00000100:00100000:0.0:1746065121.834967:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260982656 00000100:00100000:3.0:1746065121.834974:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10622 00000100:00100000:3.0:1746065121.834981:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260982528:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065121.834983:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10623 00000100:00100000:0.0:1746065121.834986:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260982784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.834995:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065121.834995:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.835008:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133261c00/0x14b4f8542d4f2c93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad5b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.835009:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136674800/0x14b4f8542d4f2c9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad69 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.835047:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259706752:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065121.835047:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259706624:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065121.835121:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10624 00000100:00100000:1.0:1746065121.835128:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+18:1958:x1830881260982656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.835135:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.835141:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f36f600/0x14b4f8542d4f2ca1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad62 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.835160:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259706880:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.835227:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.835337:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.835386:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.837324:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259706752:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065121.837358:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133261c00/0x14b4f8542d4f2c93 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad5b expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.837370:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133261c00/0x14b4f8542d4f2c93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad5b expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.837388:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133261c00, rc 0) 00000100:00100000:3.0:1746065121.837418:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+18:1958:x1830881260982528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2437us (2966us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065121.837424:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10622 00000100:00100000:0.0:1746065121.837569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.837632:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259706624:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065121.837649:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136674800/0x14b4f8542d4f2c9a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad69 expref: 18 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.837657:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136674800/0x14b4f8542d4f2c9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad69 expref: 18 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.837668:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136674800, rc 0) 00000100:00100000:1.0:1746065121.837701:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260982784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2713us (2885us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065121.837706:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10623 00000100:00100000:1.0:1746065121.838296:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260983040 00000100:00100000:1.0:1746065121.838301:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260983040 00000100:00100000:1.0:1746065121.838327:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3665 00000100:00100000:1.0:1746065121.838333:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28918:x1830881260983040:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065121.838496:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:28918:x1830881260983040:12345-192.168.202.46@tcp:35:cat.0 Request processed in 162us (927us total) trans 8589943043 rc 0/0 00000100:00100000:1.0:1746065121.838502:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3665 00000100:00100000:1.0:1746065121.838534:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259706880:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065121.838548:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f36f600/0x14b4f8542d4f2ca1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad62 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.838555:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f36f600/0x14b4f8542d4f2ca1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad62 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.838562:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f36f600, rc 0) 00000100:00100000:1.0:1746065121.838577:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881260982656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3451us (3645us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065121.838582:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10624 00000100:00100000:3.0:1746065121.849781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.849792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.849847:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260983296 00000100:00100000:1.0:1746065121.849854:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260983296 00000100:00100000:1.0:1746065121.849895:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8998 00000100:00100000:1.0:1746065121.849902:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:28926:x1830881260983296:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065121.849921:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.849934:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36f800/0x14b4f8542d4f2ca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad70 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.850010:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.850022:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf9 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.850033:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad0e expref: 254 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.850038:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad38 expref: 16 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.850044:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 6/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065121.850067:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad38 expref: 16 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.850078:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad38 expref: 16 pid: 16767 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065121.850088:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259707008:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.850164:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad0e expref: 254 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.850171:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad0e expref: 254 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065121.850178:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259707136:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.850201:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf9 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.850208:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf9 expref: 8 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065121.850215:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259707264:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.850231:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.850287:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260983552 00000100:00100000:2.0:1746065121.850290:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260983552 00002000:00100000:2.0:1746065121.850314:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009baa0000 x1830881260983552/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.850323:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0000 with x1830881260983552 ext(1048576->2097151) 00002000:00010000:2.0:1746065121.850327:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa0000 00000100:00100000:2.0:1746065121.850666:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4855 00000100:00100000:2.0:1746065121.850673:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260983552:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065121.852050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.852067:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260983680 00000100:00100000:0.0:1746065121.852071:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260983680 00010000:00010000:0.0:1746065121.852091:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad0e expref: 255 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065121.852124:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5287 00000100:00100000:0.0:1746065121.852130:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1961:x1830881260983680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.852139:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065121.852144:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad0e expref: 255 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065121.852153:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad0e expref: 255 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065121.852169:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065121.852173:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.852180:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.852187:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.852220:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1961:x1830881260983680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.852227:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5287 00010000:00010000:2.0:1746065121.853837:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133260e00/0x14b4f8542d4f2c1c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad0e expref: 254 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065121.853862:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259707136:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.854595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.854625:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259707264:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065121.854635:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259707008:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.854662:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065121.854681:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260983808 00000100:00100000:0.0:1746065121.854686:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260983808 00010000:00010000:0.0:1746065121.854708:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf9 expref: 9 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065121.854736:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5288 00000100:00100000:0.0:1746065121.854743:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881260983808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065121.854753:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065121.854758:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf9 expref: 9 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065121.854766:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf9 expref: 9 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065121.854786:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133261800/0x14b4f8542d4f2bf2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acf9 expref: 9 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065121.854799:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065121.854803:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.854809:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.854841:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065121.854874:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881260983808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 131us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065121.854880:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5288 00000100:00100000:0.0:1746065121.856230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.856278:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260983936 00000100:00100000:2.0:1746065121.856282:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260983936 00010000:00010000:2.0:1746065121.856301:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad38 expref: 17 pid: 16767 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065121.856322:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5289 00000100:00100000:2.0:1746065121.856328:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881260983936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.856335:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.856339:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad38 expref: 17 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.856361:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad38 expref: 17 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.856374:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36ec00/0x14b4f8542d4f2c69 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad38 expref: 17 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.856384:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065121.856388:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.856399:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.856405:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065121.856421:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.856446:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881260983936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 118us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.856451:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5289 00000100:00100000:3.0:1746065121.857228:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260983552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6554us (7453us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.857236:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4855 00002000:00100000:3.0:1746065121.857245:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009baa0000 x1830881260983552/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.857255:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0000 with x1830881260983552 ext(1048576->2097151) 00002000:00010000:3.0:1746065121.857259:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa0000 00010000:00010000:0.0:1746065121.857301:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.857312:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065121.857327:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065121.857441:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36f800/0x14b4f8542d4f2ca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad70 expref: 17 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.857454:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad70 expref: 16 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.857460:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065121.857462:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065121.857465:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f36fa00, rc 0) 00000100:00100000:0.0:1746065121.857498:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:28926:x1830881260983296:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7597us (7706us total) trans 8589943044 rc 0/0 00000100:00100000:0.0:1746065121.857504:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8998 00000100:00100000:0.0:1746065121.861314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.861415:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260984064 00000100:00100000:1.0:1746065121.861422:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260984064 00000100:00100000:1.0:1746065121.861757:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10625 00000100:00100000:1.0:1746065121.861765:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+16:28924:x1830881260984064:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.861778:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.861790:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad77 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.863068:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.863077:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.863079:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.863082:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 17 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.863109:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.863118:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 26 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065121.863129:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259707392:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.863199:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.865598:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259707392:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.865621:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 17 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.865635:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3b4e00, rc 0) 00000100:00100000:1.0:1746065121.865671:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+17:28924:x1830881260984064:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3906us (4364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.865677:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10625 00000100:00100000:0.0:1746065121.866758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.866999:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260984192 00000100:00100000:3.0:1746065121.867005:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260984192 00002000:00100000:3.0:1746065121.867040:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1241087) req@ffff88009f9cea00 x1830881260984192/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.867049:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cea00 with x1830881260984192 ext(1048576->1241087) 00010000:00010000:3.0:1746065121.867056:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 27 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065121.867068:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 27 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746065121.867075:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cea00 00000100:00100000:3.0:1746065121.867089:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1496 00000100:00100000:3.0:1746065121.867095:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260984192:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065121.877136:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260984192:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10030us (10370us total) trans 17179872784 rc 0/0 00000100:00100000:3.0:1746065121.877147:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1496 00002000:00100000:3.0:1746065121.877157:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1241087) req@ffff88009f9cea00 x1830881260984192/t17179872784(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/448 e 0 to 0 dl 1746065132 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.877165:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cea00 with x1830881260984192 ext(1048576->1241087) 00010000:00010000:3.0:1746065121.877173:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065121.877184:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746065121.877191:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cea00 00000100:00100000:0.0:1746065121.879875:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.880122:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260984320 00000100:00100000:1.0:1746065121.880130:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260984320 00000100:00100000:1.0:1746065121.880161:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10626 00000100:00100000:1.0:1746065121.880167:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+17:28926:x1830881260984320:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065121.880181:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.880194:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad7e expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.880222:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.880229:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.880231:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065121.880233:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.880405:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.880415:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 22 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065121.880425:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259707520:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065121.880499:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.883739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.883846:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260984448 00000100:00100000:3.0:1746065121.883854:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260984448 00010000:00010000:3.0:1746065121.883882:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065121.883913:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5290 00000100:00100000:3.0:1746065121.883920:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881260984448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.883929:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.883947:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065121.883957:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065121.883976:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f2b0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac74 expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065121.883992:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.883993:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.883999:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 16 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.884006:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 16 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.884036:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 16 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.884046:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259707648:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.884110:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.886161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.886264:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259707520:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065121.886287:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065121.886299:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3b5200, rc 0) 00000100:00100000:1.0:1746065121.886330:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+18:28926:x1830881260984320:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6162us (6461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065121.886336:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10626 00000100:00100000:3.0:1746065121.886407:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259707648:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.886412:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260984576 00000100:00100000:2.0:1746065121.886418:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260984576 00010000:00010000:3.0:1746065121.886419:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.886438:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260984448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2518us (2705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.886445:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5290 00002000:00100000:2.0:1746065121.886445:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (4145152->4194303) req@ffff88009f9cca80 x1830881260984576/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.886454:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cca80 with x1830881260984576 ext(4145152->4194303) 00010000:00010000:2.0:1746065121.886459:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 23 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.886469:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 23 pid: 8428 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065121.886475:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cca80 00000100:00100000:2.0:1746065121.886499:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1497 00000100:00100000:2.0:1746065121.886506:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881260984576:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065121.889583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.889662:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260984832 00000100:00100000:1.0:1746065121.889669:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260984832 00002000:00100000:1.0:1746065121.889699:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f9ce680 x1830881260984832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.889708:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce680 with x1830881260984832 ext(1048576->2097151) 00002000:00010000:1.0:1746065121.889712:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9ce680 00000100:00100000:1.0:1746065121.889739:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4856 00000100:00100000:1.0:1746065121.889746:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260984832:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.898409:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881260984576:12345-192.168.202.46@tcp:4:cat.0 Request processed in 11894us (12242us total) trans 21474840014 rc 0/0 00000100:00100000:2.0:1746065121.898424:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1497 00002000:00100000:2.0:1746065121.898434:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (4145152->4194303) req@ffff88009f9cca80 x1830881260984576/t21474840014(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/448 e 0 to 0 dl 1746065132 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.898442:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cca80 with x1830881260984576 ext(4145152->4194303) 00010000:00010000:2.0:1746065121.898450:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.898463:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065121.898470:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cca80 00000100:00100000:1.0:1746065121.902797:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260984832:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13041us (13210us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065121.902808:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4856 00002000:00100000:1.0:1746065121.902830:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f9ce680 x1830881260984832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.902839:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce680 with x1830881260984832 ext(1048576->2097151) 00002000:00010000:1.0:1746065121.902844:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9ce680 00000100:00100000:0.0:1746065121.905934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.906034:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260984960 00000100:00100000:3.0:1746065121.906043:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260984960 00010000:00010000:3.0:1746065121.906075:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065121.906199:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5291 00000100:00100000:3.0:1746065121.906209:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881260984960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.906220:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.906239:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065121.906250:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065121.906273:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090b1d400/0x14b4f8542d4f2c46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4145152->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad2a expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065121.906291:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.906292:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.906299:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 17 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.906306:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 17 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.906334:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 17 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.906358:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259707776:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065121.906640:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.909165:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259707776:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.909185:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.909230:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260984960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3021us (3303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.909239:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5291 00000100:00100000:1.0:1746065121.909249:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.909268:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260985216 00000100:00100000:1.0:1746065121.909273:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260985216 00002000:00100000:1.0:1746065121.909304:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3014656->3018751) req@ffff88009c7ad500 x1830881260985216/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.909312:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ad500 with x1830881260985216 ext(3014656->3018751) 00002000:00010000:1.0:1746065121.909316:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ad500 00000100:00100000:0.0:1746065121.909323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.909355:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4857 00000100:00100000:1.0:1746065121.909428:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260985216:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.909487:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260985344 00000100:00100000:2.0:1746065121.909491:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260985344 00000100:00100000:2.0:1746065121.909523:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10627 00000100:00100000:2.0:1746065121.909528:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+17:28924:x1830881260985344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065121.909536:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.909549:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad85 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.909567:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.909573:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.909575:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.909578:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.909603:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.909613:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 27 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065121.909615:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260985216:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 253us (365us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065121.909621:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4857 00000100:00100000:2.0:1746065121.909623:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259707904:192.168.202.46@tcp:104: 00002000:00100000:1.0:1746065121.909625:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3014656->3018751) req@ffff88009c7ad500 x1830881260985216/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.909631:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ad500 with x1830881260985216 ext(3014656->3018751) 00002000:00010000:1.0:1746065121.909633:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ad500 00000100:00100000:2.0:1746065121.909676:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.911282:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259707904:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065121.911302:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.911315:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090451800, rc 0) 00000100:00100000:2.0:1746065121.911366:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+18:28924:x1830881260985344:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1837us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.911373:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10627 00000100:00100000:0.0:1746065121.911974:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.912043:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260985600 00000100:00100000:2.0:1746065121.912048:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260985600 00000100:00100000:2.0:1746065121.912275:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10628 00000100:00100000:2.0:1746065121.912282:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+18:28926:x1830881260985600:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065121.912294:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065121.912305:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad8c expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.912327:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.912329:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065121.912332:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3321855] (req 3145728->3321855) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.912420:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->3321855] (req 3145728->3321855) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.912431:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090451400, rc 0) 00000100:00100000:2.0:1746065121.912459:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+19:28926:x1830881260985600:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 178us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.912464:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10628 00000100:00100000:0.0:1746065121.912632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.912848:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260985472 00000100:00100000:2.0:1746065121.912852:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260985472 00002000:00100000:2.0:1746065121.912873:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029567) req@ffff88009f9cf800 x1830881260985472/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.912881:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf800 with x1830881260985472 ext(4194304->5029567) 00010000:00010000:2.0:1746065121.912886:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 28 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.912896:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 28 pid: 8428 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065121.912902:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cf800 00000100:00100000:2.0:1746065121.912914:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1498 00000100:00100000:2.0:1746065121.912920:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260985472:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065121.913257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.913271:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260985856 00000100:00100000:0.0:1746065121.913274:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260985856 00000100:00100000:0.0:1746065121.913293:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8999 00000100:00100000:0.0:1746065121.913297:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28930:x1830881260985856:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065121.913309:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065121.913318:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1a00/0x14b4f8542d4f2cd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad93 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.913414:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913423:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913432:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913442:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913446:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913451:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913536:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913543:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913549:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065121.913557:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065121.913627:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913638:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913644:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913649:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdd0800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065121.913652:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913657:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913666:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065121.913668:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065121.913671:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913674:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd0800/0x14b4f8542d4f2ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913690:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913695:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913699:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913703:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136674000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065121.913705:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913709:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913714:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f49fc00) 00010000:00010000:0.0:1746065121.913717:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065121.913719:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913722:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136674000/0x14b4f8542d4f2ce7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065121.913751:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd1a00/0x14b4f8542d4f2cd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad93 expref: 257 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.913759:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad93 expref: 256 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065121.914091:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065121.914093:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065121.914096:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136674200, rc 0) 00000100:00100000:0.0:1746065121.914128:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:28930:x1830881260985856:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 829us (870us total) trans 8589943045 rc 0/0 00000100:00100000:0.0:1746065121.914134:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8999 00000100:00100000:0.0:1746065121.929942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.930026:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260985984 00000100:00100000:3.0:1746065121.930034:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260985984 00000100:00100000:3.0:1746065121.930070:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10629 00000100:00100000:3.0:1746065121.930077:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28930:x1830881260985984:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065121.930095:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.930108:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ad9a expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.930132:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.930140:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad3f expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.930146:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.930147:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065121.930150:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1196032->1535999] (req 1196032->1535999) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.930174:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad3f expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.930182:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad3f expref: 17 pid: 8429 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746065121.930192:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259708032:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.930905:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.930913:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 25 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065121.930925:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259708160:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065121.930944:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065121.931150:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260985472:12345-192.168.202.46@tcp:4:cat.0 Request processed in 16876us (17163us total) trans 17179872785 rc 0/0 00000100:00100000:2.0:1746065121.931160:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1498 00002000:00100000:2.0:1746065121.931168:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029567) req@ffff88009f9cf800 x1830881260985472/t17179872785(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/448 e 0 to 0 dl 1746065132 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.931177:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf800 with x1830881260985472 ext(4194304->5029567) 00010000:00010000:2.0:1746065121.931183:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 30 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.931192:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 30 pid: 8428 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065121.931198:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cf800 00000100:00100000:3.0:1746065121.932954:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259708032:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065121.935260:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.935297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.935418:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259708160:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065121.935444:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1196032->1535999] (req 1196032->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065121.935458:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133260800, rc 0) 00000100:00100000:3.0:1746065121.935543:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:28930:x1830881260985984:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5466us (5608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.935551:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10629 00000100:00100000:3.0:1746065121.935580:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260986112 00000100:00100000:3.0:1746065121.935585:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260986112 00010000:00010000:3.0:1746065121.935604:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad3f expref: 18 pid: 8429 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746065121.935624:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260986240 00000100:00100000:3.0:1746065121.935626:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260986240 00010000:00010000:3.0:1746065121.935634:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 30 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065121.935645:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5292 00000100:00100000:3.0:1746065121.935649:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881260986112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065121.935658:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065121.935675:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad3f expref: 18 pid: 8429 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065121.935683:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad3f expref: 18 pid: 8429 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065121.935701:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136674600/0x14b4f8542d4f2c77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad3f expref: 18 pid: 8429 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746065121.935844:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5293 00000100:00100000:2.0:1746065121.935852:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260986240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.935859:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.935873:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 30 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.935881:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 30 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.935895:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133261a00/0x14b4f8542d4f2c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad31 expref: 30 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.935917:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.935919:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.935926:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.935934:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.935941:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.935942:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.935946:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.935952:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.935978:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.935988:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259708288:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065121.936796:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065121.936867:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260986112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1216us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065121.936874:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5292 00010000:00010000:2.0:1746065121.936890:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.936899:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259708416:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.936917:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065121.939146:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.939267:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259708288:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.939274:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259708416:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065121.939286:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.939318:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260986240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3468us (4021us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.939326:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5293 00000100:00100000:2.0:1746065121.939350:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260986368 00000100:00100000:2.0:1746065121.939354:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260986368 00010000:00010000:2.0:1746065121.939370:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 25 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065121.939385:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5294 00000100:00100000:2.0:1746065121.939389:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881260986368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065121.939397:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065121.939410:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 25 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.939419:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 25 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.939435:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f2c3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad23 expref: 25 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065121.940496:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.940499:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065121.940507:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.940519:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065121.940545:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065121.940555:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259708544:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065121.940970:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.941062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.941285:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260986624 00000100:00100000:3.0:1746065121.941290:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260986624 00002000:00100000:3.0:1746065121.941322:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3317760->3321855) req@ffff88009c7af480 x1830881260986624/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.941329:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af480 with x1830881260986624 ext(3317760->3321855) 00002000:00010000:3.0:1746065121.941333:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7af480 00000100:00100000:3.0:1746065121.941361:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4858 00000100:00100000:3.0:1746065121.941367:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881260986624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065121.941510:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881260986624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 142us (448us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065121.941516:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4858 00002000:00100000:3.0:1746065121.941521:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3317760->3321855) req@ffff88009c7af480 x1830881260986624/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065121.941990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.942039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.942061:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260986880 00000100:00100000:2.0:1746065121.942065:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260986880 00002000:00100000:2.0:1746065121.942080:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ba1d880 x1830881260986880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.942088:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d880 with x1830881260986880 ext(2097152->3145727) 00002000:00010000:2.0:1746065121.942091:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1d880 00002000:00100000:3.0:1746065121.942146:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af480 with x1830881260986624 ext(3317760->3321855) 00002000:00010000:3.0:1746065121.942149:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7af480 00000100:00100000:3.0:1746065121.942163:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260987136 00000100:00100000:3.0:1746065121.942166:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260987136 00002000:00100000:3.0:1746065121.942179:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3014655) req@ffff88009ba1ca80 x1830881260987136/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.942185:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ca80 with x1830881260987136 ext(2097152->3014655) 00002000:00010000:3.0:1746065121.942188:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1ca80 00000100:00100000:3.0:1746065121.942205:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4859 00000100:00100000:3.0:1746065121.942211:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260986880:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065121.942465:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4860 00000100:00100000:0.0:1746065121.942472:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260987136:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065121.943638:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259708544:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065121.943654:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065121.943690:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260986368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4298us (4547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065121.943697:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5294 00000100:00100000:0.0:1746065121.944828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.944909:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260987392 00000100:00100000:2.0:1746065121.944915:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260987392 00002000:00100000:2.0:1746065121.944941:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1196032->1200127) req@ffff88009ba1ea00 x1830881260987392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.944948:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ea00 with x1830881260987392 ext(1196032->1200127) 00002000:00010000:2.0:1746065121.944953:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1ea00 00000100:00100000:2.0:1746065121.944968:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4861 00000100:00100000:2.0:1746065121.944973:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260987392:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065121.945064:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881260987392:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 90us (254us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065121.945069:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4861 00002000:00100000:2.0:1746065121.945073:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x37a:0x0] (1196032->1200127) req@ffff88009ba1ea00 x1830881260987392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.945079:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ea00 with x1830881260987392 ext(1196032->1200127) 00002000:00010000:2.0:1746065121.945082:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1ea00 00000100:00100000:3.0:1746065121.953176:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260986880:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10956us (11181us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.953186:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4859 00002000:00100000:3.0:1746065121.953195:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ba1d880 x1830881260986880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.953203:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d880 with x1830881260986880 ext(2097152->3145727) 00002000:00010000:3.0:1746065121.953208:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1d880 00000100:00100000:1.0:1746065121.953848:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260987136:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11376us (11809us total) trans 0 rc 917504/917504 00000100:00100000:1.0:1746065121.953855:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4860 00002000:00100000:1.0:1746065121.953861:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3014655) req@ffff88009ba1ca80 x1830881260987136/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 917504/917504 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065121.953867:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ca80 with x1830881260987136 ext(2097152->3014655) 00002000:00010000:1.0:1746065121.953871:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1ca80 00000100:00100000:0.0:1746065121.960459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.960501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.960536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065121.960604:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260987776 00000100:00100000:2.0:1746065121.960611:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260987776 00000100:00100000:3.0:1746065121.960612:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260987904 00000100:00100000:3.0:1746065121.960614:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260987904 00002000:00100000:3.0:1746065121.960647:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1531904->1535999) req@ffff88009ba1dc00 x1830881260987904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.960647:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3321856->4194303) req@ffff88009ba1e680 x1830881260987776/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.960656:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1dc00 with x1830881260987904 ext(1531904->1535999) 00002000:00100000:2.0:1746065121.960656:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e680 with x1830881260987776 ext(3321856->4194303) 00002000:00010000:3.0:1746065121.960660:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1dc00 00002000:00010000:2.0:1746065121.960660:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1e680 00000100:00100000:3.0:1746065121.960701:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260988160 00000100:00100000:3.0:1746065121.960704:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260988160 00002000:00100000:3.0:1746065121.960715:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009ba1f100 x1830881260988160/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.960720:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f100 with x1830881260988160 ext(3145728->4194303) 00002000:00010000:3.0:1746065121.960723:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1f100 00000100:00100000:3.0:1746065121.960891:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4862 00000100:00100000:3.0:1746065121.960899:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260987904:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065121.960908:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4863 00000100:00100000:0.0:1746065121.960913:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881260987776:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065121.961030:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260987904:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 132us (527us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065121.961035:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4862 00002000:00100000:3.0:1746065121.961039:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1531904->1535999) req@ffff88009ba1dc00 x1830881260987904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:37/0 lens 488/4536 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.961045:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1dc00 with x1830881260987904 ext(1531904->1535999) 00002000:00010000:3.0:1746065121.961047:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1dc00 00000100:00100000:3.0:1746065121.961059:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4864 00000100:00100000:3.0:1746065121.961063:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260988160:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065121.966503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.967528:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260988416 00000100:00100000:3.0:1746065121.967537:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260988416 00000100:00100000:3.0:1746065121.967578:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3666 00000100:00100000:3.0:1746065121.967585:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:28930:x1830881260988416:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065121.967761:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:28930:x1830881260988416:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 176us (1264us total) trans 8589943046 rc 0/0 00000100:00100000:3.0:1746065121.967768:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3666 00000100:00100000:2.0:1746065121.973026:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881260987776:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12105us (12567us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746065121.973035:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4863 00002000:00100000:2.0:1746065121.973045:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3321856->4194303) req@ffff88009ba1e680 x1830881260987776/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065121.973054:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e680 with x1830881260987776 ext(3321856->4194303) 00002000:00010000:2.0:1746065121.973059:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1e680 00000100:00100000:3.0:1746065121.976163:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260988160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15089us (15616us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065121.976173:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4864 00002000:00100000:3.0:1746065121.976183:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009ba1f100 x1830881260988160/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.976191:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f100 with x1830881260988160 ext(3145728->4194303) 00002000:00010000:3.0:1746065121.976195:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1f100 00000100:00100000:0.0:1746065121.981260:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.981309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065121.981374:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260988544 00000100:00100000:1.0:1746065121.981385:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260988544 00000100:00100000:1.0:1746065121.981433:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260988672 00000100:00100000:1.0:1746065121.981435:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260988672 00000100:00100000:1.0:1746065121.981448:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10630 00000100:00100000:1.0:1746065121.981454:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260988544:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.981474:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.981490:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f014e00/0x14b4f8542d4f2d03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ada1 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.981504:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10631 00000100:00100000:3.0:1746065121.981511:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881260988672:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.981518:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.981526:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdc8e00/0x14b4f8542d4f2d0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ada8 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.981534:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259708672:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.981544:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259708800:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.982168:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.982179:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065121.983256:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259708800:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065121.983279:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdc8e00/0x14b4f8542d4f2d0a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ada8 expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.983290:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdc8e00/0x14b4f8542d4f2d0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ada8 expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.983306:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdc8e00, rc 0) 00000100:00100000:3.0:1746065121.983372:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881260988672:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1861us (2061us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065121.983380:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10631 00000100:00100000:1.0:1746065121.983686:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259708672:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065121.983702:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f014e00/0x14b4f8542d4f2d03 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ada1 expref: 18 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.983710:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f014e00/0x14b4f8542d4f2d03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ada1 expref: 18 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.983732:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f014e00, rc 0) 00000100:00100000:1.0:1746065121.983924:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881260988544:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2469us (2670us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065121.983929:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10630 00000100:00100000:0.0:1746065121.986750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.987018:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260988928 00000100:00100000:3.0:1746065121.987025:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260988928 00002000:00100000:3.0:1746065121.987056:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009ba3d180 x1830881260988928/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/0 e 0 to 0 dl 1746065132 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.987062:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d180 with x1830881260988928 ext(4194304->5029887) 00002000:00010000:3.0:1746065121.987066:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3d180 00000100:00100000:3.0:1746065121.987086:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4865 00000100:00100000:3.0:1746065121.987092:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260988928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065121.992483:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260988928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5383us (5729us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065121.992492:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4865 00002000:00100000:3.0:1746065121.992503:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009ba3d180 x1830881260988928/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:37/0 lens 488/440 e 0 to 0 dl 1746065132 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065121.992511:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d180 with x1830881260988928 ext(4194304->5029887) 00002000:00010000:3.0:1746065121.992516:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3d180 00000100:00100000:0.0:1746065121.995267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065121.995326:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065121.995383:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260989056 00000100:00100000:3.0:1746065121.995390:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260989056 00000100:00100000:1.0:1746065121.995402:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260989184 00000100:00100000:1.0:1746065121.995406:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260989184 00000100:00100000:3.0:1746065121.995434:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10632 00000100:00100000:3.0:1746065121.995441:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260989056:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065121.995455:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065121.995468:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdc9200/0x14b4f8542d4f2d11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5adaf expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065121.995517:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259708928:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065121.995583:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.995722:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10633 00000100:00100000:1.0:1746065121.995729:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260989184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065121.995736:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065121.995744:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f015000/0x14b4f8542d4f2d18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5adb6 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065121.995766:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259709056:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065121.995787:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065121.997861:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259709056:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065121.997883:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f015000/0x14b4f8542d4f2d18 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adb6 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.997899:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f015000/0x14b4f8542d4f2d18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adb6 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065121.997915:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f015000, rc 0) 00000100:00100000:1.0:1746065121.997945:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260989184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2216us (2617us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065121.997956:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10633 00000100:00100000:3.0:1746065121.998168:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259708928:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065121.998183:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdc9200/0x14b4f8542d4f2d11 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adaf expref: 18 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.998191:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdc9200/0x14b4f8542d4f2d11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adaf expref: 18 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065121.998205:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdc9200, rc 0) 00000100:00100000:3.0:1746065121.998625:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260989056:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3183us (3362us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065121.998630:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10632 00000100:00100000:0.0:1746065122.000741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.000782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.000884:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260989440 00000100:00100000:3.0:1746065122.000890:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260989440 00000100:00100000:3.0:1746065122.000915:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260989312 00000100:00100000:3.0:1746065122.000917:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260989312 00000100:00100000:3.0:1746065122.000930:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10634 00000100:00100000:3.0:1746065122.000935:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260989440:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.000948:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.000960:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5adc4 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.000998:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259709184:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065122.001049:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.001394:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10635 00000100:00100000:0.0:1746065122.001401:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260989312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065122.001409:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065122.001417:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136674c00/0x14b4f8542d4f2d26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5adbd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065122.001438:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259709312:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065122.001457:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065122.003096:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259709184:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065122.003096:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259709312:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065122.003116:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d1f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adc4 expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.003116:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136674c00/0x14b4f8542d4f2d26 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adbd expref: 18 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.003125:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adc4 expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.003125:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136674c00/0x14b4f8542d4f2d26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adbd expref: 18 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.003133:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdc9600, rc 0) 00010000:00010000:1.0:1746065122.003134:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136674c00, rc 0) 00000100:00100000:3.0:1746065122.003169:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260989440:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2233us (2432us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065122.003169:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881260989312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1769us (2386us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.003175:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10634 00000100:00100000:1.0:1746065122.003319:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10635 00000100:00100000:0.0:1746065122.068155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.068442:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260989696 00000100:00100000:2.0:1746065122.068449:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260989696 00000100:00100000:0.0:1746065122.068498:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.068560:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260989952 00000100:00100000:1.0:1746065122.068565:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260989952 00000100:00100000:1.0:1746065122.068612:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9000 00000100:00100000:1.0:1746065122.068619:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:28938:x1830881260989952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.068638:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.068653:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015200/0x14b4f8542d4f2d2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5add2 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746065122.068690:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065122.068728:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9001 00010000:00010000:1.0:1746065122.068735:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065122.068736:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:28936:x1830881260989696:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065122.068746:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.068746:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.068752:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8c00/0x14b4f8542d4f2d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5adcb expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.068786:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.068793:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.068799:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.068809:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.068836:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.068840:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.068842:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.068849:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.068854:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.068859:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.068931:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.068931:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015800/0x14b4f8542d4f2d57 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.068938:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015800/0x14b4f8542d4f2d57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.068943:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015800/0x14b4f8542d4f2d57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.068944:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.068949:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065122.068950:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065122.068953:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065122.069018:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.069024:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069031:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069032:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069036:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.069040:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.069131:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdc9800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065122.069131:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f015400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.069135:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069135:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069140:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069140:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.069150:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065122.069152:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.069154:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065122.069155:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069156:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.069158:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069160:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015400/0x14b4f8542d4f2d34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069162:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f2d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069208:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.069213:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069217:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069217:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069221:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.069225:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069226:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f015600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065122.069228:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069229:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdc9a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.069231:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069232:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069235:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.069242:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2c000) 00010000:00010000:3.0:1746065122.069243:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.069245:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069245:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2c000) 00010000:00010000:1.0:1746065122.069246:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065122.069248:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069249:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f2d49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.069252:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2d50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.069276:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8c00/0x14b4f8542d4f2d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adcb expref: 19 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.069276:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015200/0x14b4f8542d4f2d2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add2 expref: 260 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.069285:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015800/0x14b4f8542d4f2d57 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add2 expref: 259 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.069287:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adcb expref: 18 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.069290:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.069292:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065122.069294:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.069294:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f015800, rc 0) 00010000:00010000:3.0:1746065122.069296:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065122.069297:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdc9600, rc 0) 00000100:00100000:3.0:1746065122.069348:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:28936:x1830881260989696:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 604us (1191us total) trans 8589943048 rc 0/0 00000100:00100000:3.0:1746065122.069355:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9001 00000100:00100000:1.0:1746065122.070130:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:28938:x1830881260989952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1511us (1631us total) trans 8589943047 rc 0/0 00000100:00100000:1.0:1746065122.070136:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9000 00000100:00100000:0.0:1746065122.076616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.076651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.077579:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260990336 00000100:00100000:1.0:1746065122.077586:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260990336 00000100:00100000:1.0:1746065122.077642:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10636 00000100:00100000:1.0:1746065122.077649:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881260990336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.077663:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.077676:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5add9 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.077699:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.077701:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.077707:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add9 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.077720:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add9 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.077729:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f015a00, rc 0) 00000100:00100000:1.0:1746065122.077762:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881260990336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 114us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.077768:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10636 00000100:00080000:1.0:1746065122.077791:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065122.077877:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.077892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.077911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.077926:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260990464 00000100:00100000:0.0:1746065122.077929:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260990464 00000100:00100000:0.0:1746065122.077941:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260990720 00000100:00100000:0.0:1746065122.077942:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260990720 00000100:00100000:0.0:1746065122.077956:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10637 00000100:00100000:0.0:1746065122.077961:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260990464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065122.077967:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065122.077973:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136675400/0x14b4f8542d4f2d7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ade0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065122.078004:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259709440:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065122.078053:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a599c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746065122.078062:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065122.078074:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10638 00000100:00100000:0.0:1746065122.078079:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881260990720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065122.078084:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065122.078092:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136675a00/0x14b4f8542d4f2d81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ade7 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065122.078110:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259709568:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065122.078124:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.078278:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260990592 00000100:00100000:1.0:1746065122.078281:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260990592 00000100:00100000:1.0:1746065122.078301:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 621 00000100:00100000:1.0:1746065122.078305:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1961:x1830881260990592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.078313:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.078326:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f015800/0x14b4f8542d4f2d57 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add2 expref: 259 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.078352:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.078356:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.078371:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1961:x1830881260990592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.078376:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 621 00000100:00100000:2.0:1746065122.079117:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260990208 00000100:00100000:2.0:1746065122.079122:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260990208 00000100:00100000:2.0:1746065122.079154:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3667 00000100:00100000:2.0:1746065122.079159:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:28936:x1830881260990208:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065122.079332:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:28936:x1830881260990208:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 172us (2722us total) trans 8589943049 rc 0/0 00000100:00100000:2.0:1746065122.079338:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3667 00000100:00100000:1.0:1746065122.081620:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259709568:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065122.081647:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136675a00/0x14b4f8542d4f2d81 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ade7 expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.081658:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136675a00/0x14b4f8542d4f2d81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ade7 expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.081667:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136675a00, rc 0) 00000100:00100000:1.0:1746065122.081694:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881260990720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3614us (3781us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065122.081701:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10638 00000100:00100000:2.0:1746065122.082057:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259709440:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065122.082074:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136675400/0x14b4f8542d4f2d7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ade0 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.082082:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136675400/0x14b4f8542d4f2d7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ade0 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.082090:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136675400, rc 0) 00000100:00100000:2.0:1746065122.082120:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260990464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4158us (4227us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065122.082125:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10637 00000100:00100000:2.0:1746065122.103248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.103294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.103372:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260990976 00000100:00100000:0.0:1746065122.103381:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260990976 00002000:00100000:0.0:1746065122.103415:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012d50b800 x1830881260990976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 504/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065122.103425:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50b800 with x1830881260990976 ext(1048576->2097151) 00002000:00010000:0.0:1746065122.103430:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d50b800 00000100:00100000:0.0:1746065122.103451:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260991232 00000100:00100000:0.0:1746065122.103453:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260991232 00002000:00100000:0.0:1746065122.103463:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012d508e00 x1830881260991232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065122.103469:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d508e00 with x1830881260991232 ext(1048576->2097151) 00002000:00010000:0.0:1746065122.103472:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d508e00 00000100:00100000:0.0:1746065122.103488:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4866 00000100:00100000:0.0:1746065122.103494:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260990976:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065122.105015:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4867 00000100:00100000:1.0:1746065122.105024:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260991232:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065122.114660:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.114690:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260991488 00000100:00100000:0.0:1746065122.114697:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260991488 00000100:00100000:0.0:1746065122.114741:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9002 00000100:00100000:0.0:1746065122.114747:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:28940:x1830881260991488:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065122.114764:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065122.114778:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136674600/0x14b4f8542d4f2d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5adee expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.114878:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260990976:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11383us (11637us total) trans 0 rc 708608/708608 00010000:00010000:0.0:1746065122.114878:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065122.114886:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4866 00010000:00010000:0.0:1746065122.114888:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00002000:00100000:2.0:1746065122.114893:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012d50b800 x1830881260990976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 504/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 708608/708608 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746065122.114897:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00002000:00100000:2.0:1746065122.114902:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50b800 with x1830881260990976 ext(1048576->2097151) 00002000:00010000:2.0:1746065122.114906:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d50b800 00010000:00010000:0.0:1746065122.114907:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.114912:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.114917:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115000:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136674a00/0x14b4f8542d4f2d9d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115007:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136674a00/0x14b4f8542d4f2d9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115013:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136674a00/0x14b4f8542d4f2d9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065122.115020:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065122.115084:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115088:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115093:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115097:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136674800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065122.115101:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115106:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115113:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065122.115116:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065122.115119:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115124:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136674800/0x14b4f8542d4f2d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115148:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115153:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115157:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115164:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136675000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065122.115166:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115171:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115176:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5a36800) 00010000:00010000:0.0:1746065122.115178:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065122.115180:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115184:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136675000/0x14b4f8542d4f2d96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065122.115212:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136674600/0x14b4f8542d4f2d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adee expref: 261 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.115221:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136674a00/0x14b4f8542d4f2d9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adee expref: 260 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.115227:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065122.115228:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065122.115230:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136674a00, rc 0) 00000100:00100000:0.0:1746065122.115260:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:28940:x1830881260991488:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 513us (608us total) trans 8589943050 rc 0/0 00000100:00100000:0.0:1746065122.115266:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9002 00000100:00100000:1.0:1746065122.120362:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260991232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15330us (17056us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065122.120373:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4867 00002000:00100000:1.0:1746065122.120384:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012d508e00 x1830881260991232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.120393:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d508e00 with x1830881260991232 ext(1048576->2097151) 00002000:00010000:1.0:1746065122.120399:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d508e00 00000100:00100000:0.0:1746065122.121178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.121408:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260991616 00000100:00100000:1.0:1746065122.121415:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260991616 00000100:00100000:1.0:1746065122.121459:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 622 00000100:00100000:1.0:1746065122.121465:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1960:x1830881260991616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.121478:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.121498:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136674a00/0x14b4f8542d4f2d9d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adee expref: 260 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.121515:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.121519:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.122084:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1960:x1830881260991616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 618us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.122090:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 622 00000100:00100000:0.0:1746065122.125237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.125610:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260991744 00000100:00100000:2.0:1746065122.125618:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260991744 00000100:00100000:2.0:1746065122.125677:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10639 00000100:00100000:2.0:1746065122.125684:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260991744:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.125698:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.125712:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5adf5 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.125759:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259709696:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065122.125884:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.125986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.126143:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260991872 00000100:00100000:1.0:1746065122.126148:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260991872 00000100:00100000:1.0:1746065122.126185:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10640 00000100:00100000:1.0:1746065122.126192:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260991872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.126201:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.126212:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f015800/0x14b4f8542d4f2db2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5adfc expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.126242:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259709824:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065122.126283:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.131786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.131844:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260992000 00000100:00100000:0.0:1746065122.131852:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260992000 00000100:00100000:0.0:1746065122.131907:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10641 00000100:00100000:0.0:1746065122.131916:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+17:28936:x1830881260992000:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065122.131933:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065122.131949:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae03 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.131975:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.131982:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5accf expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065122.131988:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac27 expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.131994:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065122.131995:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065122.131999:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [2011136->2097151] (req 2011136->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.132024:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac27 expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.132035:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac27 expref: 18 pid: 9716 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.132046:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259709952:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065122.132128:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5accf expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065122.132136:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5accf expref: 12 pid: 9716 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746065122.132144:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259710080:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065122.132173:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.132181:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 25 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.132188:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259710208:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065122.132207:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.132295:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259709696:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065122.132319:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adf5 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.132329:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adf5 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.132357:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf69a00, rc 0) 00000100:00100000:2.0:1746065122.132399:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881260991744:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6714us (7169us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065122.132405:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10639 00000100:00100000:1.0:1746065122.132760:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259709824:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065122.132777:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f015800/0x14b4f8542d4f2db2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adfc expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.132786:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f015800/0x14b4f8542d4f2db2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adfc expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.132853:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f015800, rc 0) 00000100:00100000:1.0:1746065122.132878:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881260991872:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6687us (6894us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065122.132884:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10640 00000100:00100000:2.0:1746065122.135476:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259709952:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.135487:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259710080:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.135492:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259710208:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.135615:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [2011136->2097151] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.135629:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136675c00, rc 0) 00000100:00100000:2.0:1746065122.135674:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+18:28936:x1830881260992000:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3759us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.135681:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10641 00000100:00100000:3.0:1746065122.136037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.136092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.136154:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260992512 00000100:00100000:2.0:1746065122.136159:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260992512 00000100:00100000:2.0:1746065122.136194:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10642 00000100:00100000:2.0:1746065122.136199:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28938:x1830881260992512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.136211:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.136223:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae0a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.136241:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.136242:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.136248:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae0a expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.136259:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae0a expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.136265:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf69c00, rc 0) 00000100:00100000:2.0:1746065122.136284:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28938:x1830881260992512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.136288:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10642 00000100:00100000:1.0:1746065122.136362:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260992128 00000100:00100000:1.0:1746065122.136366:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260992128 00010000:00010000:1.0:1746065122.136389:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5accf expref: 13 pid: 9716 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746065122.136409:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5295 00000100:00100000:1.0:1746065122.136413:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881260992128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.136521:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.136538:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5accf expref: 13 pid: 9716 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065122.136546:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5accf expref: 13 pid: 9716 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065122.136560:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0400/0x14b4f8542d4f2bb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5accf expref: 13 pid: 9716 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065122.136569:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.136582:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881260992128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 169us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.136587:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5295 00000100:00080000:2.0:1746065122.136835:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065122.137907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.137940:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.138045:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260992384 00000100:00100000:1.0:1746065122.138050:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260992384 00010000:00010000:1.0:1746065122.138068:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.138093:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260992256 00000100:00100000:1.0:1746065122.138095:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260992256 00010000:00010000:1.0:1746065122.138105:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac27 expref: 18 pid: 9716 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.138122:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5296 00000100:00100000:1.0:1746065122.138127:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260992384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.138135:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.138147:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.138154:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.138167:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdd0000/0x14b4f8542d4f2a9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac04 expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.138176:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.138198:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881260992384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.138203:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5296 00000100:00100000:1.0:1746065122.138214:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5297 00000100:00100000:1.0:1746065122.138217:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881260992256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.138223:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.138228:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac27 expref: 18 pid: 9716 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.138235:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac27 expref: 18 pid: 9716 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.138244:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b267c00/0x14b4f8542d4f2abe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac27 expref: 18 pid: 9716 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.138250:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.138252:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.138257:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 17 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.138264:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 17 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.138284:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 17 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.138293:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259710336:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065122.138332:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.139782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.140400:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260992768 00000100:00100000:2.0:1746065122.140405:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260992768 00000100:00100000:2.0:1746065122.140439:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10643 00000100:00100000:2.0:1746065122.140445:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:28940:x1830881260992768:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065122.140456:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.140476:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae11 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.140495:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 17 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.140500:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.140502:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746065122.140804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.141788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.141927:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259710336:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065122.141943:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065122.141972:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260992256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3754us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.141981:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5297 00000100:00100000:1.0:1746065122.142442:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260992896 00000100:00100000:1.0:1746065122.142447:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260992896 00002000:00100000:1.0:1746065122.142475:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88008fd04000 x1830881260992896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.142488:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04000 with x1830881260992896 ext(2097152->3145727) 00002000:00010000:1.0:1746065122.142491:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04000 00010000:00010000:2.0:1746065122.142495:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3497984->3891199] (req 3497984->3891199) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.142514:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260993152 00000100:00100000:1.0:1746065122.142517:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260993152 00010000:00010000:2.0:1746065122.142526:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 17 pid: 21235 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065122.142529:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (2011136->2015231) req@ffff88008fd07b80 x1830881260993152/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.142535:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07b80 with x1830881260993152 ext(2011136->2015231) 00010000:00010000:2.0:1746065122.142537:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 17 pid: 21235 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746065122.142537:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd07b80 00000100:00100000:1.0:1746065122.142546:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4868 00000100:00100000:2.0:1746065122.142551:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259710464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.142559:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881260992896:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065122.142601:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.142603:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4869 00000100:00100000:0.0:1746065122.142609:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260993152:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065122.142724:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881260993152:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 115us (937us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065122.142732:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4869 00002000:00100000:0.0:1746065122.142736:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x379:0x0] (2011136->2015231) req@ffff88008fd07b80 x1830881260993152/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065122.142743:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07b80 with x1830881260993152 ext(2011136->2015231) 00002000:00010000:0.0:1746065122.142746:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd07b80 00000100:00100000:2.0:1746065122.145274:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259710464:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.145299:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3497984->3891199] (req 3497984->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.145313:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf69e00, rc 0) 00000100:00100000:2.0:1746065122.145348:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:28940:x1830881260992768:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4895us (5562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.145354:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10643 00000100:00100000:3.0:1746065122.145442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.145501:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260993280 00000100:00100000:0.0:1746065122.145507:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260993280 00002000:00100000:0.0:1746065122.145532:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3014656->3145727) req@ffff88009baa3800 x1830881260993280/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065122.145540:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3800 with x1830881260993280 ext(3014656->3145727) 00010000:00010000:0.0:1746065122.145546:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 17 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065122.145557:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 17 pid: 21235 timeout: 821 lvb_type: 0 00002000:00010000:0.0:1746065122.145563:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa3800 00000100:00100000:0.0:1746065122.145575:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1499 00000100:00100000:0.0:1746065122.145581:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881260993280:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065122.148234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.148439:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260993408 00000100:00100000:2.0:1746065122.148531:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260993408 00000100:00100000:2.0:1746065122.148564:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10644 00000100:00100000:2.0:1746065122.148570:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+19:28936:x1830881260993408:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065122.148584:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.148599:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae18 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.148621:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 23 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.148627:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.148629:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.148638:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->1486847] (req 1048576->1486847) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.148663:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 23 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.148677:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 23 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.148687:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259710592:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.148738:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.150737:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881260992896:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8179us (9926us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065122.150746:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4868 00002000:00100000:2.0:1746065122.150755:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88008fd04000 x1830881260992896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.150763:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04000 with x1830881260992896 ext(2097152->3145727) 00002000:00010000:2.0:1746065122.150768:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04000 00000100:00100000:1.0:1746065122.150924:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260993280:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5342us (5481us total) trans 21474840015 rc 0/0 00000100:00100000:1.0:1746065122.150931:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1499 00002000:00100000:1.0:1746065122.150937:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3014656->3145727) req@ffff88009baa3800 x1830881260993280/t21474840015(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/448 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.150944:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3800 with x1830881260993280 ext(3014656->3145727) 00010000:00010000:1.0:1746065122.150950:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.150959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065122.150960:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746065122.150966:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa3800 00000100:00100000:1.0:1746065122.150978:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260993536 00000100:00100000:1.0:1746065122.150983:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260993536 00002000:00100000:1.0:1746065122.151003:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1196032->1535999) req@ffff88009ff20000 x1830881260993536/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.151010:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20000 with x1830881260993536 ext(1196032->1535999) 00010000:00010000:1.0:1746065122.151014:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.151020:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 24 pid: 21235 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746065122.151024:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff20000 00000100:00100000:2.0:1746065122.151032:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259710592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.151036:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1500 00000100:00100000:1.0:1746065122.151041:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881260993536:12345-192.168.202.46@tcp:4:multiop.0 00010000:00010000:2.0:1746065122.151050:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->1486847] (req 1048576->1486847) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.151061:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf69a00, rc 0) 00000100:00100000:2.0:1746065122.151079:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+20:28936:x1830881260993408:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2509us (2852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.151085:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10644 00000100:00100000:0.0:1746065122.154265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.154330:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260993664 00000100:00100000:2.0:1746065122.154337:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260993664 00000100:00100000:2.0:1746065122.154400:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10645 00000100:00100000:2.0:1746065122.154408:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:28938:x1830881260993664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.154424:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.154438:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae1f expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.154458:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.154461:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.154465:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.154475:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.154483:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1e00, rc 0) 00000100:00100000:2.0:1746065122.154527:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:28938:x1830881260993664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 120us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.154533:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10645 00000100:00100000:0.0:1746065122.155251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.155318:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260993792 00000100:00100000:3.0:1746065122.155323:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260993792 00010000:00010000:3.0:1746065122.155353:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 20 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.155372:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5298 00000100:00100000:3.0:1746065122.155377:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881260993792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.155386:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065122.155398:0:10991:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065122 -> 1746065123 00010000:00010000:3.0:1746065122.155404:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 20 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.155413:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 20 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.155428:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f3b5200/0x14b4f8542d4f2cc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad7e expref: 20 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.155442:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.155444:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.155449:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.155456:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.155462:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.155463:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.155466:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.155472:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.155504:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.155514:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259710720:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065122.155563:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.155569:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259710848:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065122.155581:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.157424:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881260993536:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 6378us (6460us total) trans 21474840016 rc 0/0 00000100:00100000:1.0:1746065122.157434:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1500 00002000:00100000:1.0:1746065122.157443:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1196032->1535999) req@ffff88009ff20000 x1830881260993536/t21474840016(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/448 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.157451:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20000 with x1830881260993536 ext(1196032->1535999) 00010000:00010000:1.0:1746065122.157458:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 27 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.157469:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 27 pid: 21235 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746065122.157480:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff20000 00000100:00100000:0.0:1746065122.158635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.158695:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259710720:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065122.158704:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259710848:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065122.158720:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065122.158761:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881260993792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3383us (3512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.158769:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5298 00000100:00100000:0.0:1746065122.158914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.158992:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260994048 00000100:00100000:2.0:1746065122.158998:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260994048 00002000:00100000:2.0:1746065122.159027:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009ff21c00 x1830881260994048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.159035:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21c00 with x1830881260994048 ext(2097152->3145727) 00002000:00010000:2.0:1746065122.159039:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff21c00 00000100:00100000:2.0:1746065122.159059:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260994304 00000100:00100000:2.0:1746065122.159065:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260994304 00002000:00100000:2.0:1746065122.159074:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3497984->3502079) req@ffff88009ff22a00 x1830881260994304/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065122.159084:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4870 00002000:00100000:2.0:1746065122.159088:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff22a00 with x1830881260994304 ext(3497984->3502079) 00000100:00100000:3.0:1746065122.159091:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881260994048:12345-192.168.202.46@tcp:3:multiop.0 00002000:00010000:2.0:1746065122.159091:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff22a00 00000100:00100000:2.0:1746065122.159099:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4871 00000100:00100000:2.0:1746065122.159104:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260994304:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065122.159222:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260994304:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 116us (307us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065122.159227:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4871 00002000:00100000:2.0:1746065122.159231:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3497984->3502079) req@ffff88009ff22a00 x1830881260994304/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.159238:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff22a00 with x1830881260994304 ext(3497984->3502079) 00002000:00010000:2.0:1746065122.159240:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff22a00 00000100:00100000:0.0:1746065122.161082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.161265:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260994432 00000100:00100000:3.0:1746065122.161272:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260994432 00010000:00010000:3.0:1746065122.161294:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 29 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.161323:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5299 00000100:00100000:3.0:1746065122.161329:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881260994432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.161345:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065122.161357:0:10991:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065122 -> 1746065123 00010000:00010000:3.0:1746065122.161362:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 29 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.161372:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 29 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.161390:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133260800/0x14b4f8542d4f2cfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1535999) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad9a expref: 29 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.161404:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.161406:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.161412:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.161419:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.161464:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.162205:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259710976:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065122.162285:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.166807:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259710976:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.166838:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.166873:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881260994432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5542us (5794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.166883:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5299 00000100:00100000:3.0:1746065122.167154:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260994048:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8062us (8520us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.167161:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4870 00002000:00100000:3.0:1746065122.167170:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009ff21c00 x1830881260994048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.167179:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff21c00 with x1830881260994048 ext(2097152->3145727) 00002000:00010000:3.0:1746065122.167184:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff21c00 00000100:00100000:0.0:1746065122.167888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.167949:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260994688 00000100:00100000:3.0:1746065122.167955:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260994688 00002000:00100000:3.0:1746065122.167980:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3887104->3891199) req@ffff880130446a00 x1830881260994688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.167987:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446a00 with x1830881260994688 ext(3887104->3891199) 00002000:00010000:3.0:1746065122.167991:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130446a00 00000100:00100000:3.0:1746065122.168182:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4872 00000100:00100000:3.0:1746065122.168189:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260994688:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065122.168493:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881260994688:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 304us (604us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065122.168499:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4872 00002000:00100000:3.0:1746065122.168504:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3887104->3891199) req@ffff880130446a00 x1830881260994688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.168510:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446a00 with x1830881260994688 ext(3887104->3891199) 00002000:00010000:3.0:1746065122.168512:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130446a00 00000100:00100000:0.0:1746065122.169275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.169424:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260994944 00000100:00100000:3.0:1746065122.169428:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260994944 00002000:00100000:3.0:1746065122.169444:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1482752->1486847) req@ffff880130447480 x1830881260994944/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.169451:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447480 with x1830881260994944 ext(1482752->1486847) 00002000:00010000:3.0:1746065122.169454:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130447480 00000100:00100000:3.0:1746065122.169946:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4873 00000100:00100000:3.0:1746065122.169953:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260994944:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065122.170042:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881260994944:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 90us (768us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065122.170048:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4873 00002000:00100000:3.0:1746065122.170053:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1482752->1486847) req@ffff880130447480 x1830881260994944/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.170063:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447480 with x1830881260994944 ext(1482752->1486847) 00002000:00010000:3.0:1746065122.170066:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130447480 00000100:00100000:0.0:1746065122.170238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.170374:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260995200 00000100:00100000:3.0:1746065122.170377:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260995200 00000100:00100000:3.0:1746065122.170400:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3668 00000100:00100000:3.0:1746065122.170405:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:28940:x1830881260995200:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065122.170598:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:28940:x1830881260995200:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 192us (360us total) trans 8589943051 rc 0/0 00000100:00100000:3.0:1746065122.170604:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3668 00000100:00100000:0.0:1746065122.171133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.171411:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260995328 00000100:00100000:3.0:1746065122.171414:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260995328 00000100:00100000:3.0:1746065122.171636:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10646 00000100:00100000:3.0:1746065122.171642:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28938:x1830881260995328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.171651:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.171664:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae26 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.171684:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.171691:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065122.171692:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065122.171696:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.171718:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 18 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.171728:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 18 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.171737:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259711104:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.172883:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.175395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.175500:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260995456 00000100:00100000:2.0:1746065122.175512:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260995456 00002000:00100000:2.0:1746065122.175547:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3321855) req@ffff880130445c00 x1830881260995456/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.175556:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445c00 with x1830881260995456 ext(3145728->3321855) 00010000:00010000:2.0:1746065122.175563:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 19 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.175580:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 19 pid: 21235 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065122.175586:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130445c00 00000100:00100000:2.0:1746065122.175619:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1501 00000100:00100000:2.0:1746065122.175626:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881260995456:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065122.175705:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259711104:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.175726:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.175738:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdc9c00, rc 0) 00000100:00100000:3.0:1746065122.175787:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28938:x1830881260995328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4145us (4654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.176581:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10646 00000100:00100000:2.0:1746065122.178929:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260995456:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 3297us (3534us total) trans 17179872786 rc 0/0 00000100:00100000:2.0:1746065122.178938:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1501 00002000:00100000:2.0:1746065122.178947:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3321855) req@ffff880130445c00 x1830881260995456/t17179872786(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/448 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.178955:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445c00 with x1830881260995456 ext(3145728->3321855) 00010000:00010000:2.0:1746065122.178962:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.178974:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065122.178980:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130445c00 00000100:00100000:0.0:1746065122.181886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.181971:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260995584 00000100:00100000:2.0:1746065122.181978:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260995584 00010000:00010000:2.0:1746065122.182003:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.182030:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5300 00000100:00100000:2.0:1746065122.182036:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881260995584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.182047:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065122.182062:0:10991:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065122 -> 1746065123 00010000:00010000:2.0:1746065122.182068:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.182078:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.182095:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090451400/0x14b4f8542d4f2cd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad8c expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.182109:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.182110:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.182116:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.182123:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.182149:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.182158:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259711232:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065122.182255:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.183276:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259711232:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.183286:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.183459:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+20:1958:x1830881260995584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1420us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.183466:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5300 00000100:00100000:2.0:1746065122.187252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.187654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.187708:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260995840 00000100:00100000:0.0:1746065122.187709:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260996096 00000100:00100000:1.0:1746065122.187716:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260995840 00000100:00100000:0.0:1746065122.187716:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260996096 00002000:00100000:1.0:1746065122.187746:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012d50bb80 x1830881260995840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065122.187746:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d50aa00 x1830881260996096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 504/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.187755:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50bb80 with x1830881260995840 ext(3145728->4194303) 00002000:00100000:0.0:1746065122.187755:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50aa00 with x1830881260996096 ext(3145728->4194303) 00002000:00010000:1.0:1746065122.187760:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d50bb80 00002000:00010000:0.0:1746065122.187760:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d50aa00 00000100:00100000:0.0:1746065122.187787:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4874 00000100:00100000:0.0:1746065122.187793:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260996096:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065122.188321:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4875 00000100:00100000:1.0:1746065122.188328:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881260995840:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065122.196070:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260996096:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8266us (8405us total) trans 0 rc 655360/655360 00000100:00100000:2.0:1746065122.196081:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4874 00002000:00100000:2.0:1746065122.196092:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d50aa00 x1830881260996096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 504/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 655360/655360 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.196100:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50aa00 with x1830881260996096 ext(3145728->4194303) 00002000:00010000:2.0:1746065122.196106:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d50aa00 00000100:00100000:1.0:1746065122.197335:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881260995840:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 9004us (10087us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065122.197355:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4875 00002000:00100000:1.0:1746065122.197362:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012d50bb80 x1830881260995840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.197370:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50bb80 with x1830881260995840 ext(3145728->4194303) 00002000:00010000:1.0:1746065122.197373:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d50bb80 00000100:00100000:2.0:1746065122.209240:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.209274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.209309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.209350:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260996224 00000100:00100000:2.0:1746065122.209358:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260996224 00000100:00100000:2.0:1746065122.209397:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260996480 00000100:00100000:2.0:1746065122.209400:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260996480 00000100:00100000:2.0:1746065122.209412:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260996352 00000100:00100000:2.0:1746065122.209414:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260996352 00000100:00100000:2.0:1746065122.209426:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10647 00000100:00100000:2.0:1746065122.209433:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260996224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.209453:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.209468:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f2de3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae2d expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.209514:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259711360:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065122.209578:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.209594:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10648 00000100:00100000:2.0:1746065122.209599:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881260996480:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.209604:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.209611:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f2dea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae3b expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.209633:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259711488:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065122.209650:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.209661:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10649 00000100:00100000:2.0:1746065122.209666:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260996352:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.209670:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.209676:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f2df1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae34 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.209694:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259711616:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065122.209711:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6240 going to sleep for 11 seconds 00002000:00010000:3.0:1746065122.211719:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065122 -> 1746065123 00002000:00010000:3.0:1746065122.211724:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065122 -> 1746065123 00000100:00100000:3.0:1746065122.211742:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259711488:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065122.211767:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f2dea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae3b expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.211779:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f2dea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae3b expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.211792:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd37200, rc 0) 00000100:00100000:3.0:1746065122.211845:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881260996480:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2245us (2568us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.211852:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10648 00002000:00010000:3.0:1746065122.211953:0:21235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime: 1746065122 -> 1746065123 00002000:00010000:3.0:1746065122.211955:0:21235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime: 1746065122 -> 1746065123 00000100:00100000:3.0:1746065122.211963:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259711616:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065122.211976:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f2df1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae34 expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.211983:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f2df1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae34 expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.211990:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36c00, rc 0) 00000100:00100000:3.0:1746065122.212008:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881260996352:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2342us (2699us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.212013:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10649 00002000:00010000:2.0:1746065122.212120:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065121 -> 1746065123 00002000:00010000:2.0:1746065122.212123:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime: 1746065121 -> 1746065123 00002000:00010000:2.0:1746065122.212124:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065122 -> 1746065123 00000100:00100000:2.0:1746065122.212133:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259711360:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065122.212147:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f2de3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae2d expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.212154:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f2de3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae2d expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.212179:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd37a00, rc 0) 00000100:00100000:2.0:1746065122.212199:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881260996224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2767us (2967us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065122.212204:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10647 00000100:00100000:0.0:1746065122.219146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.220042:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260996736 00000100:00100000:1.0:1746065122.220050:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260996736 00002000:00100000:1.0:1746065122.220084:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880130444380 x1830881260996736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.220092:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444380 with x1830881260996736 ext(4194304->5029887) 00002000:00010000:1.0:1746065122.220097:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130444380 00000100:00100000:1.0:1746065122.220285:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4876 00000100:00100000:1.0:1746065122.220294:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260996736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065122.229669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.230389:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881260996736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10095us (11250us total) trans 0 rc 835584/835584 00000100:00100000:1.0:1746065122.230399:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4876 00002000:00100000:1.0:1746065122.230408:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880130444380 x1830881260996736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.230417:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444380 with x1830881260996736 ext(4194304->5029887) 00002000:00010000:1.0:1746065122.230423:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130444380 00000100:00100000:3.0:1746065122.231126:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260996992 00000100:00100000:3.0:1746065122.231134:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260996992 00000100:00100000:3.0:1746065122.231170:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9003 00000100:00100000:3.0:1746065122.231178:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:28945:x1830881260996992:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.231193:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.231217:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398000/0x14b4f8542d4f2df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae42 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.231898:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.231911:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.231919:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.231931:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.231936:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.231940:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232026:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e0d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232033:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232038:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065122.232045:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065122.232186:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232193:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232197:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232202:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a398200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.232205:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232211:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232219:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065122.232222:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.232225:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232230:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232255:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232260:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232264:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232268:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a398400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.232270:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232278:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232284:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2c700) 00010000:00010000:3.0:1746065122.232285:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.232287:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232292:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2e06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.232328:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398000/0x14b4f8542d4f2df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae42 expref: 22 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.232358:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae42 expref: 21 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.232365:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.232367:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065122.232369:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a398600, rc 0) 00000100:00100000:3.0:1746065122.232411:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:28945:x1830881260996992:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1233us (2748us total) trans 8589943052 rc 0/0 00000100:00100000:3.0:1746065122.232417:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9003 00000100:00100000:0.0:1746065122.237099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.237129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.237162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.237445:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260997120 00000100:00100000:2.0:1746065122.237454:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260997120 00000100:00100000:2.0:1746065122.237498:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10650 00000100:00100000:2.0:1746065122.237505:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260997120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.237520:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.237533:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f2e1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae49 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.237576:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259711744:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065122.237652:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065122.237754:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260997376 00000100:00100000:3.0:1746065122.237758:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260997376 00000100:00100000:3.0:1746065122.237775:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260997248 00000100:00100000:3.0:1746065122.237777:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260997248 00000100:00100000:3.0:1746065122.237789:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10651 00000100:00100000:3.0:1746065122.237794:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260997376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.237801:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065122.237805:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10652 00010000:00010000:3.0:1746065122.237808:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae57 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.237849:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259711872:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065122.237883:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.237910:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260997248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.237918:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.237925:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae50 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.237945:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259712000:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065122.237969:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.239248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.239357:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260997632 00000100:00100000:2.0:1746065122.239361:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260997632 00000100:00100000:3.0:1746065122.239461:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259711744:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065122.239478:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f2e1b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae49 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.239488:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f2e1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae49 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.239496:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd37200, rc 0) 00000100:00100000:3.0:1746065122.239519:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260997120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2015us (2427us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.239525:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10650 00000100:00100000:2.0:1746065122.240000:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3669 00000100:00100000:2.0:1746065122.240007:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:28945:x1830881260997632:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065122.241577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.241745:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260997760 00000100:00100000:1.0:1746065122.241751:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260997760 00000100:00100000:1.0:1746065122.241778:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 623 00000100:00100000:3.0:1746065122.241780:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259711872:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065122.241783:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881260997760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.241791:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.241802:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e22 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae57 expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065122.241802:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:28945:x1830881260997632:12345-192.168.202.46@tcp:35:cat.0 Request processed in 1794us (2554us total) trans 8589943053 rc 0/0 00010000:00010000:1.0:1746065122.241805:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e0d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae42 expref: 23 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.241809:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3669 00010000:00010000:3.0:1746065122.241812:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae57 expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.241836:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a398c00, rc 0) 00010000:00010000:1.0:1746065122.241836:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.241840:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065122.241855:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881260997376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4060us (4725us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.241860:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10651 00000100:00100000:1.0:1746065122.241861:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881260997760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.241867:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 623 00000100:00100000:1.0:1746065122.242004:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259712000:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065122.242017:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae50 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.242025:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae50 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.242031:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f015600, rc 0) 00000100:00100000:1.0:1746065122.242059:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260997248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4246us (4896us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065122.242064:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10652 00000100:00100000:0.0:1746065122.245082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.245130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.245228:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260997888 00000100:00100000:1.0:1746065122.245236:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260997888 00000100:00100000:1.0:1746065122.245267:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260998016 00000100:00100000:1.0:1746065122.245269:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260998016 00000100:00100000:1.0:1746065122.245288:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10653 00000100:00100000:1.0:1746065122.245295:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881260997888:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.245310:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.245324:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae5e expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.245358:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.245360:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.245367:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae5e expref: 21 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.245379:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae5e expref: 21 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.245387:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f014000, rc 0) 00000100:00100000:1.0:1746065122.245422:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881260997888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 127us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.245427:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10654 00000100:00100000:0.0:1746065122.245433:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881260998016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065122.245441:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065122.245449:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f108c00/0x14b4f8542d4f2e37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae65 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.245498:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.245513:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260998144 00000100:00100000:3.0:1746065122.245516:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260998144 00000100:00100000:1.0:1746065122.245543:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10653 00000100:00100000:0.0:1746065122.245544:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259712128:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065122.245588:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065122.245592:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10655 00000100:00100000:3.0:1746065122.245598:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260998144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.245605:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.245612:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a398e00/0x14b4f8542d4f2e3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae6c expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.245634:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259712256:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065122.245674:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.245707:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.245717:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260998400 00000100:00100000:1.0:1746065122.245719:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260998400 00000100:00100000:1.0:1746065122.245731:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260998272 00000100:00100000:1.0:1746065122.245732:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260998272 00000100:00100000:1.0:1746065122.245741:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10656 00000100:00100000:1.0:1746065122.245745:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260998400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.245751:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.245756:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f014400/0x14b4f8542d4f2e45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae7a expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.245774:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259712384:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065122.245793:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.245806:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10657 00000100:00100000:1.0:1746065122.245811:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881260998272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.245837:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.245843:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f014e00/0x14b4f8542d4f2e4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae73 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.245868:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259712512:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065122.245897:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065122.245973:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.249094:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259712128:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065122.249103:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259712256:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065122.249121:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a398e00/0x14b4f8542d4f2e3e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae6c expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.249121:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f108c00/0x14b4f8542d4f2e37 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae65 expref: 20 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.249132:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a398e00/0x14b4f8542d4f2e3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae6c expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.249132:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f108c00/0x14b4f8542d4f2e37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae65 expref: 20 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.249141:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a398e00, rc 0) 00010000:00010000:2.0:1746065122.249142:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f108c00, rc 0) 00000100:00100000:2.0:1746065122.249180:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881260998016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3746us (4049us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065122.249187:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10654 00000100:00100000:1.0:1746065122.249208:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259712384:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065122.249220:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f014400/0x14b4f8542d4f2e45 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae7a expref: 30 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.249227:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f014400/0x14b4f8542d4f2e45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae7a expref: 30 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.249233:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f014400, rc 0) 00000100:00100000:3.0:1746065122.249300:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881260998144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3702us (3801us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.249305:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10655 00000100:00100000:1.0:1746065122.249376:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881260998400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3630us (3701us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065122.249380:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10656 00000100:00100000:1.0:1746065122.249406:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259712512:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065122.249417:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f014e00/0x14b4f8542d4f2e4c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae73 expref: 27 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.249424:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f014e00/0x14b4f8542d4f2e4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae73 expref: 27 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.249430:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f014e00, rc 0) 00000100:00100000:1.0:1746065122.249441:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881260998272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3631us (3734us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065122.249448:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10657 00000100:00100000:0.0:1746065122.256022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.256074:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260998656 00000100:00100000:2.0:1746065122.256082:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260998656 00000100:00100000:2.0:1746065122.256128:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3670 00000100:00100000:2.0:1746065122.256135:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:28938:x1830881260998656:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065122.256458:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:28938:x1830881260998656:12345-192.168.202.46@tcp:35:cat.0 Request processed in 323us (446us total) trans 8589943054 rc 0/0 00000100:00100000:2.0:1746065122.256464:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3670 00000100:00100000:0.0:1746065122.260267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.260945:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260998912 00000100:00100000:1.0:1746065122.260953:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260998912 00000100:00100000:0.0:1746065122.260955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:1.0:1746065122.260987:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2011135) req@ffff88009c3f9c00 x1830881260998912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.260996:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9c00 with x1830881260998912 ext(1048576->2011135) 00002000:00010000:1.0:1746065122.261001:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9c00 00000100:00100000:1.0:1746065122.261017:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260999168 00000100:00100000:1.0:1746065122.261018:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260999168 00002000:00100000:1.0:1746065122.261026:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1486848->2097151) req@ffff88009c3fa680 x1830881260999168/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.261031:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830881260999168 ext(1486848->2097151) 00002000:00010000:1.0:1746065122.261034:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa680 00000100:00100000:1.0:1746065122.261043:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4877 00000100:00100000:1.0:1746065122.261049:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+20:1958:x1830881260998912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065122.261110:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4878 00000100:00100000:2.0:1746065122.261118:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+20:1958:x1830881260999168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065122.265268:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881260999168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 4142us (4304us total) trans 0 rc 610304/610304 00000100:00100000:2.0:1746065122.265279:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4878 00002000:00100000:2.0:1746065122.265289:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1486848->2097151) req@ffff88009c3fa680 x1830881260999168/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 610304/610304 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.265298:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830881260999168 ext(1486848->2097151) 00002000:00010000:2.0:1746065122.265303:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa680 00000100:00100000:1.0:1746065122.274989:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881260998912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13931us (14721us total) trans 0 rc 962560/962560 00000100:00100000:1.0:1746065122.274999:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4877 00002000:00100000:1.0:1746065122.275008:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2011135) req@ffff88009c3f9c00 x1830881260998912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 962560/962560 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.275017:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9c00 with x1830881260998912 ext(1048576->2011135) 00002000:00010000:1.0:1746065122.275022:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9c00 00000100:00100000:0.0:1746065122.285537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.285865:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260999296 00000100:00100000:1.0:1746065122.285874:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260999296 00000100:00100000:1.0:1746065122.285924:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10658 00000100:00100000:1.0:1746065122.285931:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+19:28945:x1830881260999296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.285946:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.285960:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae81 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.285983:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.285984:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.285990:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae81 expref: 20 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.286003:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae81 expref: 20 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.286010:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f015600, rc 0) 00000100:00100000:1.0:1746065122.286055:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+20:28945:x1830881260999296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 123us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.286060:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10658 00000100:00100000:0.0:1746065122.294772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.294855:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260999552 00000100:00100000:3.0:1746065122.294864:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260999552 00000100:00100000:3.0:1746065122.294919:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9004 00000100:00100000:3.0:1746065122.294927:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:28950:x1830881260999552:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065122.295356:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.295373:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399000/0x14b4f8542d4f2e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae88 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.295457:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295466:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295474:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295484:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295488:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295493:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295582:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399e00/0x14b4f8542d4f2e6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295590:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399e00/0x14b4f8542d4f2e6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295596:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399e00/0x14b4f8542d4f2e6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065122.295673:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065122.295742:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295748:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295754:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295759:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a399800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.295762:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295767:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295776:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065122.295778:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.295781:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.295786:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399800/0x14b4f8542d4f2e61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.296143:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.296148:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.296153:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.296161:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a399c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.296163:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.296168:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.296174:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2c800) 00010000:00010000:3.0:1746065122.296176:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.296178:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.296182:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399c00/0x14b4f8542d4f2e68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.296210:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399000/0x14b4f8542d4f2e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae88 expref: 264 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.296224:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399e00/0x14b4f8542d4f2e6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae88 expref: 263 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.296230:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.296232:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065122.296234:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a399e00, rc 0) 00000100:00100000:3.0:1746065122.296270:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:28950:x1830881260999552:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1344us (1507us total) trans 8589943055 rc 0/0 00000100:00100000:3.0:1746065122.296276:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9004 00000100:00100000:2.0:1746065122.296917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.297211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.297318:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260999808 00000100:00100000:3.0:1746065122.297322:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260999808 00000100:00100000:0.0:1746065122.297681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.298049:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261000064 00000100:00100000:1.0:1746065122.298053:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261000064 00002000:00100000:1.0:1746065122.298082:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009c3f9500 x1830881261000064/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065122.298581:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9005 00000100:00100000:3.0:1746065122.298589:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:28949:x1830881260999808:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:2.0:1746065122.298590:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261000320 00000100:00100000:2.0:1746065122.298594:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261000320 00010000:00010000:3.0:1746065122.298606:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746065122.298614:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009c3f9180 x1830881261000320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065122.298619:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398e00/0x14b4f8542d4f2e7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae8f expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065122.298622:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830881261000320 ext(3145728->4194303) 00002000:00010000:2.0:1746065122.298627:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9180 00000100:00100000:2.0:1746065122.298642:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4879 00000100:00100000:2.0:1746065122.298647:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261000320:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065122.298692:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298701:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298709:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298719:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298724:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298728:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298797:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399a00/0x14b4f8542d4f2e92 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298803:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399a00/0x14b4f8542d4f2e92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298807:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399a00/0x14b4f8542d4f2e92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065122.298826:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065122.298886:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298891:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298896:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298900:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a398c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.298903:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298907:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298915:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065122.298917:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.298920:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298924:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398c00/0x14b4f8542d4f2e84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298933:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298937:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298941:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298944:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a398600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.298946:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298951:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298955:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2c000) 00010000:00010000:3.0:1746065122.298956:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.298958:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298961:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398600/0x14b4f8542d4f2e8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.298986:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398e00/0x14b4f8542d4f2e7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae8f expref: 24 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.298994:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399a00/0x14b4f8542d4f2e92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae8f expref: 23 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.298999:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.299000:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065122.299002:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a399a00, rc 0) 00000100:00100000:3.0:1746065122.299044:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+23:28949:x1830881260999808:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 456us (2128us total) trans 8589943056 rc 0/0 00000100:00100000:3.0:1746065122.299049:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9005 00002000:00100000:1.0:1746065122.299643:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9500 with x1830881261000064 ext(2097152->3145727) 00002000:00010000:1.0:1746065122.299646:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9500 00000100:00100000:1.0:1746065122.299662:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4880 00000100:00100000:1.0:1746065122.299669:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+20:1958:x1830881261000064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065122.301800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.302126:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261000448 00000100:00100000:2.0:1746065122.302133:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261000448 00000100:00100000:2.0:1746065122.302170:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 624 00000100:00100000:2.0:1746065122.302177:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:1959:x1830881261000448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.302187:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.302205:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399e00/0x14b4f8542d4f2e6f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae88 expref: 263 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.302223:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.302227:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.302248:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1959:x1830881261000448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.302256:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 624 00000100:00100000:2.0:1746065122.311788:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261000320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13131us (14097us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065122.311798:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4879 00002000:00100000:2.0:1746065122.311808:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009c3f9180 x1830881261000320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.311841:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830881261000320 ext(3145728->4194303) 00002000:00010000:2.0:1746065122.311847:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9180 00000100:00100000:0.0:1746065122.312359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.312399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.312656:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261000832 00000100:00100000:3.0:1746065122.312664:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261000832 00000100:00100000:3.0:1746065122.312709:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 625 00000100:00100000:3.0:1746065122.312715:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261000832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.312726:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.312747:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399a00/0x14b4f8542d4f2e92 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae8f expref: 23 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.312769:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.312773:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.312787:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261000704 00000100:00100000:2.0:1746065122.312790:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261000704 00000100:00100000:2.0:1746065122.312810:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3671 00000100:00100000:3.0:1746065122.312811:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261000832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.312829:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:28949:x1830881261000704:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065122.312831:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 625 00000100:00100000:2.0:1746065122.312994:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:28949:x1830881261000704:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 178us (636us total) trans 8589943057 rc 0/0 00000100:00100000:2.0:1746065122.313000:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3671 00000100:00100000:1.0:1746065122.313923:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+20:1958:x1830881261000064:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14253us (16710us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065122.313929:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4880 00002000:00100000:1.0:1746065122.313937:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009c3f9500 x1830881261000064/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.313944:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9500 with x1830881261000064 ext(2097152->3145727) 00002000:00010000:1.0:1746065122.313947:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9500 00000100:00100000:0.0:1746065122.323468:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.323562:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261000960 00000100:00100000:2.0:1746065122.323569:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261000960 00000100:00100000:2.0:1746065122.323678:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10659 00000100:00100000:2.0:1746065122.323686:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+20:28945:x1830881261000960:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.323792:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.323809:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae96 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.323927:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 25 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.323934:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.323936:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.323938:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.323963:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 25 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.323973:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 25 pid: 25185 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.323983:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259712640:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.324334:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c1600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065122.325527:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259712640:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.325545:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.325555:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c870a00, rc 0) 00000100:00100000:3.0:1746065122.325580:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+21:28945:x1830881261000960:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1895us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.325586:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10659 00000100:00100000:0.0:1746065122.326163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.326404:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261001088 00000100:00100000:1.0:1746065122.326409:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261001088 00002000:00100000:1.0:1746065122.326437:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3497984->3891199) req@ffff88012f3d0a80 x1830881261001088/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.326445:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0a80 with x1830881261001088 ext(3497984->3891199) 00010000:00010000:1.0:1746065122.326451:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 26 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.326460:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 26 pid: 25185 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746065122.326465:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3d0a80 00000100:00100000:1.0:1746065122.326476:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1502 00000100:00100000:1.0:1746065122.326481:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261001088:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065122.330976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.331051:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261001216 00000100:00100000:2.0:1746065122.331059:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261001216 00000100:00100000:2.0:1746065122.331094:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10660 00000100:00100000:2.0:1746065122.331101:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+21:28949:x1830881261001216:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065122.331115:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.331129:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ae9d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.331151:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.331159:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae81 expref: 22 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.331169:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065122.331171:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065122.331173:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2134016->2469887] (req 2134016->2469887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.331193:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae81 expref: 22 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.331201:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae81 expref: 22 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.331210:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259712768:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.331277:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.331285:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 27 pid: 25185 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.331292:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259712896:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.331445:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.336875:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261001088:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10384us (10704us total) trans 21474840017 rc 0/0 00000100:00100000:1.0:1746065122.336885:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1502 00002000:00100000:1.0:1746065122.336895:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3497984->3891199) req@ffff88012f3d0a80 x1830881261001088/t21474840017(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/448 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.336910:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0a80 with x1830881261001088 ext(3497984->3891199) 00010000:00010000:1.0:1746065122.336919:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 28 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.336930:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 28 pid: 25185 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746065122.336935:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3d0a80 00000100:00100000:2.0:1746065122.337289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.337353:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261001344 00000100:00100000:0.0:1746065122.337361:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261001344 00010000:00010000:0.0:1746065122.337383:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 28 pid: 25185 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.337405:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5301 00000100:00100000:0.0:1746065122.337413:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881261001344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065122.337426:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065122.337444:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 28 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065122.337454:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 28 pid: 25185 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.337466:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259712768:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065122.337477:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065122.337478:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f2dd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae1f expref: 28 pid: 25185 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.337495:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259712896:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065122.337510:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881261001344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (220us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065122.337515:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2134016->2469887] (req 2134016->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065122.337515:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5301 00010000:00010000:3.0:1746065122.337525:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c871200, rc 0) 00000100:00100000:3.0:1746065122.337550:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+22:28949:x1830881261001216:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6449us (6584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.337555:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10660 00000100:00100000:0.0:1746065122.340067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.340123:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261001472 00000100:00100000:2.0:1746065122.340129:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261001472 00010000:00010000:2.0:1746065122.340153:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae81 expref: 22 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.340179:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5302 00000100:00100000:2.0:1746065122.340185:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261001472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.340196:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.340211:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae81 expref: 22 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.340221:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae81 expref: 22 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.340237:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f015600/0x14b4f8542d4f2e53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae81 expref: 22 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.340261:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.340293:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261001472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.340298:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5302 00000100:00100000:0.0:1746065122.350005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.350162:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261001600 00000100:00100000:2.0:1746065122.350170:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261001600 00010000:00010000:2.0:1746065122.350196:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 27 pid: 25185 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.350229:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5303 00000100:00100000:2.0:1746065122.350236:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881261001600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.350249:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.350267:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 27 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.350278:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 27 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.350296:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69e00/0x14b4f8542d4f2dc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3497984->3891199) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae11 expref: 27 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.350322:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.350324:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.350335:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.350350:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.350358:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.350359:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.350363:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.350369:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.350399:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.350409:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259713024:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.350506:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.350515:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259713152:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065122.350532:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.357512:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.357563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.357844:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259713024:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065122.357856:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259713152:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.357871:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.357917:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261001600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7681us (7918us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.357926:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5303 00000100:00100000:1.0:1746065122.358038:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261001856 00000100:00100000:1.0:1746065122.358043:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261001856 00002000:00100000:1.0:1746065122.358077:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012f3d0700 x1830881261001856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.358085:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0700 with x1830881261001856 ext(3145728->4194303) 00002000:00010000:1.0:1746065122.358089:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d0700 00000100:00100000:1.0:1746065122.358104:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261002112 00000100:00100000:1.0:1746065122.358107:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261002112 00002000:00100000:1.0:1746065122.358117:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2134016->2138111) req@ffff88012f3d1500 x1830881261002112/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.358124:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1500 with x1830881261002112 ext(2134016->2138111) 00002000:00010000:1.0:1746065122.358126:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d1500 00000100:00100000:1.0:1746065122.358136:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4881 00000100:00100000:1.0:1746065122.358143:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881261001856:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065122.358147:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4882 00000100:00100000:0.0:1746065122.358153:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261002112:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065122.358261:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261002112:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 108us (697us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065122.358266:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4882 00002000:00100000:0.0:1746065122.358270:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2134016->2138111) req@ffff88012f3d1500 x1830881261002112/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065122.358276:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1500 with x1830881261002112 ext(2134016->2138111) 00002000:00010000:0.0:1746065122.358278:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d1500 00000100:00100000:0.0:1746065122.372903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.376418:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881261001856:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 18268us (18908us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.376427:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4881 00002000:00100000:3.0:1746065122.376438:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012f3d0700 x1830881261001856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.376446:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d0700 with x1830881261001856 ext(3145728->4194303) 00002000:00010000:3.0:1746065122.376451:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d0700 00000100:00100000:3.0:1746065122.376470:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261002368 00000100:00100000:3.0:1746065122.376475:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261002368 00002000:00100000:3.0:1746065122.376498:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2465792->2469887) req@ffff88012f3d2a00 x1830881261002368/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.376504:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d2a00 with x1830881261002368 ext(2465792->2469887) 00002000:00010000:3.0:1746065122.376507:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d2a00 00000100:00100000:3.0:1746065122.376633:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4883 00000100:00100000:3.0:1746065122.376640:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261002368:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065122.376746:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261002368:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 107us (3851us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065122.376751:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4883 00002000:00100000:3.0:1746065122.376756:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2465792->2469887) req@ffff88012f3d2a00 x1830881261002368/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.376762:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d2a00 with x1830881261002368 ext(2465792->2469887) 00002000:00010000:3.0:1746065122.376765:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d2a00 00000100:00100000:0.0:1746065122.386652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.386716:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261002496 00000100:00100000:3.0:1746065122.386724:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261002496 00000100:00100000:3.0:1746065122.386770:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10661 00000100:00100000:3.0:1746065122.386779:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261002496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.386795:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.386810:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a398800/0x14b4f8542d4f2eae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aea4 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.386866:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a398800/0x14b4f8542d4f2eae lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aea4 expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.386875:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a398800/0x14b4f8542d4f2eae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aea4 expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.386889:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a398800, rc 0) 00000100:00100000:3.0:1746065122.388183:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261002496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1400us (1534us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.388191:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10661 00000100:00100000:0.0:1746065122.398994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.399033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.399065:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261003008 00000100:00100000:0.0:1746065122.399071:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261003008 00002000:00100000:0.0:1746065122.399104:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012f3d3800 x1830881261003008/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065122.399113:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3800 with x1830881261003008 ext(4194304->5029887) 00002000:00010000:0.0:1746065122.399119:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d3800 00000100:00100000:0.0:1746065122.399134:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4884 00000100:00100000:0.0:1746065122.399140:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261003008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065122.400058:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261002880 00000100:00100000:3.0:1746065122.400062:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261002880 00000100:00100000:3.0:1746065122.400088:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9006 00000100:00100000:3.0:1746065122.400093:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:28953:x1830881261002880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.400105:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.400118:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398000/0x14b4f8542d4f2eb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aeab expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.400195:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400205:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400214:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400224:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400228:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400232:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400310:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398a00/0x14b4f8542d4f2eca lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400318:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398a00/0x14b4f8542d4f2eca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400323:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398a00/0x14b4f8542d4f2eca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065122.400329:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065122.400402:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400407:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400415:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400420:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a398400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.400423:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400428:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400437:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065122.400439:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.400442:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400446:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398400/0x14b4f8542d4f2ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400458:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400462:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400466:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400470:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a399600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.400471:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400475:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400483:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134c2ce00) 00010000:00010000:3.0:1746065122.400485:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.400487:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400491:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a399600/0x14b4f8542d4f2ec3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.400523:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398000/0x14b4f8542d4f2eb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeab expref: 265 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.400532:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398a00/0x14b4f8542d4f2eca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeab expref: 264 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.400538:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.400540:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065122.400541:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a398a00, rc 0) 00000100:00100000:3.0:1746065122.400577:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:28953:x1830881261002880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 484us (1591us total) trans 8589943058 rc 0/0 00000100:00100000:3.0:1746065122.400583:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9006 00000100:00100000:0.0:1746065122.413854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.415575:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261003136 00000100:00100000:2.0:1746065122.415585:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261003136 00000100:00100000:2.0:1746065122.415640:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 626 00000100:00100000:2.0:1746065122.415647:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1960:x1830881261003136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.415659:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.415678:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a398a00/0x14b4f8542d4f2eca lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeab expref: 264 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.415706:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.415709:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.415743:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:1960:x1830881261003136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.415748:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 626 00000100:00100000:2.0:1746065122.415789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.415806:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261003264 00000100:00100000:2.0:1746065122.415808:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261003264 00000100:00100000:2.0:1746065122.415838:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10662 00000100:00100000:2.0:1746065122.415843:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261003264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.415855:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.415866:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c871a00/0x14b4f8542d4f2ed8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aeb2 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.415902:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259713280:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065122.416088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.416107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.416119:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261003392 00000100:00100000:3.0:1746065122.416121:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261003392 00000100:00100000:1.0:1746065122.416124:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261003520 00000100:00100000:1.0:1746065122.416129:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261003520 00000100:00100000:3.0:1746065122.416137:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10663 00000100:00100000:3.0:1746065122.416142:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261003392:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.416148:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065122.416150:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10664 00010000:00010000:3.0:1746065122.416155:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a399200/0x14b4f8542d4f2edf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aeb9 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.416156:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261003520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.416163:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.416170:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f2ee6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aec0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.416175:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259713408:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065122.416185:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f2ee6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aec0 expref: 31 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.416194:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f2ee6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aec0 expref: 31 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.416204:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15d000, rc 0) 00000100:00100000:3.0:1746065122.416215:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.416221:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261003520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 66us (113us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065122.416226:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10664 00000100:00100000:2.0:1746065122.416868:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.418676:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261003008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19344us (19450us total) trans 0 rc 835584/835584 00000100:00100000:1.0:1746065122.418686:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4884 00002000:00100000:1.0:1746065122.418695:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012f3d3800 x1830881261003008/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.418704:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3800 with x1830881261003008 ext(4194304->5029887) 00002000:00010000:1.0:1746065122.418709:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d3800 00000100:00100000:0.0:1746065122.425293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.425315:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259713408:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065122.425395:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259713280:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065122.425402:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261003648 00000100:00100000:1.0:1746065122.425407:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261003648 00010000:00010000:2.0:1746065122.425415:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c871a00/0x14b4f8542d4f2ed8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeb2 expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.425428:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c871a00/0x14b4f8542d4f2ed8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeb2 expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.425441:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c871a00, rc 0) 00000100:00100000:1.0:1746065122.425445:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10665 00000100:00100000:1.0:1746065122.425453:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261003648:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065122.425465:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065122.425475:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261003264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9632us (9684us total) trans 0 rc 301/301 00010000:00010000:1.0:1746065122.425476:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15d200/0x14b4f8542d4f2eed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aec7 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.425482:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10662 00010000:00010000:1.0:1746065122.425498:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15d200/0x14b4f8542d4f2eed lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aec7 expref: 22 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.425504:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15d200/0x14b4f8542d4f2eed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aec7 expref: 22 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.425515:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15d200, rc 0) 00000100:00100000:1.0:1746065122.425533:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261003648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 82us (248us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065122.425539:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10665 00010000:00010000:3.0:1746065122.425669:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a399200/0x14b4f8542d4f2edf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeb9 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.425679:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a399200/0x14b4f8542d4f2edf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeb9 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.425690:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a399200, rc 0) 00000100:00100000:3.0:1746065122.425705:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261003392:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9563us (9617us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.425711:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10663 00000100:00100000:0.0:1746065122.427723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.427804:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261003776 00000100:00100000:3.0:1746065122.427809:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261003776 00000100:00100000:3.0:1746065122.427872:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10666 00000100:00100000:3.0:1746065122.427879:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881261003776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.427891:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.427903:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2ef4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aece expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.427926:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2ef4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aece expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.427939:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a398200/0x14b4f8542d4f2ef4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aece expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.427947:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a398200, rc 0) 00000100:00100000:3.0:1746065122.427986:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881261003776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 106us (267us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.427991:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10666 00000100:00100000:0.0:1746065122.432001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.432051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.432118:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261003904 00000100:00100000:2.0:1746065122.432125:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261003904 00000100:00100000:2.0:1746065122.432153:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261004032 00000100:00100000:2.0:1746065122.432155:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261004032 00000100:00100000:2.0:1746065122.432166:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10667 00000100:00100000:2.0:1746065122.432171:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:28953:x1830881261003904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.432185:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.432196:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aed5 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.432219:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.432225:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.432226:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.432229:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.432250:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.432259:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 20 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.432268:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259713536:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.432346:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.432362:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10668 00000100:00100000:2.0:1746065122.432368:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:28950:x1830881261004032:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065122.432373:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.432379:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aedc expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.433127:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.433134:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.433136:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.433138:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1601536->2097151] (req 1601536->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.433152:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.433159:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 20 pid: 25185 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.433167:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259713664:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.434679:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259713536:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.434700:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.434711:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c871600, rc 0) 00000100:00100000:3.0:1746065122.434756:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:28953:x1830881261003904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2583us (2761us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.434763:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10667 00000100:00100000:2.0:1746065122.435068:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.435506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.436187:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261004160 00000100:00100000:2.0:1746065122.436194:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261004160 00002000:00100000:2.0:1746065122.436224:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (2011136->2097151) req@ffff88009c7aed80 x1830881261004160/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.436233:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7aed80 with x1830881261004160 ext(2011136->2097151) 00010000:00010000:2.0:1746065122.436240:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 21 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.436252:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 21 pid: 8428 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065122.436259:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7aed80 00000100:00100000:2.0:1746065122.436285:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1503 00000100:00100000:2.0:1746065122.436291:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261004160:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065122.437704:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259713664:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.437725:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1601536->2097151] (req 1601536->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.437738:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c870e00, rc 0) 00000100:00100000:0.0:1746065122.438031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.438234:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:28950:x1830881261004032:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5864us (6180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.438241:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10668 00000100:00100000:3.0:1746065122.438494:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261004288 00000100:00100000:3.0:1746065122.438500:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261004288 00002000:00100000:3.0:1746065122.438525:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1486847) req@ffff880095356680 x1830881261004288/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.438533:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356680 with x1830881261004288 ext(1048576->1486847) 00010000:00010000:3.0:1746065122.438540:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 23 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.438551:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 23 pid: 25185 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746065122.438558:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095356680 00000100:00100000:3.0:1746065122.438572:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1504 00000100:00100000:3.0:1746065122.438578:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261004288:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065122.440270:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261004160:12345-192.168.202.46@tcp:4:cat.0 Request processed in 3974us (4761us total) trans 21474840018 rc 0/0 00000100:00100000:3.0:1746065122.440278:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1503 00002000:00100000:3.0:1746065122.440286:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (2011136->2097151) req@ffff88009c7aed80 x1830881261004160/t21474840018(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/448 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.440293:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7aed80 with x1830881261004160 ext(2011136->2097151) 00010000:00010000:3.0:1746065122.440301:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.440311:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746065122.440316:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7aed80 00000100:00100000:0.0:1746065122.444333:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.444395:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261004416 00000100:00100000:3.0:1746065122.444403:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261004416 00010000:00010000:3.0:1746065122.444432:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.444739:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5304 00000100:00100000:3.0:1746065122.444748:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261004416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.444762:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.444780:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.444789:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.444808:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136675c00/0x14b4f8542d4f2db9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae03 expref: 25 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.444838:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.444840:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.444847:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.444854:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.444883:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.444893:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259713792:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065122.445693:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.448065:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259713792:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.448083:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.448128:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261004416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3380us (5143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.448137:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5304 00000100:00100000:3.0:1746065122.449097:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261004288:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10517us (11064us total) trans 21474840019 rc 0/0 00000100:00100000:3.0:1746065122.449106:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1504 00002000:00100000:3.0:1746065122.449116:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1486847) req@ffff880095356680 x1830881261004288/t21474840019(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/448 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.449124:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356680 with x1830881261004288 ext(1048576->1486847) 00010000:00010000:3.0:1746065122.449132:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 24 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.449145:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 24 pid: 25185 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746065122.449369:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095356680 00000100:00100000:2.0:1746065122.452599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.452911:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261004672 00000100:00100000:3.0:1746065122.452918:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261004672 00002000:00100000:3.0:1746065122.452953:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd04380 x1830881261004672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.452962:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04380 with x1830881261004672 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.452966:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd04380 00000100:00100000:3.0:1746065122.452993:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4885 00000100:00100000:3.0:1746065122.452999:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261004672:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065122.458859:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.466080:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261004800 00000100:00100000:2.0:1746065122.466092:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261004800 00010000:00010000:2.0:1746065122.466130:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 24 pid: 25185 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.466171:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5305 00000100:00100000:2.0:1746065122.466179:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261004800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.466191:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.466210:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 24 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.466222:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 24 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.466242:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cf69a00/0x14b4f8542d4f2dce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae18 expref: 24 pid: 25185 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.466271:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.466273:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.466279:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.466288:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.466322:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.466332:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259713920:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065122.466422:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.472959:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.473022:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259713920:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065122.473024:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261005056 00000100:00100000:1.0:1746065122.473030:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261005056 00010000:00010000:2.0:1746065122.473039:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065122.473060:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1601536->1605631) req@ffff880095356d80 x1830881261005056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.473069:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356d80 with x1830881261005056 ext(1601536->1605631) 00000100:00100000:2.0:1746065122.473071:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261004800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6893us (14218us total) trans 0 rc 0/0 00002000:00010000:1.0:1746065122.473073:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095356d80 00000100:00100000:2.0:1746065122.473080:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5305 00000100:00100000:1.0:1746065122.473090:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4886 00000100:00100000:1.0:1746065122.473095:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261005056:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065122.473210:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261005056:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 114us (257us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065122.473215:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4886 00002000:00100000:1.0:1746065122.473220:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1601536->1605631) req@ffff880095356d80 x1830881261005056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.473226:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356d80 with x1830881261005056 ext(1601536->1605631) 00002000:00010000:1.0:1746065122.473229:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095356d80 00000100:00100000:3.0:1746065122.473360:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261004672:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 20359us (20765us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.473366:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4885 00002000:00100000:3.0:1746065122.473372:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd04380 x1830881261004672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.473377:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04380 with x1830881261004672 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.473380:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd04380 00000100:00100000:0.0:1746065122.479350:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.480798:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261005312 00000100:00100000:3.0:1746065122.480810:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261005312 00002000:00100000:3.0:1746065122.480872:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1601535) req@ffff880095357b80 x1830881261005312/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.480881:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095357b80 with x1830881261005312 ext(1048576->1601535) 00002000:00010000:3.0:1746065122.480886:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095357b80 00000100:00100000:1.0:1746065122.482744:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4887 00000100:00100000:1.0:1746065122.482761:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261005312:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065122.483070:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.483096:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261005440 00000100:00100000:2.0:1746065122.483102:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261005440 00000100:00100000:2.0:1746065122.483138:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10669 00000100:00100000:2.0:1746065122.483143:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28950:x1830881261005440:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065122.483153:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.483167:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aee3 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.483187:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 20 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.483195:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add9 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.483200:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.483202:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.483204:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1310719] (req 1048576->1310719) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.483228:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add9 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.483238:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add9 expref: 33 pid: 8428 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746065122.483248:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259714048:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.483310:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 20 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.483319:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 20 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.483326:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259714176:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.483358:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.487512:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259714048:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.487524:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259714176:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.487545:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1310719] (req 1048576->1310719) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.487548:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261005312:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 4792us (8216us total) trans 0 rc 552960/552960 00000100:00100000:1.0:1746065122.487558:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4887 00002000:00100000:1.0:1746065122.487568:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1601535) req@ffff880095357b80 x1830881261005312/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 552960/552960 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.487576:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095357b80 with x1830881261005312 ext(1048576->1601535) 00002000:00010000:1.0:1746065122.487581:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095357b80 00010000:00010000:2.0:1746065122.487790:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c870400, rc 0) 00000100:00100000:2.0:1746065122.487841:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28950:x1830881261005440:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4697us (4772us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.487847:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10669 00000100:00100000:0.0:1746065122.487876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.488054:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261005568 00000100:00100000:2.0:1746065122.488060:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261005568 00010000:00010000:2.0:1746065122.488079:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add9 expref: 33 pid: 8428 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746065122.488099:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5306 00000100:00100000:2.0:1746065122.488105:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261005568:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.488115:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.488137:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add9 expref: 33 pid: 8428 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.488147:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add9 expref: 33 pid: 8428 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.488166:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f015a00/0x14b4f8542d4f2d73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5add9 expref: 33 pid: 8428 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.489479:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.489522:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261005568:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1413us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.489529:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5306 00000100:00100000:0.0:1746065122.492574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.492668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.492730:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261005696 00000100:00100000:3.0:1746065122.492739:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261005696 00010000:00010000:3.0:1746065122.492770:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.492796:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5307 00000100:00100000:3.0:1746065122.492803:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261005696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.492835:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.492854:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.492865:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.492883:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f3b4e00/0x14b4f8542d4f2cbd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad77 expref: 21 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.492899:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.492900:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.492906:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.492917:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.492943:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.492953:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259714304:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065122.493024:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065122.493049:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261005824 00000100:00100000:3.0:1746065122.493052:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261005824 00000100:00100000:3.0:1746065122.493076:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10670 00000100:00100000:3.0:1746065122.493081:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28953:x1830881261005824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.493092:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.493101:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aeea expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.493116:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.493121:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065122.493122:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065122.493125:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.493141:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.493154:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.493161:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259714432:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.493178:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.497865:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259714304:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.497885:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.497936:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261005696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5132us (5368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.497945:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5307 00000100:00100000:3.0:1746065122.498031:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259714432:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.498049:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.498064:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf00e00, rc 0) 00000100:00100000:3.0:1746065122.498084:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28953:x1830881261005824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5003us (5416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.498089:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10670 00000100:00100000:0.0:1746065122.500606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.500780:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261006080 00000100:00100000:1.0:1746065122.500788:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261006080 00002000:00100000:1.0:1746065122.500845:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1306624->1310719) req@ffff880095355500 x1830881261006080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.500854:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355500 with x1830881261006080 ext(1306624->1310719) 00010000:00010000:1.0:1746065122.500862:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.500873:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746065122.500879:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095355500 00000100:00100000:1.0:1746065122.501630:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1505 00000100:00100000:1.0:1746065122.501639:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261006080:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065122.501770:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261006080:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 132us (1170us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065122.501775:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1505 00002000:00100000:1.0:1746065122.501779:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1306624->1310719) req@ffff880095355500 x1830881261006080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065122.501786:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355500 with x1830881261006080 ext(1306624->1310719) 00010000:00010000:1.0:1746065122.501790:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.501798:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746065122.501803:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095355500 00000100:00100000:0.0:1746065122.504776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.505273:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261006464 00000100:00100000:2.0:1746065122.505281:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261006464 00000100:00100000:2.0:1746065122.505318:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3672 00000100:00100000:2.0:1746065122.505325:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:28950:x1830881261006464:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065122.505752:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.506008:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:28950:x1830881261006464:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 681us (1237us total) trans 8589943059 rc 0/0 00000100:00100000:2.0:1746065122.506014:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3672 00000100:00100000:3.0:1746065122.506184:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261006592 00000100:00100000:3.0:1746065122.506188:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261006592 00002000:00100000:3.0:1746065122.506211:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1310719) req@ffff880095354380 x1830881261006592/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.506219:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354380 with x1830881261006592 ext(1048576->1310719) 00010000:00010000:3.0:1746065122.506227:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.506243:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 33 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746065122.506253:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095354380 00000100:00100000:3.0:1746065122.506269:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1506 00000100:00100000:3.0:1746065122.506274:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881261006592:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065122.512717:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261006592:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 6432us (6955us total) trans 17179872787 rc 0/0 00000100:00100000:2.0:1746065122.512731:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1506 00002000:00100000:2.0:1746065122.512742:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1310719) req@ffff880095354380 x1830881261006592/t17179872787(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/448 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.512751:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354380 with x1830881261006592 ext(1048576->1310719) 00010000:00010000:2.0:1746065122.512759:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 35 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.512772:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 35 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065122.512778:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095354380 00000100:00100000:0.0:1746065122.518247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.518576:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261006720 00000100:00100000:2.0:1746065122.518583:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261006720 00010000:00010000:2.0:1746065122.518611:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 35 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.518648:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5308 00000100:00100000:2.0:1746065122.518654:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261006720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.518665:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065122.518679:0:7080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065122 -> 1746065123 00002000:00010000:2.0:1746065122.518681:0:7080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065122 -> 1746065123 00010000:00010000:2.0:1746065122.518686:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 35 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.518697:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 35 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.518715:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c870400/0x14b4f8542d4f2f09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aee3 expref: 35 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.518741:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.518743:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.518748:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 34 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.518755:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 34 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.518781:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 34 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.518791:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259714560:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065122.518890:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.521996:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259714560:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.522012:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.522052:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261006720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3397us (3811us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.522061:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5308 00000100:00100000:0.0:1746065122.525792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.527359:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261006976 00000100:00100000:2.0:1746065122.527368:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261006976 00002000:00100000:2.0:1746065122.527405:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880095355180 x1830881261006976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.527421:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355180 with x1830881261006976 ext(1048576->2097151) 00002000:00010000:2.0:1746065122.527426:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095355180 00000100:00100000:2.0:1746065122.527452:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4888 00000100:00100000:2.0:1746065122.527459:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881261006976:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065122.541218:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881261006976:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13750us (15424us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.541229:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4888 00002000:00100000:3.0:1746065122.541240:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880095355180 x1830881261006976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.541248:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355180 with x1830881261006976 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.541253:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095355180 00000100:00100000:0.0:1746065122.550934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.551550:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261007104 00000100:00100000:3.0:1746065122.551558:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261007104 00000100:00100000:3.0:1746065122.551672:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10671 00000100:00100000:3.0:1746065122.551680:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:28953:x1830881261007104:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.551696:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.551711:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aef1 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.551735:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.551742:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065122.551743:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065122.551746:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.551771:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.551782:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 22 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.551792:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259714688:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.552115:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065122.554810:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259714688:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.554866:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.554882:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf01200, rc 0) 00000100:00100000:3.0:1746065122.554920:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:28953:x1830881261007104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3241us (4056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.554928:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10671 00000100:00100000:3.0:1746065122.555078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.555169:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261007232 00000100:00100000:2.0:1746065122.555174:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261007232 00002000:00100000:2.0:1746065122.555208:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2134016->2469887) req@ffff88009baa0380 x1830881261007232/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.555216:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0380 with x1830881261007232 ext(2134016->2469887) 00010000:00010000:2.0:1746065122.555223:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 23 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.555234:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 23 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065122.555240:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa0380 00000100:00100000:2.0:1746065122.555265:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1507 00000100:00100000:2.0:1746065122.555271:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261007232:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065122.560211:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261007232:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4931us (5125us total) trans 21474840020 rc 0/0 00000100:00100000:2.0:1746065122.560222:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1507 00002000:00100000:2.0:1746065122.560234:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2134016->2469887) req@ffff88009baa0380 x1830881261007232/t21474840020(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/448 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.560249:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0380 with x1830881261007232 ext(2134016->2469887) 00010000:00010000:2.0:1746065122.560257:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 25 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.560269:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 25 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746065122.560276:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa0380 00000100:00100000:0.0:1746065122.562490:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.562573:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261007360 00000100:00100000:2.0:1746065122.562580:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261007360 00010000:00010000:2.0:1746065122.562607:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 25 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.562642:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5309 00000100:00100000:2.0:1746065122.562648:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261007360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.562659:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.562676:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 25 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.562686:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 25 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.562705:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c871200/0x14b4f8542d4f2ea7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2134016->3145727] (req 2134016->2469887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae9d expref: 25 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.562733:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.562735:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.562741:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.562748:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.562786:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.562795:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259714816:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065122.562883:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.566788:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259714816:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.566806:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.567492:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261007360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4840us (5005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.567502:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5309 00000100:00100000:0.0:1746065122.567682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.567731:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261007744 00000100:00100000:3.0:1746065122.567737:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261007744 00000100:00100000:0.0:1746065122.567747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065122.567773:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880094244a80 x1830881261007744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.567781:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244a80 with x1830881261007744 ext(3145728->4194303) 00002000:00010000:3.0:1746065122.567785:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094244a80 00000100:00100000:3.0:1746065122.568876:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261007616 00000100:00100000:3.0:1746065122.568882:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261007616 00002000:00100000:3.0:1746065122.568905:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880094245880 x1830881261007616/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.568912:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094245880 with x1830881261007616 ext(2097152->3145727) 00002000:00010000:3.0:1746065122.568915:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094245880 00000100:00100000:3.0:1746065122.568928:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4889 00000100:00100000:3.0:1746065122.568935:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261007744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065122.568939:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4890 00000100:00100000:0.0:1746065122.568947:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261007616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065122.581025:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261007616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12067us (13265us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065122.581035:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4890 00002000:00100000:2.0:1746065122.581045:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880094245880 x1830881261007616/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.581053:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094245880 with x1830881261007616 ext(2097152->3145727) 00002000:00010000:2.0:1746065122.581058:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094245880 00000100:00100000:3.0:1746065122.587979:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261007744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19034us (20287us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.587989:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4889 00002000:00100000:3.0:1746065122.588000:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880094244a80 x1830881261007744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.588008:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244a80 with x1830881261007744 ext(3145728->4194303) 00002000:00010000:3.0:1746065122.588012:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094244a80 00000100:00100000:0.0:1746065122.597566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.597664:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261008128 00000100:00100000:2.0:1746065122.597673:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261008128 00000100:00100000:2.0:1746065122.597724:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3673 00000100:00100000:2.0:1746065122.597731:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:28953:x1830881261008128:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065122.597954:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:28953:x1830881261008128:12345-192.168.202.46@tcp:35:cat.0 Request processed in 222us (394us total) trans 8589943060 rc 0/0 00000100:00100000:2.0:1746065122.597960:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3673 00000100:00100000:0.0:1746065122.605890:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.606056:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261008256 00000100:00100000:2.0:1746065122.606065:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261008256 00000100:00100000:2.0:1746065122.606171:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9007 00000100:00100000:2.0:1746065122.606179:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28960:x1830881261008256:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065122.606199:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.606213:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6200/0x14b4f8542d4f2f1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aef8 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.606265:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.606276:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.606284:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.606294:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.606299:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.606303:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.606405:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.606414:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad70 expref: 22 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.606420:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.606445:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad70 expref: 22 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.606455:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad70 expref: 22 pid: 16767 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.606464:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259714944:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.606609:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.607689:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259714944:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.607703:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065122.609020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.609097:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261008512 00000100:00100000:2.0:1746065122.609103:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261008512 00000100:00100000:2.0:1746065122.609135:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3674 00000100:00100000:2.0:1746065122.609142:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:27247:x1830881261008512:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065122.609347:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:27247:x1830881261008512:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 205us (330us total) trans 8589943061 rc 0/0 00000100:00100000:2.0:1746065122.609357:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3674 00000100:00100000:0.0:1746065122.610736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.610838:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261008640 00000100:00100000:2.0:1746065122.610843:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261008640 00010000:00010000:2.0:1746065122.610866:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad70 expref: 24 pid: 16767 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.610886:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5310 00000100:00100000:2.0:1746065122.610892:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261008640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.610901:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.610906:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad70 expref: 24 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.610916:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad70 expref: 24 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.610934:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f36fa00/0x14b4f8542d4f2caf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad70 expref: 24 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.610946:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.610950:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.610958:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.610965:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.610996:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065122.611121:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611128:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065122.611159:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065122.611162:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065122.611173:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611182:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611190:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611196:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611202:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611207:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982b6400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.611211:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611217:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611224:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065122.611226:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.611229:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611234:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6400/0x14b4f8542d4f2f25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611247:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611252:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611256:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611261:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982b6600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065122.611263:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611271:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611277:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205a00) 00010000:00010000:3.0:1746065122.611278:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065122.611280:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611285:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6600/0x14b4f8542d4f2f2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.611310:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6200/0x14b4f8542d4f2f1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef8 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.611320:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef8 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.611326:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.611328:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065122.611330:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982b6800, rc 0) 00000100:00100000:2.0:1746065122.611479:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261008640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 585us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.611487:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5310 00000100:00100000:3.0:1746065122.612186:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28960:x1830881261008256:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6006us (6301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.612194:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9007 00000100:00100000:0.0:1746065122.615685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.615730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.616129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.616718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.617175:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261008768 00000100:00100000:3.0:1746065122.617183:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261008768 00000100:00100000:3.0:1746065122.617221:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261008896 00000100:00100000:3.0:1746065122.617224:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261008896 00000100:00100000:3.0:1746065122.617239:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261009024 00000100:00100000:3.0:1746065122.617241:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261009024 00000100:00100000:3.0:1746065122.617255:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10672 00000100:00100000:3.0:1746065122.617262:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261008768:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065122.617277:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.617290:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aeff expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.617309:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.617310:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.617317:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeff expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.617329:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeff expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.617350:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf01c00, rc 0) 00000100:00100000:3.0:1746065122.617387:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261008768:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 125us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.617393:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10672 00000100:00100000:3.0:1746065122.617407:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10673 00000100:00100000:3.0:1746065122.617412:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261008896:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065122.617418:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.617423:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf01400/0x14b4f8542d4f2f41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af06 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.617457:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259715072:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065122.617492:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065122.617509:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10674 00000100:00100000:3.0:1746065122.617515:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261009024:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065122.617521:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.617529:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af0d expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.617540:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.617541:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.617545:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af0d expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.617554:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af0d expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.617560:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf01000, rc 0) 00000100:00100000:3.0:1746065122.617574:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261009024:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 59us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.617578:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10674 00000100:00100000:0.0:1746065122.617945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.619117:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261009152 00000100:00100000:1.0:1746065122.619124:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261009152 00000100:00100000:2.0:1746065122.619133:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261009280 00000100:00100000:2.0:1746065122.619136:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261009280 00000100:00100000:1.0:1746065122.619164:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10675 00000100:00100000:2.0:1746065122.619652:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10676 00000100:00100000:2.0:1746065122.619658:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1960:x1830881261009280:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065122.619671:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.619682:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af1b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.619698:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.619700:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.619706:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af1b expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.619717:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af1b expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.619725:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982b6c00, rc 0) 00000100:00100000:2.0:1746065122.619759:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1960:x1830881261009280:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 100us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.619764:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10676 00000100:00100000:3.0:1746065122.620107:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259715072:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065122.620128:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf01400/0x14b4f8542d4f2f41 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af06 expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.620136:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf01400/0x14b4f8542d4f2f41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af06 expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.620143:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf01400, rc 0) 00000100:00100000:3.0:1746065122.620160:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261008896:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2748us (4431us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065122.620168:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10673 00000100:00100000:1.0:1746065122.621128:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261009152:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065122.621144:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.621156:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af14 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.621174:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.621176:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.622375:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af14 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.622392:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af14 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.622401:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d38a00, rc 0) 00000100:00100000:1.0:1746065122.623044:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261009152:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3871us (6323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.623052:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10675 00000100:00100000:0.0:1746065122.625685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.625791:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261009536 00000100:00100000:3.0:1746065122.625800:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261009536 00000100:00100000:3.0:1746065122.625878:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9008 00000100:00100000:3.0:1746065122.625886:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28960:x1830881261009536:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065122.625902:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.626073:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf01600/0x14b4f8542d4f2f5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af22 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.626153:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.626165:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef8 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.626171:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.626195:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef8 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.626205:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef8 expref: 10 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.626215:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259715200:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.626343:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.628032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.628050:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259715200:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.628069:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065122.628230:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261009664 00000100:00100000:2.0:1746065122.628235:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261009664 00010000:00010000:2.0:1746065122.628259:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef8 expref: 11 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.628293:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5311 00000100:00100000:2.0:1746065122.628300:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261009664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.628309:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.628314:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef8 expref: 11 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.628323:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef8 expref: 11 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.628350:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982b6800/0x14b4f8542d4f2f33 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef8 expref: 11 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.628748:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.628753:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.628761:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.628767:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.628794:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.628870:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261009664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 570us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.628876:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5311 00010000:00010000:3.0:1746065122.628980:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.628986:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065122.629002:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065122.629300:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf01600/0x14b4f8542d4f2f5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af22 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.629316:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af22 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.629322:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.629324:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065122.629326:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf00c00, rc 0) 00000100:00100000:3.0:1746065122.629361:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28960:x1830881261009536:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3475us (3683us total) trans 8589943062 rc 0/0 00000100:00100000:3.0:1746065122.629367:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9008 00000100:00100000:0.0:1746065122.631252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.631404:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261009792 00000100:00100000:3.0:1746065122.631410:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261009792 00000100:00100000:3.0:1746065122.631573:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9009 00000100:00100000:3.0:1746065122.631581:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28960:x1830881261009792:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065122.631597:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.631610:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00400/0x14b4f8542d4f2f72 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af29 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.631677:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.631688:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af22 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.631694:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.631715:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af22 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.631725:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af22 expref: 11 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.631735:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259715328:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.631991:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.634552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.634654:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259715328:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.634669:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261009920 00010000:00010000:3.0:1746065122.634674:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065122.634675:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261009920 00010000:00010000:2.0:1746065122.634700:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af22 expref: 12 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.634874:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5312 00000100:00100000:2.0:1746065122.634882:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881261009920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.634893:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.634898:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af22 expref: 12 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.634908:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af22 expref: 12 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.634930:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f2f64 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af22 expref: 12 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.634942:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.635376:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.635385:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.635391:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.635501:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065122.635523:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.635529:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065122.635561:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000100:00100000:2.0:1746065122.635561:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881261009920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 679us (1012us total) trans 0 rc 0/0 00000004:00200000:3.0:1746065122.635564:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1746065122.635567:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5312 00000004:00010000:3.0:1746065122.635578:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.635600:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00400/0x14b4f8542d4f2f72 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af29 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.635628:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af29 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.635633:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.635635:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065122.635637:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf00800, rc 0) 00000100:00100000:3.0:1746065122.635661:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28960:x1830881261009792:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4081us (4418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.635666:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9009 00000100:00100000:0.0:1746065122.639635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.639702:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261010048 00000100:00100000:1.0:1746065122.639710:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261010048 00000100:00100000:1.0:1746065122.639765:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10677 00000100:00100000:1.0:1746065122.639773:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881261010048:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065122.639788:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.640227:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d39000/0x14b4f8542d4f2f80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af30 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.640279:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259715456:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065122.640362:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.642784:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259715456:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065122.642812:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d39000/0x14b4f8542d4f2f80 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af30 expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.642856:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d39000/0x14b4f8542d4f2f80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af30 expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.642973:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d39000, rc 0) 00000100:00100000:0.0:1746065122.643305:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881261010048:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3530us (3673us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065122.643313:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10677 00000100:00100000:0.0:1746065122.647235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.648042:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261010304 00000100:00100000:3.0:1746065122.648051:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261010304 00000100:00100000:3.0:1746065122.648087:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9010 00000100:00100000:3.0:1746065122.648094:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28960:x1830881261010304:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065122.648110:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.648123:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00a00/0x14b4f8542d4f2f87 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af37 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.648186:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00600/0x14b4f8542d4f2f8e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.648197:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00600/0x14b4f8542d4f2f8e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065122.648205:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00600/0x14b4f8542d4f2f8e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065122.648213:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065122.648297:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00a00/0x14b4f8542d4f2f87 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af37 expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.648327:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00600/0x14b4f8542d4f2f8e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af37 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.648342:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.648345:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065122.648347:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf00600, rc 0) 00000100:00100000:3.0:1746065122.648386:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28960:x1830881261010304:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 293us (1159us total) trans 8589943063 rc 0/0 00000100:00100000:3.0:1746065122.648392:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9010 00000100:00100000:0.0:1746065122.650424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.650456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.650539:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261010432 00000100:00100000:0.0:1746065122.650541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.650545:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261010432 00000100:00100000:0.0:1746065122.650673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.650887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.650914:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261010688 00000100:00100000:2.0:1746065122.650914:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261010944 00000100:00100000:3.0:1746065122.650918:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261010688 00000100:00100000:2.0:1746065122.650918:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261010944 00000100:00100000:2.0:1746065122.650933:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261010560 00000100:00100000:2.0:1746065122.650935:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261010560 00000100:00100000:3.0:1746065122.650940:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10678 00000100:00100000:3.0:1746065122.650946:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261010432:12345-192.168.202.46@tcp:1:lfs.0 00000100:00100000:2.0:1746065122.650957:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10679 00000100:00100000:2.0:1746065122.650962:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261010944:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065122.650980:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.650980:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.650993:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.650993:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.651000:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.651001:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc8 expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.651006:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af14 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.651008:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac12 expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.651011:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae5e expref: 19 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.651014:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.651016:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.651017:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae0a expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.651018:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.651022:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065122.651024:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065122.651026:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 8/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.651042:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac12 expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.651045:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae0a expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.651053:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac12 expref: 19 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.651053:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae0a expref: 33 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.651063:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259715584:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.651063:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259715712:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.651110:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10680 00000100:00100000:2.0:1746065122.651116:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1961:x1830881261010688:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065122.651121:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc8 expref: 12 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.651129:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc8 expref: 12 pid: 21235 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.651133:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.651137:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259715840:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.651141:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.651146:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.651147:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065122.651149:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.651159:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.651163:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.651166:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 33 pid: 8851 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.651170:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 28 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.651173:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259715968:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.651183:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259716096:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.651188:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.651202:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065122.651205:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10681 00000100:00100000:3.0:1746065122.651211:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1961:x1830881261010560:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065122.651217:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae5e expref: 19 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.651224:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae5e expref: 19 pid: 4544 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065122.651229:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.651230:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259716224:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.651238:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.651244:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeff expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.651249:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.651250:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.651250:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af14 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.651252:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.651262:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af14 expref: 12 pid: 21998 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065122.651265:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeff expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065122.651269:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259716352:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.651273:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeff expref: 15 pid: 4544 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746065122.651280:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259716480:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.651288:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.651295:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 33 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.651301:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259716608:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.651305:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.651313:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 28 pid: 4544 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.651320:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.651325:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259716736:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.651327:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 19 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.651345:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259716864:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.651353:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.651359:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800953c1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.651455:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261010816 00000100:00100000:0.0:1746065122.651458:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261010816 00000100:00100000:0.0:1746065122.651488:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10682 00000100:00100000:0.0:1746065122.651494:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881261010816:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065122.651509:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.651518:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.651523:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af0d expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065122.651528:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065122.651530:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065122.651532:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.651600:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af0d expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065122.651608:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af0d expref: 13 pid: 25185 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746065122.651616:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259716992:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065122.651639:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.651647:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 33 pid: 4544 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.651654:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259717120:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065122.651666:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.651726:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.651969:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261011072 00000100:00100000:1.0:1746065122.651973:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261011072 00000100:00100000:1.0:1746065122.651999:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10683 00000100:00100000:1.0:1746065122.652004:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1961:x1830881261011072:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065122.652018:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.652027:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.652034:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af1b expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.652045:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.652049:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065122.652050:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065122.652052:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.652072:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.652080:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 23 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.652087:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259717248:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.652251:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af1b expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065122.652303:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af1b expref: 16 pid: 9716 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746065122.652310:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259717376:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.652380:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.652388:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 28 pid: 4544 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.652395:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259717504:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.652412:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.653717:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259715712:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.653784:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259715584:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.654108:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259715840:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.654115:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259715968:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.654132:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.654190:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259716096:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.654200:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065122.659044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.659081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.659092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.659112:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012224 00000100:00100000:0.0:1746065122.659117:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012224 00010000:00010000:0.0:1746065122.659144:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af1b expref: 17 pid: 9716 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746065122.659162:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012096 00000100:00100000:0.0:1746065122.659163:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012096 00010000:00010000:0.0:1746065122.659171:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 29 pid: 4544 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.659181:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5313 00000100:00100000:0.0:1746065122.659187:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1958:x1830881261012224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065122.659196:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065122.659213:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af1b expref: 17 pid: 9716 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746065122.659227:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af1b expref: 17 pid: 9716 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746065122.659246:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065122.659322:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1958:x1830881261012224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 134us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.659327:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5313 00000100:00100000:1.0:1746065122.659440:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259716992:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.659448:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259717120:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.659469:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.659495:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259717248:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.659502:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982b6c00/0x14b4f8542d4f2f4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af1b expref: 17 pid: 9716 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746065122.659516:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259717376:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.659522:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259717504:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.659532:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065122.659653:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5314 00000100:00100000:0.0:1746065122.659658:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261012096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065122.659665:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065122.659674:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 29 pid: 4544 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065122.659682:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 29 pid: 4544 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065122.659692:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065122.659706:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261012096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 48us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.659710:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5314 00000100:00100000:0.0:1746065122.659735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.660019:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012864 00000100:00100000:3.0:1746065122.660023:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012864 00010000:00010000:3.0:1746065122.660037:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 29 pid: 4544 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.660050:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5315 00000100:00100000:3.0:1746065122.660055:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881261012864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.660061:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.660068:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 29 pid: 4544 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.660074:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 29 pid: 4544 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.660084:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf01200/0x14b4f8542d4f2f17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aef1 expref: 29 pid: 4544 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.660096:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065122.660111:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881261012864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.660114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.660116:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5315 00000100:00100000:3.0:1746065122.660125:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261011328 00000100:00100000:3.0:1746065122.660127:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261011328 00000100:00100000:0.0:1746065122.660133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065122.660137:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc8 expref: 14 pid: 21235 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746065122.660156:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261011712 00000100:00100000:3.0:1746065122.660158:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261011712 00010000:00010000:3.0:1746065122.660167:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 20 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.660176:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5316 00000100:00100000:3.0:1746065122.660180:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261011328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.660187:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.660198:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc8 expref: 14 pid: 21235 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065122.660205:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc8 expref: 14 pid: 21235 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065122.660216:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cdd000/0x14b4f8542d4f2bac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5acc8 expref: 14 pid: 21235 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746065122.660227:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065122.660241:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261011328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.660246:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5316 00000100:00100000:3.0:1746065122.660256:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5317 00000100:00100000:3.0:1746065122.660260:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261011712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.660265:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.660273:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 20 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.660281:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 20 pid: 21235 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.660290:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065122.660301:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261011712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 41us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.660305:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5317 00000100:00100000:3.0:1746065122.660327:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259716480:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.660349:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c871600/0x14b4f8542d4f2efb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aed5 expref: 27 pid: 4544 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.660357:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259716736:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.660368:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.660387:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261011456 00000100:00100000:3.0:1746065122.660389:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261011456 00002000:00100000:3.0:1746065122.660409:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1601536->2097151) req@ffff88008f49dc00 x1830881261011456/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.660416:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49dc00 with x1830881261011456 ext(1601536->2097151) 00010000:00010000:3.0:1746065122.660422:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 27 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.660429:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 27 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746065122.660435:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f49dc00 00000100:00100000:3.0:1746065122.660452:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1508 00000100:00100000:3.0:1746065122.660456:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881261011456:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065122.660802:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259716224:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065122.660807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.660810:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259716352:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.660833:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259716608:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.660841:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090451800/0x14b4f8542d4f2ccb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad85 expref: 19 pid: 21235 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.660844:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.660859:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259716864:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.660876:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.660888:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261011968 00000100:00100000:2.0:1746065122.660891:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261011968 00000100:00100000:0.0:1746065122.660892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065122.660903:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 34 pid: 8851 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.660905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.660915:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012480 00000100:00100000:0.0:1746065122.660915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.660916:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012480 00010000:00010000:2.0:1746065122.660924:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 24 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.660924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.660932:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012736 00000100:00100000:2.0:1746065122.660933:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012736 00000100:00100000:0.0:1746065122.660933:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065122.660939:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeff expref: 16 pid: 4544 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746065122.660942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.660946:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261011200 00000100:00100000:2.0:1746065122.660948:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261011200 00000100:00100000:0.0:1746065122.660952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065122.660953:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae0a expref: 35 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.660960:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261011584 00000100:00100000:2.0:1746065122.660961:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261011584 00010000:00010000:2.0:1746065122.660967:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac12 expref: 19 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.660973:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261011840 00000100:00100000:2.0:1746065122.660974:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261011840 00000100:00100000:0.0:1746065122.660975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065122.660980:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af0d expref: 13 pid: 25185 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746065122.660987:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012352 00000100:00100000:2.0:1746065122.660989:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012352 00010000:00010000:2.0:1746065122.660994:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 36 pid: 4544 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.661006:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012608 00000100:00100000:2.0:1746065122.661008:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012608 00010000:00010000:2.0:1746065122.661015:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af14 expref: 14 pid: 21998 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746065122.661022:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012992 00000100:00100000:2.0:1746065122.661024:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012992 00010000:00010000:2.0:1746065122.661029:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae5e expref: 20 pid: 4544 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746065122.661036:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261013120 00000100:00100000:2.0:1746065122.661038:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261013120 00010000:00010000:2.0:1746065122.661044:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 37 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.661053:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5318 00000100:00100000:2.0:1746065122.661057:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261011968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.661064:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.661072:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 37 pid: 8851 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.661079:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 37 pid: 8851 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.661091:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f2a32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abd3 expref: 37 pid: 8851 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.661098:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.661107:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5319 00000100:00100000:1.0:1746065122.661113:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261012480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065122.661117:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881261011968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (310us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065122.661119:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065122.661122:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5318 00010000:00010000:1.0:1746065122.661128:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 24 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.661135:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 24 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.661145:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f2ea0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae96 expref: 24 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.661152:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5320 00010000:00010000:1.0:1746065122.661152:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.661154:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065122.661156:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1960:x1830881261012736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.661158:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.661161:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.661165:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.661167:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeff expref: 16 pid: 4544 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.661173:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeff expref: 16 pid: 4544 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065122.661179:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065122.661182:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf01c00/0x14b4f8542d4f2f3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeff expref: 16 pid: 4544 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.661189:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.661190:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.661192:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.661192:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261012480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.661197:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5319 00010000:00010000:2.0:1746065122.661198:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.661206:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5321 00010000:00010000:2.0:1746065122.661209:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.661210:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261011200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.661215:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065122.661220:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1960:x1830881261012736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (327us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065122.661222:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae0a expref: 35 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.661225:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5320 00010000:00010000:1.0:1746065122.661228:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae0a expref: 35 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.661232:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5322 00000100:00100000:2.0:1746065122.661236:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261011584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.661238:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf69c00/0x14b4f8542d4f2dc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae0a expref: 35 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.661240:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.661246:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac12 expref: 20 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.661246:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065122.661252:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac12 expref: 20 pid: 8428 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.661255:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261011200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 45us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.661260:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5321 00010000:00010000:2.0:1746065122.661261:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f2aa9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac12 expref: 20 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.661267:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065122.661267:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5323 00010000:00010000:2.0:1746065122.661268:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.661270:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.661271:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261011840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.661276:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.661276:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.661283:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af0d expref: 14 pid: 25185 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.661287:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065122.661289:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af0d expref: 14 pid: 25185 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746065122.661297:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261011584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (381us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065122.661299:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f2f48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af0d expref: 14 pid: 25185 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746065122.661301:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5322 00010000:00010000:1.0:1746065122.661305:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.661309:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5324 00000100:00100000:2.0:1746065122.661313:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261012352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065122.661315:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261011840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 44us (390us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065122.661319:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065122.661319:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5323 00010000:00010000:2.0:1746065122.661324:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 33 pid: 4544 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.661326:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5325 00000100:00100000:1.0:1746065122.661329:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261012608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.661331:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 33 pid: 4544 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.661348:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.661355:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf00e00/0x14b4f8542d4f2f10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aeea expref: 33 pid: 4544 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.661355:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af14 expref: 12 pid: 21998 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065122.661361:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af14 expref: 12 pid: 21998 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.661362:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.661363:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.661366:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.661369:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d38a00/0x14b4f8542d4f2f56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af14 expref: 12 pid: 21998 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.661371:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.661383:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065122.661384:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.661395:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261012352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.661396:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261012608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.661399:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5324 00000100:00100000:1.0:1746065122.661401:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5325 00000100:00100000:2.0:1746065122.661407:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5326 00000100:00100000:2.0:1746065122.661411:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881261012992:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065122.661414:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5327 00010000:00010000:2.0:1746065122.661417:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065122.661418:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261013120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.661422:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.661423:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae5e expref: 18 pid: 4544 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065122.661426:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 31 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.661431:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae5e expref: 18 pid: 4544 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746065122.662050:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 31 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.662062:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdc9c00/0x14b4f8542d4f2ddc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae26 expref: 31 pid: 8428 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.662070:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065122.662076:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.662081:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261013120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 663us (1106us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065122.662083:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.662086:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5327 00010000:00010000:3.0:1746065122.662100:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.662105:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662107:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.662110:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662118:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662124:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf00200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065122.662125:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662127:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.662130:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662134:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.662135:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.662139:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d39400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065122.662141:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662143:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.662147:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662148:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f2f9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.662153:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.662157:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f2fbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.662177:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261010432:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 11231us (11758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.662180:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881261011072:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 10176us (10455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.662182:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10678 00000100:00100000:1.0:1746065122.662185:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10683 00010000:00010000:2.0:1746065122.662227:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f014000/0x14b4f8542d4f2e30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ae5e expref: 18 pid: 4544 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746065122.662234:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.662236:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.662238:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662244:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662256:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.662271:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261012992:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 859us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.662276:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5326 00010000:00010000:2.0:1746065122.662290:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662295:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662307:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662317:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662322:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662327:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b15d600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065122.662330:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662348:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662356:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662362:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15d600/0x14b4f8542d4f2fb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.662388:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881261010560:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 11178us (11715us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.662393:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10681 00010000:00010000:2.0:1746065122.662407:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662413:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662425:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662431:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662436:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662441:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c871e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065122.662443:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662448:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662456:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.662461:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c871e00/0x14b4f8542d4f2fb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.662483:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261010816:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 10990us (11596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.662489:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10682 00010000:00010000:3.0:1746065122.662534:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662540:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662551:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662557:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662563:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662567:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982b7200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065122.662570:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662575:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662583:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.662589:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982b7200/0x14b4f8542d4f2fa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.662769:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261010944:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 11805us (12226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.662774:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10679 00000100:00100000:3.0:1746065122.669049:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261011456:12345-192.168.202.46@tcp:4:cat.0 Request processed in 8583us (10003us total) trans 21474840021 rc 0/0 00000100:00100000:3.0:1746065122.669060:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1508 00002000:00100000:3.0:1746065122.669071:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1601536->2097151) req@ffff88008f49dc00 x1830881261011456/t21474840021(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/448 e 0 to 0 dl 1746065133 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.669080:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49dc00 with x1830881261011456 ext(1601536->2097151) 00010000:00010000:3.0:1746065122.669094:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.669106:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746065122.669112:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f49dc00 00000100:00100000:2.0:1746065122.674233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.674322:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261013248 00000100:00100000:0.0:1746065122.674330:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261013248 00010000:00010000:0.0:1746065122.674366:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746065122.674389:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5328 00000100:00100000:0.0:1746065122.674395:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881261013248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065122.674406:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065122.674422:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065122.674433:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065122.674451:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c870e00/0x14b4f8542d4f2f02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1601536->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aedc expref: 29 pid: 21998 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746065122.674710:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065122.674712:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065122.674717:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.674724:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.674847:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065122.674883:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881261013248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 487us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.674889:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5328 00010000:00010000:2.0:1746065122.675038:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.675045:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.675062:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.675068:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.675075:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.675081:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982b7800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065122.675084:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.675090:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.675099:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.675104:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982b7800/0x14b4f8542d4f2faa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.675148:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261010688:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 24032us (24691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.675154:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10680 00000100:00100000:2.0:1746065122.677954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.678048:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261013504 00000100:00100000:1.0:1746065122.678056:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261013504 00000100:00100000:1.0:1746065122.678103:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9011 00000100:00100000:1.0:1746065122.678110:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:28960:x1830881261013504:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:1.0:1746065122.678153:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.678174:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00800/0x14b4f8542d4f2f79 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af29 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678196:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.678200:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065122.678221:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.678232:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 22 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678238:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 22 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678243:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678249:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad93 expref: 264 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678254:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adcb expref: 22 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678259:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.678285:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adcb expref: 22 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678295:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adcb expref: 22 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.678306:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259717632:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.678475:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad93 expref: 264 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678482:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad93 expref: 264 pid: 16767 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.678490:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259717760:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.678518:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678525:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 264 pid: 14644 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.678532:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259717888:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.678555:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 22 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678561:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 22 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.678571:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7af100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259718016:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.678595:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 22 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.678602:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 22 pid: 16767 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.678608:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259718144:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.678626:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065122.680864:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259717632:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.680874:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259717760:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.680879:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259717888:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065122.682240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.682263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.682279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.682315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.682321:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261013760 00000100:00100000:3.0:1746065122.682322:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261013632 00000100:00100000:3.0:1746065122.682328:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261013632 00000100:00100000:1.0:1746065122.682328:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261013760 00010000:00010000:1.0:1746065122.682365:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad93 expref: 265 pid: 16767 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.682386:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261013888 00000100:00100000:1.0:1746065122.682389:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261013888 00000100:00100000:2.0:1746065122.682403:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261014144 00000100:00100000:2.0:1746065122.682405:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261014144 00010000:00010000:2.0:1746065122.682466:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 24 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.682466:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 266 pid: 14644 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.682469:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adcb expref: 24 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746065122.682481:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5329 00000100:00100000:1.0:1746065122.682485:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5330 00000100:00100000:2.0:1746065122.682487:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:1960:x1830881261013760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065122.682489:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:1960:x1830881261013888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.682496:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.682496:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.682501:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad93 expref: 266 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.682501:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 266 pid: 14644 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.682509:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 266 pid: 14644 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.682515:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad93 expref: 266 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.682529:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b5600/0x14b4f8542d4f2aa2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ac0b expref: 266 pid: 14644 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.682532:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136674200/0x14b4f8542d4f2cee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ad93 expref: 266 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.682540:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.682544:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.682550:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.682550:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065122.682552:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.682556:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.682577:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1960:x1830881261013760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.682577:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1960:x1830881261013888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.682583:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5330 00000100:00100000:2.0:1746065122.682585:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5329 00000100:00100000:2.0:1746065122.682594:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5331 00000100:00100000:1.0:1746065122.682597:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5332 00000100:00100000:2.0:1746065122.682598:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261014144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065122.682600:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261013632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.682603:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.682604:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.682606:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 24 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.682607:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adcb expref: 24 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.682614:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adcb expref: 24 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.682619:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 24 pid: 16767 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746065122.682627:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f2d5e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5adcb expref: 24 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746065122.682629:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.682631:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.682635:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065122.682636:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.682638:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.682642:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.682652:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261014144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.682652:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261013632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.682656:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5332 00000100:00100000:2.0:1746065122.682658:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5331 00000100:00100000:1.0:1746065122.682682:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7af100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259718016:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.682689:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935ae600/0x14b4f8542d4f2a8d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abf6 expref: 21 pid: 16767 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746065122.682697:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259718144:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.682718:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065122.682924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.682988:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261014016 00000100:00100000:3.0:1746065122.682992:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261014016 00010000:00010000:3.0:1746065122.683004:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 21 pid: 24350 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746065122.683018:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5333 00000100:00100000:3.0:1746065122.683022:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261014016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.683028:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.683030:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 21 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.683037:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 21 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.683051:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090b1d600/0x14b4f8542d4f2a94 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5abfd expref: 21 pid: 24350 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746065122.683061:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.683064:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.683070:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.683076:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.683089:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065122.683091:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.683097:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065122.683104:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261014016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.683108:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5333 00000040:00080000:1.0:1746065122.683812:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2511, 88 off210784 00000004:00080000:1.0:1746065122.684099:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721975282993ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.684206:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2454, 88 off205592 00000004:00080000:1.0:1746065122.684212:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721975396175ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.684283:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2455, 88 off205680 00000004:00080000:1.0:1746065122.684287:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721975471535ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.684293:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2512, 88 off210872 00000004:00080000:1.0:1746065122.684295:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721975480085ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.684302:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2513, 88 off210960 00000004:00080000:1.0:1746065122.684305:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721975489403ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.684312:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2456, 88 off205768 00000004:00080000:1.0:1746065122.684314:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721975498912ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.684320:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2457, 88 off205856 00000004:00080000:1.0:1746065122.684322:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721975507040ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.684327:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2458, 88 off205944 00000004:00080000:1.0:1746065122.684329:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721975514270ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.684347:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2514, 88 off211048 00000004:00080000:1.0:1746065122.684349:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721975533857ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.684357:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2459, 88 off206032 00000004:00080000:1.0:1746065122.684360:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721975544823ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.684366:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2515, 88 off211136 00000004:00080000:1.0:1746065122.684368:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721975552775ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.684375:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2460, 88 off206120 00000004:00080000:1.0:1746065122.684377:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721975561782ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.684383:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2516, 88 off211224 00000004:00080000:1.0:1746065122.684385:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721975569632ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.684391:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2517, 88 off211312 00000004:00080000:1.0:1746065122.684394:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721975578450ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.684401:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2518, 88 off211400 00000004:00080000:1.0:1746065122.684404:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721975588828ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.684411:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2519, 88 off211488 00000004:00080000:1.0:1746065122.684414:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721975598836ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.684422:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2461, 88 off206208 00000004:00080000:1.0:1746065122.684424:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721975608893ns, next at 666938887344ns, rc = 0 00000004:00010000:1.0:1746065122.703890:0:16767:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008fd05880 reply state ffff8800a587b800 transno 8589943064 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065122.703903:0:16767:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065122.703992:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:28960:x1830881261013504:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 25879us (26039us total) trans 8589943064 rc 0/0 00000100:00100000:1.0:1746065122.703999:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9011 00000001:00080000:3.0:1746065122.704479:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943050 is committed 00000001:00080000:3.0:1746065122.704490:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943044 is committed 00000001:00080000:3.0:1746065122.705004:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943064 is committed 00000004:00080000:3.0:1746065122.705009:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1754 committed 00000004:00080000:3.0:1746065122.705510:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1813 committed 00000004:00080000:3.0:1746065122.705517:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1812 committed 00000004:00080000:3.0:1746065122.705519:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1811 committed 00000004:00080000:3.0:1746065122.705521:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1810 committed 00000004:00080000:3.0:1746065122.705522:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1753 committed 00000004:00080000:3.0:1746065122.705523:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1809 committed 00000004:00080000:3.0:1746065122.705524:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1752 committed 00000004:00080000:3.0:1746065122.705525:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1808 committed 00000004:00080000:3.0:1746065122.705527:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1751 committed 00000004:00080000:3.0:1746065122.705528:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1750 committed 00000004:00080000:3.0:1746065122.705529:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1749 committed 00000004:00080000:3.0:1746065122.705530:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1807 committed 00000004:00080000:3.0:1746065122.705532:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1806 committed 00000004:00080000:3.0:1746065122.705533:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1748 committed 00000004:00080000:3.0:1746065122.705534:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1747 committed 00000004:00080000:3.0:1746065122.705535:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1805 committed 00000001:00080000:3.0:1746065122.705559:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943061 is committed 00000001:00080000:3.0:1746065122.705573:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943060 is committed 00010000:00010000:2.0:1746065122.705580:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.705589:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.705594:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.705598:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d39c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065122.705602:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.705608:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.705622:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.705624:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065122.705628:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.705632:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f2fc6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065122.705663:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065122.705673:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259718272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.705721:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.705730:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259718784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.705752:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.705766:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259718400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.705774:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259718528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.705781:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.705795:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259718272 00000100:00100000:2.0:1746065122.705797:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259718912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.705801:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259718272 00000100:00100000:2.0:1746065122.705809:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.705843:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259718784 00000100:00100000:3.0:1746065122.705845:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259718784 00000100:00100000:2.0:1746065122.705852:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259718656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.705855:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259718400 00000100:00100000:3.0:1746065122.705856:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259718400 00000100:00100000:3.0:1746065122.705864:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259718912 00000100:00100000:3.0:1746065122.705865:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259718912 00000100:00100000:2.0:1746065122.705867:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.705876:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259718656 00000100:00100000:3.0:1746065122.705877:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259718656 00000100:00100000:2.0:1746065122.705878:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259719168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.705887:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10684 00000100:00100000:2.0:1746065122.705890:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.705892:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3296:x1830881259718272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.705906:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259719168 00000100:00100000:2.0:1746065122.705909:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259719168 00000100:00100000:2.0:1746065122.705921:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10685 00000100:00100000:2.0:1746065122.705926:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3295:x1830881259718784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.706005:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10686 00000100:00100000:3.0:1746065122.706010:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3296:x1830881259718400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065122.706025:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065122.706028:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.706030:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.706031:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.706033:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065122.706057:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881259718784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (303us total) trans 17179872788 rc 0/0 00000100:00100000:2.0:1746065122.706062:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10685 00000100:00100000:2.0:1746065122.706073:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10687 00000100:00100000:2.0:1746065122.706077:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3296:x1830881259718912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.706093:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3296:x1830881259718400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (310us total) trans 17179872790 rc 0/0 00000100:00100000:3.0:1746065122.706101:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10686 00000100:00100000:3.0:1746065122.706110:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10688 00000100:00100000:3.0:1746065122.706114:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3298:x1830881259718656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065122.706145:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065122.706147:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.706149:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.706150:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.706151:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065122.706169:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3296:x1830881259718912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (358us total) trans 17179872791 rc 0/0 00002000:00010000:3.0:1746065122.706171:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1746065122.706173:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10687 00002000:00010000:3.0:1746065122.706174:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.706175:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.706176:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.706178:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065122.706182:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10689 00000100:00100000:2.0:1746065122.706186:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3298:x1830881259719168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.706197:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3298:x1830881259718656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (329us total) trans 17179872792 rc 0/0 00000100:00100000:3.0:1746065122.706202:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10688 00000100:00100000:3.0:1746065122.706225:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.706236:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259719040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.706250:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.706261:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3298:x1830881259719168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (370us total) trans 17179872793 rc 0/0 00000100:00100000:3.0:1746065122.706265:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259718528 00000100:00100000:2.0:1746065122.706266:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10689 00000100:00100000:3.0:1746065122.706267:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259718528 00000100:00100000:2.0:1746065122.706274:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259719040 00000100:00100000:2.0:1746065122.706276:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259719040 00000100:00100000:3.0:1746065122.706280:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10690 00000100:00100000:3.0:1746065122.706284:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3297:x1830881259718528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.706288:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10691 00000100:00100000:2.0:1746065122.706292:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3297:x1830881259719040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.706392:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3297:x1830881259719040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (140us total) trans 17179872794 rc 0/0 00000100:00100000:2.0:1746065122.706397:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10691 00000004:00080000:2.0:1746065122.706427:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa2680/2, rc 0, transno 17179872788 00000100:00100000:2.0:1746065122.706433:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259718784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065122.706448:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa2300/2, rc 0, transno 17179872792 00000100:00100000:2.0:1746065122.706451:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259718656:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065122.706457:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa0e00/2, rc 0, transno 17179872793 00000100:00100000:2.0:1746065122.706459:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259719168:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065122.706469:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa1880/2, rc 0, transno 17179872790 00000100:00100000:2.0:1746065122.706472:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259718400:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065122.706477:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa1180/2, rc 0, transno 17179872791 00000100:00100000:2.0:1746065122.706479:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259718912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.706518:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3296:x1830881259718272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 626us (797us total) trans 17179872789 rc 0/0 00000100:00100000:2.0:1746065122.706523:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10684 00000100:00100000:2.0:1746065122.706557:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3297:x1830881259718528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 273us (331us total) trans 17179872795 rc 0/0 00000100:00100000:2.0:1746065122.706561:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10690 00000004:00080000:2.0:1746065122.706576:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa1f80/2, rc 0, transno 17179872789 00000100:00100000:2.0:1746065122.706579:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259718272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.706653:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259719296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.706672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.706698:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259719808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.706703:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259719552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.706712:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.706722:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.706724:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065122.706729:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259719424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.706734:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259720064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.706741:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.706748:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259719296 00000100:00100000:3.0:1746065122.706750:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259719296 00000100:00100000:2.0:1746065122.706753:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259719936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.706762:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259719808 00000100:00100000:2.0:1746065122.706763:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.706764:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259719808 00000100:00100000:3.0:1746065122.706771:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259719552 00000100:00100000:3.0:1746065122.706773:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259719552 00000100:00100000:3.0:1746065122.706778:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259719424 00000100:00100000:3.0:1746065122.706780:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259719424 00000100:00100000:2.0:1746065122.706784:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259719936 00000100:00100000:2.0:1746065122.706787:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259719936 00000100:00100000:3.0:1746065122.706788:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10692 00000100:00100000:3.0:1746065122.706793:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881259719296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.706801:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10693 00000100:00100000:2.0:1746065122.706806:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881259719808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.706883:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259719680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.706899:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.706908:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3295:x1830881259719296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (234us total) trans 21474840022 rc 0/0 00000100:00100000:3.0:1746065122.706913:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10692 00000100:00100000:2.0:1746065122.706916:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259720192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.706920:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259719680 00000100:00100000:3.0:1746065122.706922:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259719680 00000100:00100000:2.0:1746065122.706927:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.706929:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259720192 00000100:00100000:3.0:1746065122.706931:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259720192 00000100:00100000:3.0:1746065122.706937:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10694 00000100:00100000:3.0:1746065122.706941:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3297:x1830881259719552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065122.706957:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:2.0:1746065122.706959:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065122.706961:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.706962:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065122.706964:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:2.0:1746065122.706980:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3295:x1830881259719808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (267us total) trans 21474840023 rc 0/0 00000100:00100000:2.0:1746065122.706985:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10693 00000100:00100000:2.0:1746065122.706993:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10695 00000100:00100000:2.0:1746065122.706998:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3295:x1830881259719424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.707006:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3297:x1830881259719552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (283us total) trans 21474840024 rc 0/0 00000100:00100000:0.0:1746065122.707008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.707011:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10694 00000100:00100000:3.0:1746065122.707019:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10696 00000100:00100000:3.0:1746065122.707023:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3295:x1830881259719936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.707057:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3295:x1830881259719424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (315us total) trans 21474840025 rc 0/0 00000100:00100000:2.0:1746065122.707061:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10695 00000100:00100000:2.0:1746065122.707067:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10697 00000100:00100000:2.0:1746065122.707069:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3298:x1830881259719680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065122.707074:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065122.707076:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.707078:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746065122.707078:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10698 00002000:00010000:3.0:1746065122.707080:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.707081:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065122.707084:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3298:x1830881259720192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.707096:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3295:x1830881259719936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (331us total) trans 21474840026 rc 0/0 00000100:00100000:3.0:1746065122.707100:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10696 00000100:00100000:2.0:1746065122.707141:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3298:x1830881259719680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (241us total) trans 21474840027 rc 0/0 00000100:00100000:2.0:1746065122.707147:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10697 00000004:00080000:2.0:1746065122.707165:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45f480/2, rc 0, transno 21474840027 00000100:00100000:2.0:1746065122.707168:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259719680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065122.707168:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3298:x1830881259720192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (238us total) trans 21474840028 rc 0/0 00000100:00100000:1.0:1746065122.707173:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10698 00000004:00080000:2.0:1746065122.707175:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45ed80/2, rc 0, transno 21474840028 00000100:00100000:2.0:1746065122.707177:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259720192:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065122.707186:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45d880/2, rc 0, transno 21474840025 00000100:00100000:2.0:1746065122.707188:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259719424:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065122.707191:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45e680/2, rc 0, transno 21474840026 00000100:00100000:2.0:1746065122.707192:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259719936:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065122.707196:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45f800/2, rc 0, transno 21474840023 00000100:00100000:2.0:1746065122.707197:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259719808:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065122.707199:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45e300/2, rc 0, transno 21474840022 00000100:00100000:2.0:1746065122.707201:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259719296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065122.707229:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261014272 00000100:00100000:1.0:1746065122.707233:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261014272 00000100:00100000:1.0:1746065122.707253:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9012 00000100:00100000:1.0:1746065122.707258:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28960:x1830881261014272:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065122.707268:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.707280:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af3e expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.707314:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af3e expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.707324:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af3e expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.707354:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.707357:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065122.707359:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d39e00, rc 0) 00000100:00100000:1.0:1746065122.707389:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28960:x1830881261014272:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 131us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.707394:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9012 00000100:00100000:3.0:1746065122.707454:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.707455:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259720320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.707471:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065122.707472:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa0a80/2, rc 0, transno 17179872795 00000100:00100000:3.0:1746065122.707476:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259718528:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065122.707483:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa3b80/2, rc 0, transno 17179872794 00000100:00100000:3.0:1746065122.707485:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259719040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.707491:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259720320 00000100:00100000:2.0:1746065122.707493:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259720320 00000004:00080000:3.0:1746065122.707494:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45ea00/2, rc 0, transno 21474840024 00000100:00100000:3.0:1746065122.707496:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259719552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.707507:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10699 00000100:00100000:2.0:1746065122.707511:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3295:x1830881259720320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.707624:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3295:x1830881259720320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (150us total) trans 17179872796 rc 0/0 00000100:00100000:2.0:1746065122.707629:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10699 00000004:00080000:3.0:1746065122.707677:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7ff100/2, rc 0, transno 17179872796 00000100:00100000:3.0:1746065122.707681:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259720320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065122.708476:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259720064 00000100:00100000:0.0:1746065122.708481:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259720064 00000100:00100000:0.0:1746065122.708502:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10700 00000100:00100000:0.0:1746065122.708507:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3297:x1830881259720064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065122.708584:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065122.708586:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065122.708588:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065122.708590:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065122.708591:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065122.708631:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3297:x1830881259720064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (1175us total) trans 21474840029 rc 0/0 00000100:00100000:0.0:1746065122.708637:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10700 00000004:00080000:3.0:1746065122.708698:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45d500/2, rc 0, transno 21474840029 00000100:00100000:3.0:1746065122.708702:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259720064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.710152:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.710205:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261014400 00000100:00100000:2.0:1746065122.710211:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261014400 00000100:00100000:2.0:1746065122.710249:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9013 00000100:00100000:2.0:1746065122.710255:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28960:x1830881261014400:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065122.710265:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.710279:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f2fd4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af45 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.710328:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f2fdb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.710347:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.710357:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065122.710378:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065122.710381:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065122.710392:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.710409:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f2fd4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af45 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.710419:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f2fdb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af45 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.710425:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.710428:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065122.710430:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36400, rc 0) 00000100:00100000:2.0:1746065122.710464:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28960:x1830881261014400:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 210us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.710470:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9013 00000100:00100000:0.0:1746065122.713899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.714555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.714601:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261014528 00000100:00100000:2.0:1746065122.714608:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261014528 00000100:00100000:2.0:1746065122.714682:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261014784 00000100:00100000:2.0:1746065122.714685:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261014784 00000100:00100000:2.0:1746065122.714735:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10701 00000100:00100000:2.0:1746065122.714743:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261014528:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065122.714755:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065122.714786:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10702 00000100:00100000:3.0:1746065122.714793:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261014784:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065122.714799:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.714808:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af5a expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065122.714851:0:4544:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6e3, atime: 0x6812d6e3, ctime: 0x6812d6e3, blocks: 0x821 00010000:00010000:3.0:1746065122.714865:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.714867:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.714900:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af4c expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065122.714914:0:21235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e1, atime: 0x6812d6e1, ctime: 0x6812d6e2, blocks: 0x7f1 00010000:00010000:2.0:1746065122.714925:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.714926:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.714930:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af4c expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.714943:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af4c expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.714951:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd37c00, rc 0) 00000100:00100000:2.0:1746065122.714993:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261014528:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 251us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.714998:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10701 00010000:00010000:3.0:1746065122.715034:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af5a expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.715046:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af5a expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.715058:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f109400, rc 0) 00000100:00100000:3.0:1746065122.715072:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261014784:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 281us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.715077:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10702 00000100:00100000:0.0:1746065122.715469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.715495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.715512:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261015040 00000100:00100000:3.0:1746065122.715515:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261015040 00000100:00100000:0.0:1746065122.715518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.715534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.715537:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261014656 00000100:00100000:3.0:1746065122.715539:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261014656 00000100:00100000:3.0:1746065122.715550:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261014912 00000100:00100000:3.0:1746065122.715552:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261014912 00000100:00100000:3.0:1746065122.715560:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261015168 00000100:00100000:3.0:1746065122.715561:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261015168 00000100:00100000:3.0:1746065122.715670:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10703 00000100:00100000:3.0:1746065122.715678:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261015040:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065122.715685:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.715693:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af68 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065122.715703:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6e3, atime: 0x6812d6e2, ctime: 0x6812d6e2, blocks: 0x1643 00010000:00010000:3.0:1746065122.715710:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.715712:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.715716:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af68 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.715725:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af68 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065122.715736:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f108c00, rc 0) 00000100:00100000:3.0:1746065122.715754:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261015040:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.715857:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10704 00000100:00100000:2.0:1746065122.715864:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261014656:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065122.715870:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.715878:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af53 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065122.715889:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6e3, atime: 0x6812d6e3, ctime: 0x6812d6e3, blocks: 0x81d 00010000:00010000:2.0:1746065122.715896:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.715897:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.715901:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af53 expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.715910:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af53 expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.715916:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36600, rc 0) 00000100:00100000:2.0:1746065122.715930:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1960:x1830881261014656:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 68us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.715935:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10704 00000100:00100000:2.0:1746065122.715945:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10705 00000100:00100000:2.0:1746065122.715949:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261014912:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065122.715954:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.715960:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af61 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065122.715968:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6e3, atime: 0x6812d6e2, ctime: 0x6812d6e3, blocks: 0x821 00010000:00010000:2.0:1746065122.715975:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.715976:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.715979:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af61 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.715986:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af61 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.715992:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36200, rc 0) 00000100:00100000:2.0:1746065122.716005:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261014912:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 56us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.716010:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10705 00000100:00100000:2.0:1746065122.716018:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10706 00000100:00100000:2.0:1746065122.716023:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261015168:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065122.716032:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.716039:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af6f expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065122.716048:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6e3, atime: 0x6812d6e3, ctime: 0x6812d6e3, blocks: 0x102b 00010000:00010000:2.0:1746065122.716055:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.716056:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.716060:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af6f expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.716067:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af6f expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.716121:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36c00, rc 0) 00000100:00100000:2.0:1746065122.716133:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1960:x1830881261015168:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 111us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.716138:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10706 00000100:00100000:3.0:1746065122.716229:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10703 00000100:00100000:0.0:1746065122.727292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.728296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.728318:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261015424 00000100:00100000:3.0:1746065122.728326:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261015424 00000100:00100000:3.0:1746065122.728390:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4891 00000100:00100000:3.0:1746065122.728397:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881261015424:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065122.728423:0:21488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.728434:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.728436:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.728440:0:21488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.728451:0:21488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.729926:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261015680 00000100:00100000:2.0:1746065122.729933:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261015680 00000100:00100000:2.0:1746065122.729964:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4892 00000100:00100000:2.0:1746065122.729970:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1959:x1830881261015680:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065122.729988:0:21482:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.729996:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.729998:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.730000:0:21482:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.730009:0:21482:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065122.734141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.735403:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261015936 00000100:00100000:1.0:1746065122.735412:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261015936 00000100:00100000:1.0:1746065122.735458:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4893 00000100:00100000:1.0:1746065122.735465:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1958:x1830881261015936:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065122.735494:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.735505:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.735506:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.735510:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.735521:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065122.740316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.740365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.740395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.740410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.740422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.740572:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261016320 00000100:00100000:3.0:1746065122.740580:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261016320 00000100:00100000:3.0:1746065122.740622:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261016448 00000100:00100000:3.0:1746065122.740624:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261016448 00000100:00100000:3.0:1746065122.740656:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261016576 00000100:00100000:3.0:1746065122.740658:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261016576 00000100:00100000:3.0:1746065122.740672:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261016832 00000100:00100000:3.0:1746065122.740674:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261016832 00000100:00100000:3.0:1746065122.740685:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261017216 00000100:00100000:3.0:1746065122.740687:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261017216 00000100:00100000:3.0:1746065122.740700:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4894 00000100:00100000:3.0:1746065122.740707:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+20:1958:x1830881261016320:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065122.740738:0:8433:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.740750:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.740752:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.740756:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.740767:0:8433:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.741032:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4895 00000100:00100000:1.0:1746065122.741041:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1958:x1830881261016448:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065122.741058:0:350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.741067:0:350:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.741068:0:350:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065122.741070:0:350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.741075:0:350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.741801:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4896 00000100:00100000:3.0:1746065122.741807:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1958:x1830881261016576:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065122.741843:0:21485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.741850:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.741852:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.741855:0:21485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.741862:0:21485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.742184:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4897 00000100:00100000:2.0:1746065122.742192:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1958:x1830881261016832:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065122.742207:0:21483:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.742215:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.742216:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.742220:0:21483:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.742228:0:21483:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.742959:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4898 00000100:00100000:3.0:1746065122.742966:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+21:1958:x1830881261017216:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065122.742984:0:21481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.742992:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.742993:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.742996:0:21481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.743004:0:21481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.744177:0:21488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.744188:0:21488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.744196:0:21488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.744201:0:21488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f109c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065122.744204:0:21488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.744211:0:21488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.744224:0:21488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.744234:0:21488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f109c00/0x14b4f8542d4f300c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.744293:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1959:x1830881261015424:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 15895us (17007us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.744300:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4891 00010000:00010000:3.0:1746065122.748228:0:21482:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.748242:0:21482:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.748248:0:21482:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.748254:0:21482:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd36000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065122.748257:0:21482:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.748264:0:21482:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.748277:0:21482:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.748282:0:21482:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f3013 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.748358:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+21:1959:x1830881261015680:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 18384us (20059us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.748367:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4892 00010000:00010000:1.0:1746065122.751756:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.751772:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.751779:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.751785:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d38800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065122.751789:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.751796:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.751811:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.751833:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f301a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.751914:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+19:1958:x1830881261015936:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 16444us (17775us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065122.751923:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4893 00010000:00010000:3.0:1746065122.755141:0:8433:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.755154:0:8433:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.755160:0:8433:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.755165:0:8433:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f108400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065122.755168:0:8433:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.755174:0:8433:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.755188:0:8433:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.755193:0:8433:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f108400/0x14b4f8542d4f3021 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.756359:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1958:x1830881261016320:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 15620us (16019us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.756373:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4894 00010000:00010000:1.0:1746065122.760713:0:350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.760727:0:350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.760734:0:350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.760740:0:350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4cc1000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065122.760744:0:350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.760751:0:350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.760765:0:350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.760771:0:350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc1000/0x14b4f8542d4f3028 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 350 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065122.760856:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1958:x1830881261016448:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 19813us (20486us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065122.760867:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4895 00010000:00010000:3.0:1746065122.766089:0:21485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.766105:0:21485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.766113:0:21485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.766119:0:21485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f108200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065122.766122:0:21485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.766129:0:21485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.766144:0:21485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.766149:0:21485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f108200/0x14b4f8542d4f302f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.766219:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1958:x1830881261016576:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 24407us (25818us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.766227:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4896 00010000:00010000:3.0:1746065122.770081:0:21481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.770093:0:21481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.770100:0:21481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.770106:0:21481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f108000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065122.770109:0:21481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.770115:0:21481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.770128:0:21481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.770133:0:21481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f108000/0x14b4f8542d4f303d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.770184:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1958:x1830881261017216:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 27216us (29757us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.770193:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4898 00010000:00010000:2.0:1746065122.772930:0:21483:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.772944:0:21483:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.772951:0:21483:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.772957:0:21483:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd37e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065122.772960:0:21483:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.772966:0:21483:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.772980:0:21483:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.772984:0:21483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd37e00/0x14b4f8542d4f3036 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.773051:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881261016832:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 30858us (32637us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065122.773060:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4897 00000100:00100000:0.0:1746065122.777888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.778102:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261017472 00000100:00100000:2.0:1746065122.778109:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261017472 00000100:00100000:2.0:1746065122.778154:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9014 00000100:00100000:2.0:1746065122.778164:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28960:x1830881261017472:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:2.0:1746065122.778201:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.778221:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f2fdb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af45 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.778237:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.778240:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065122.778268:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.778278:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.778285:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00010000:2.0:1746065122.778483:0:24350:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b9ffb80 reply state ffff88009f247000 transno 8589943065 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065122.778490:0:24350:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065122.778758:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:28960:x1830881261017472:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 596us (876us total) trans 8589943065 rc 0/0 00000100:00100000:2.0:1746065122.778765:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9014 00010000:00010000:2.0:1746065122.781875:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.781891:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.781897:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.781901:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd37000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065122.781905:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.781911:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.781925:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.781928:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065122.781931:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.781936:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37000/0x14b4f8542d4f3044 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065122.783128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.783369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.783395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.783406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.783418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.783489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.783555:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261017600 00000100:00100000:3.0:1746065122.783561:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261017600 00000100:00100000:3.0:1746065122.783591:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261017856 00000100:00100000:3.0:1746065122.783593:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261017856 00000100:00100000:3.0:1746065122.783602:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261018112 00000100:00100000:3.0:1746065122.783604:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261018112 00000100:00100000:3.0:1746065122.783614:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261017728 00000100:00100000:3.0:1746065122.783616:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261017728 00000100:00100000:3.0:1746065122.783623:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261017984 00000100:00100000:3.0:1746065122.783624:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261017984 00000100:00100000:3.0:1746065122.783629:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261018240 00000100:00100000:3.0:1746065122.783630:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261018240 00000100:00100000:3.0:1746065122.783639:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10707 00000100:00100000:3.0:1746065122.783645:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261017600:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:3.0:1746065122.783787:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065122.783790:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065121 -> 1746065123 00002000:00010000:3.0:1746065122.783792:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065121 -> 1746065123 00002000:00010000:3.0:1746065122.783794:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065122 -> 1746065123 00002000:00010000:3.0:1746065122.783796:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:3.0:1746065122.783854:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261017600:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 209us (731us total) trans 17179872797 rc 0/0 00000100:00100000:3.0:1746065122.783860:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10707 00000100:00100000:3.0:1746065122.783955:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10708 00000100:00100000:3.0:1746065122.783960:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1960:x1830881261017856:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:3.0:1746065122.784028:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065122.784031:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784033:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784034:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784036:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065122.784049:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1960:x1830881261017856:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 89us (680us total) trans 21474840030 rc 0/0 00000100:00100000:3.0:1746065122.784053:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10708 00000100:00100000:3.0:1746065122.784061:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10709 00000100:00100000:3.0:1746065122.784065:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261018112:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:3.0:1746065122.784113:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:3.0:1746065122.784116:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784117:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065122 -> 1746065123 00002000:00010000:3.0:1746065122.784119:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065122 -> 1746065123 00002000:00010000:3.0:1746065122.784120:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5699 -> 5699 00000100:00100000:3.0:1746065122.784135:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261018112:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 70us (740us total) trans 17179872798 rc 0/0 00000100:00100000:3.0:1746065122.784140:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10709 00000100:00100000:3.0:1746065122.784149:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10710 00000100:00100000:3.0:1746065122.784153:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1960:x1830881261017728:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:3.0:1746065122.784214:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065122.784216:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784218:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784219:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784221:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065122.784235:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1960:x1830881261017728:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 81us (827us total) trans 21474840031 rc 0/0 00000100:00100000:3.0:1746065122.784239:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10710 00000100:00100000:3.0:1746065122.784246:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10711 00000100:00100000:3.0:1746065122.784250:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261017984:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:3.0:1746065122.784301:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065122.784304:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784306:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065122 -> 1746065123 00002000:00010000:3.0:1746065122.784307:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784309:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065122.784325:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261017984:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 73us (906us total) trans 17179872799 rc 0/0 00000100:00100000:3.0:1746065122.784329:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10711 00000100:00100000:3.0:1746065122.784351:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10712 00000100:00100000:3.0:1746065122.784355:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1960:x1830881261018240:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:3.0:1746065122.784425:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065122.784427:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784429:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784430:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.784432:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746065122.784451:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1960:x1830881261018240:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 95us (962us total) trans 21474840032 rc 0/0 00000100:00100000:3.0:1746065122.784456:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10712 00000100:00100000:0.0:1746065122.786730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.786792:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261018496 00000100:00100000:2.0:1746065122.786799:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261018496 00000100:00100000:2.0:1746065122.786856:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3675 00000100:00100000:2.0:1746065122.786861:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:28960:x1830881261018496:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:2.0:1746065122.786906:0:14647:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x309:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00600/0x14b4f8542d4f2f8e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af37 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.786939:0:14647:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065122.786952:0:14647:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af3e expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.786957:0:14647:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065122.786978:0:14647:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af3e expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.786987:0:14647:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af3e expref: 9 pid: 16767 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065122.786997:0:14647:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14647:1830881259720448:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.787063:0:14647:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.788789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.788949:0:14647:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14647:1830881259720448:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.788968:0:14647:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00000100:00100000:1.0:1746065122.789655:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261018624 00000100:00100000:1.0:1746065122.789660:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261018624 00010000:00010000:1.0:1746065122.789683:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af3e expref: 10 pid: 16767 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.789715:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5334 00000100:00100000:1.0:1746065122.789722:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261018624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.789732:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.789737:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af3e expref: 10 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.789745:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af3e expref: 10 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.789760:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39e00/0x14b4f8542d4f2fcd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af3e expref: 10 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.789781:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.789785:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00010000:00010000:1.0:1746065122.789791:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14647 initiator: MDT0 00010000:00010000:1.0:1746065122.789796:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14647 initiator: MDT0 00010000:00010000:1.0:1746065122.789831:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.789859:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261018624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 137us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.789864:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5334 00010000:00010000:3.0:1746065122.789925:0:14647:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00010000:00010000:3.0:1746065122.789936:0:14647:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00000040:00080000:3.0:1746065122.791250:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2520, 88 off211576 00000004:00080000:3.0:1746065122.791256:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722082440790ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065122.791294:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2462, 88 off206296 00000004:00080000:3.0:1746065122.791296:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722082480575ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065122.791312:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2463, 88 off206384 00000004:00080000:3.0:1746065122.791314:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722082498675ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065122.791319:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2521, 88 off211664 00000004:00080000:3.0:1746065122.791320:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722082505350ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065122.791324:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2522, 88 off211752 00000004:00080000:3.0:1746065122.791326:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722082510987ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065122.791330:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2464, 88 off206472 00000004:00080000:3.0:1746065122.791331:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722082516170ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065122.791347:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2465, 88 off206560 00000004:00080000:3.0:1746065122.791349:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722082534025ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065122.791357:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2466, 88 off206648 00000004:00080000:3.0:1746065122.791359:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722082543912ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065122.791365:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2523, 88 off211840 00000004:00080000:3.0:1746065122.791367:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722082552262ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065122.791373:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2467, 88 off206736 00000004:00080000:3.0:1746065122.791375:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722082559658ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065122.791380:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2524, 88 off211928 00000004:00080000:3.0:1746065122.791382:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722082566910ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065122.791388:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2468, 88 off206824 00000004:00080000:3.0:1746065122.791390:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722082574880ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065122.791396:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2525, 88 off212016 00000004:00080000:3.0:1746065122.791398:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722082582437ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065122.791403:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2526, 88 off212104 00000004:00080000:3.0:1746065122.791407:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722082591525ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065122.791413:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2527, 88 off212192 00000004:00080000:3.0:1746065122.791415:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722082599910ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065122.791420:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2528, 88 off212280 00000004:00080000:3.0:1746065122.791422:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722082607185ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065122.791428:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2469, 88 off206912 00000004:00080000:3.0:1746065122.791431:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722082615447ns, next at 666938887344ns, rc = 0 00000001:00080000:3.0:1746065122.804684:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943065 is committed 00000001:00080000:3.0:1746065122.804698:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943066 is committed 00000004:00080000:3.0:1746065122.804700:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1762 committed 00000004:00080000:3.0:1746065122.804712:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1822 committed 00000004:00080000:3.0:1746065122.804716:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1821 committed 00000004:00080000:3.0:1746065122.804718:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1820 committed 00000004:00080000:3.0:1746065122.804719:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1819 committed 00000004:00080000:3.0:1746065122.804721:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1761 committed 00000004:00080000:3.0:1746065122.804722:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1818 committed 00000004:00010000:2.0:1746065122.804723:0:14647:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009bf9f450 reply state ffff88009bff3000 transno 8589943066 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00000004:00080000:3.0:1746065122.804724:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1760 committed 00000004:00080000:3.0:1746065122.804725:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1817 committed 00000004:00080000:3.0:1746065122.804726:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1759 committed 00000004:00080000:3.0:1746065122.804727:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1758 committed 00000004:00080000:3.0:1746065122.804728:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1757 committed 00000004:00080000:3.0:1746065122.804730:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1816 committed 00000004:00080000:3.0:1746065122.804731:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1815 committed 00000004:00080000:3.0:1746065122.804732:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1756 committed 00000100:00100000:2.0:1746065122.804733:0:14647:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1746065122.804734:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1755 committed 00000004:00080000:3.0:1746065122.804735:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1814 committed 00010000:00010000:2.0:1746065122.804741:0:14647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.804744:0:14647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065122.804750:0:14647:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf00600/0x14b4f8542d4f2f8e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af37 expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.804772:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065122.804784:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259720576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065122.804812:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259721088:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746065122.804845:0:14647:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065122.804849:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.804854:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28960:x1830881261018496:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 17992us (18128us total) trans 8589943066 rc 0/0 00000100:00100000:2.0:1746065122.804862:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3675 00000100:00100000:3.0:1746065122.804875:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259720960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.804891:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.804900:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259720832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.804902:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259721472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.804915:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065122.804929:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065122.804936:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065122.804942:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065122.804947:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d38000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065122.804950:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065122.804955:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065122.804965:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.804967:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065122.804969:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065122.804974:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f304b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14647 initiator: MDT0 00000100:00100000:1.0:1746065122.805035:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259720576 00000100:00100000:1.0:1746065122.805042:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259720576 00000100:00100000:1.0:1746065122.805065:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259720960 00000100:00100000:1.0:1746065122.805067:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259720960 00000100:00100000:1.0:1746065122.805076:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259721472 00000100:00100000:1.0:1746065122.805077:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259721472 00000100:00100000:1.0:1746065122.805087:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10713 00000100:00100000:1.0:1746065122.805092:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+61:3295:x1830881259720576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065122.805456:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065122.805459:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.805461:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.805462:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.805464:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:0.0:1746065122.805500:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.805521:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259721600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.805528:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259721984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.805540:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.805551:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259720704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065122.805558:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259722112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.805572:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.805578:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259721088 00000100:00100000:0.0:1746065122.805581:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259721088 00000100:00100000:3.0:1746065122.805585:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259721216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065122.805595:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259721600 00000100:00100000:0.0:1746065122.805597:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259721600 00000100:00100000:3.0:1746065122.805598:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.805604:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259720704 00000100:00100000:0.0:1746065122.805606:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259720704 00000100:00100000:3.0:1746065122.805608:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259721728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.805611:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259721216 00000100:00100000:0.0:1746065122.805612:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259721216 00000100:00100000:0.0:1746065122.805619:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10714 00000100:00100000:3.0:1746065122.805625:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.805630:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3295:x1830881259720960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.805633:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259722240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.805644:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.805652:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065122.805656:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259721856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.805667:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.805672:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259722368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.805683:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.805696:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259721728 00000100:00100000:3.0:1746065122.805699:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259721728 00002000:00010000:0.0:1746065122.805699:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065122.805701:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065122.805703:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065122.805704:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065122.805706:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065122.805711:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259722240 00000100:00100000:3.0:1746065122.805713:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259722240 00000100:00100000:3.0:1746065122.805718:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259721856 00000100:00100000:3.0:1746065122.805720:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259721856 00000100:00100000:3.0:1746065122.805725:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259722368 00000100:00100000:3.0:1746065122.805726:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259722368 00000100:00100000:0.0:1746065122.805727:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3295:x1830881259720960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (835us total) trans 17179872801 rc 0/0 00000100:00100000:3.0:1746065122.805733:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10715 00000100:00100000:3.0:1746065122.805737:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3295:x1830881259721472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.805837:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3295:x1830881259721472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (920us total) trans 17179872802 rc 0/0 00000100:00100000:1.0:1746065122.805914:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3295:x1830881259720576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 820us (1064us total) trans 17179872800 rc 0/0 00000100:00100000:2.0:1746065122.806067:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.806083:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259721344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.806099:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.806152:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259720832 00000100:00100000:2.0:1746065122.806155:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259720832 00000100:00100000:0.0:1746065122.806559:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10714 00000100:00100000:3.0:1746065122.806589:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10715 00000100:00100000:1.0:1746065122.806597:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10713 00000100:00100000:3.0:1746065122.806602:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259721344 00000100:00100000:3.0:1746065122.806604:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259721344 00000100:00100000:2.0:1746065122.806609:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10716 00000100:00100000:2.0:1746065122.806614:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830881259721088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.806616:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10717 00000100:00100000:3.0:1746065122.806620:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3296:x1830881259721600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065122.806626:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10718 00000100:00100000:1.0:1746065122.806631:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3297:x1830881259720704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065122.806691:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065122.806692:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065122.806694:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.806694:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065122.806696:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.806696:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065122.806697:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.806698:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065122.806699:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746065122.806699:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746065122.806707:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065122.806709:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.806711:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.806712:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.806714:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746065122.806718:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:3296:x1830881259721088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (1218us total) trans 17179872803 rc 0/0 00000100:00100000:1.0:1746065122.806719:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3297:x1830881259720704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (1147us total) trans 17179872804 rc 0/0 00000100:00100000:2.0:1746065122.806722:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10716 00000100:00100000:1.0:1746065122.806724:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10718 00000100:00100000:3.0:1746065122.806733:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3296:x1830881259721600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (1192us total) trans 21474840033 rc 0/0 00000100:00100000:2.0:1746065122.806734:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10719 00000100:00100000:1.0:1746065122.806737:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10720 00000100:00100000:2.0:1746065122.806738:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3297:x1830881259721216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.806739:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10717 00000100:00100000:1.0:1746065122.806740:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3297:x1830881259721728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.806750:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10721 00000100:00100000:3.0:1746065122.806754:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3297:x1830881259722240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065122.806795:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065122.806796:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065122.806797:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.806798:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.806798:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065122.806800:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.806800:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065122.806802:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746065122.806802:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.806803:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746065122.806812:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065122.806828:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.806830:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.806832:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.806833:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065122.806835:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3297:x1830881259721216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1235us total) trans 17179872805 rc 0/0 00000100:00100000:1.0:1746065122.806835:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3297:x1830881259721728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1214us total) trans 21474840034 rc 0/0 00000100:00100000:2.0:1746065122.806840:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10719 00000100:00100000:1.0:1746065122.806841:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10720 00000100:00100000:1.0:1746065122.806849:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10722 00000100:00100000:3.0:1746065122.806851:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3297:x1830881259722240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (1205us total) trans 21474840035 rc 0/0 00000100:00100000:2.0:1746065122.806853:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10723 00000100:00100000:1.0:1746065122.806854:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3297:x1830881259721856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.806856:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10721 00000100:00100000:2.0:1746065122.806857:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3297:x1830881259722368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.806866:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10724 00000100:00100000:3.0:1746065122.806870:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3298:x1830881259720832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.806874:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10725 00000100:00100000:2.0:1746065122.806878:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3298:x1830881259721344:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065122.806912:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380f800/2, rc 0, transno 17179872804 00000100:00100000:3.0:1746065122.806919:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259720704:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065122.806920:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065122.806923:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.806924:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00000004:00080000:3.0:1746065122.806926:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380ce00/2, rc 0, transno 17179872805 00002000:00010000:1.0:1746065122.806926:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00000100:00100000:3.0:1746065122.806928:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259721216:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065122.806928:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000004:00080000:3.0:1746065122.806936:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7af100/2, rc 0, transno 21474840034 00000100:00100000:3.0:1746065122.806939:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259721728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065122.806945:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7ad880/2, rc 0, transno 21474840035 00000100:00100000:1.0:1746065122.806946:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3297:x1830881259721856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1278us total) trans 21474840036 rc 0/0 00000100:00100000:3.0:1746065122.806947:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259722240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.806951:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3298:x1830881259721344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (850us total) trans 17179872806 rc 0/0 00000100:00100000:1.0:1746065122.806951:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10722 00000004:00080000:3.0:1746065122.806954:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7adf80/2, rc 0, transno 21474840036 00000100:00100000:3.0:1746065122.806957:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259721856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065122.806958:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10725 00000004:00080000:2.0:1746065122.806975:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380d500/2, rc 0, transno 17179872806 00000100:00100000:2.0:1746065122.806979:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259721344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.806984:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.806998:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259722496:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065122.807011:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1746065122.807013:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065122.807013:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.807014:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.807015:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.807017:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:3.0:1746065122.807027:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380ca80/2, rc 0, transno 17179872801 00000100:00100000:3.0:1746065122.807029:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259720960:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065122.807035:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380f480/2, rc 0, transno 17179872802 00000100:00100000:3.0:1746065122.807038:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259721472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065122.807039:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3297:x1830881259722368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (1354us total) trans 21474840037 rc 0/0 00000004:00080000:3.0:1746065122.807044:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fdf80/2, rc 0, transno 17179872800 00000100:00100000:1.0:1746065122.807044:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10723 00000100:00100000:3.0:1746065122.807047:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259720576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.807052:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065122.807052:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259721984 00000004:00080000:2.0:1746065122.807053:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7ac380/2, rc 0, transno 21474840037 00000100:00100000:1.0:1746065122.807054:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259721984 00000100:00100000:3.0:1746065122.807056:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259722624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.807057:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259722368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065122.807064:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259722496 00000100:00100000:1.0:1746065122.807066:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259722496 00000100:00100000:3.0:1746065122.807067:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065122.807082:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259722624 00000100:00100000:2.0:1746065122.807084:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10726 00000100:00100000:1.0:1746065122.807084:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259722624 00000100:00100000:2.0:1746065122.807089:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3295:x1830881259721984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065122.807091:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10727 00000100:00100000:3.0:1746065122.807094:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10728 00000100:00100000:1.0:1746065122.807095:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3295:x1830881259722496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.807100:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3295:x1830881259722624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065122.807179:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3295:x1830881259722624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (110us total) trans 17179872807 rc 0/0 00000100:00100000:2.0:1746065122.807179:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3295:x1830881259721984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (193us total) trans 21474840038 rc 0/0 00000100:00100000:2.0:1746065122.807183:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10726 00000100:00100000:3.0:1746065122.807186:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10728 00000100:00100000:2.0:1746065122.807246:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3295:x1830881259722496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (233us total) trans 21474840039 rc 0/0 00000100:00100000:2.0:1746065122.807251:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10727 00000100:00100000:0.0:1746065122.807254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.807266:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261018752 00000100:00100000:2.0:1746065122.807268:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261018752 00000100:00100000:0.0:1746065122.807275:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065122.807292:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00000100:00100000:2.0:1746065122.807292:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9015 00000004:00080000:0.0:1746065122.807293:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380df80/2, rc 0, transno 17179872803 00002000:00010000:3.0:1746065122.807295:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.807296:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00000100:00100000:0.0:1746065122.807296:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259721088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.807297:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:28960:x1830881261018752:12345-192.168.202.46@tcp:101:lfs.0 00002000:00010000:3.0:1746065122.807298:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.807299:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5699 -> 5699 00000004:00080000:0.0:1746065122.807305:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7ac700/2, rc 0, transno 21474840033 00010000:00010000:2.0:1746065122.807307:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065122.807308:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259721600:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065122.807318:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af76 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.807322:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3298:x1830881259720832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 451us (1443us total) trans 17179872808 rc 0/0 00000100:00100000:3.0:1746065122.807327:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10724 00000100:00100000:3.0:1746065122.807347:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259722112 00000100:00100000:3.0:1746065122.807350:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259722112 00000100:00100000:3.0:1746065122.807362:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10729 00000100:00100000:3.0:1746065122.807366:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3296:x1830881259722112:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065122.807366:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af76 expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.807378:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af76 expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.807392:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.807394:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065122.807397:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d38600, rc 0) 00000100:00100000:2.0:1746065122.807421:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28960:x1830881261018752:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 124us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.807426:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9015 00000004:00080000:2.0:1746065122.807448:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc5b800/2, rc 0, transno 17179872807 00000100:00100000:2.0:1746065122.807451:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259722624:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065122.807458:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7aea00/2, rc 0, transno 21474840038 00000100:00100000:2.0:1746065122.807460:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259721984:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065122.807465:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7ae300/2, rc 0, transno 21474840039 00000100:00100000:2.0:1746065122.807467:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259722496:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065122.807481:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:3.0:1746065122.807483:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065122.807485:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.807486:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065122.807488:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:3.0:1746065122.807510:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3296:x1830881259722112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (233us total) trans 21474840040 rc 0/0 00000100:00100000:3.0:1746065122.807515:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10729 00000004:00080000:3.0:1746065122.807535:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380e680/2, rc 0, transno 17179872808 00000100:00100000:3.0:1746065122.807538:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259720832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065122.807634:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7ad180/2, rc 0, transno 21474840040 00000100:00100000:0.0:1746065122.807638:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259722112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.809934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.810027:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261019008 00000100:00100000:3.0:1746065122.810086:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261019008 00000100:00100000:3.0:1746065122.810119:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3676 00000100:00100000:3.0:1746065122.810126:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28960:x1830881261019008:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1746065122.810302:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28960:x1830881261019008:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 176us (373us total) trans 8589943067 rc 0/0 00000100:00100000:3.0:1746065122.810308:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3676 00010000:00010000:0.0:1746065122.823964:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065122.828553:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.829175:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261019264 00000100:00100000:1.0:1746065122.829182:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261019264 00000100:00100000:1.0:1746065122.829313:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9016 00000100:00100000:3.0:1746065122.829384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.829406:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261019520 00000100:00100000:2.0:1746065122.829409:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261019520 00000100:00100000:2.0:1746065122.829428:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9017 00000100:00100000:2.0:1746065122.829433:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:28969:x1830881261019520:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065122.829451:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065122.829464:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+7:28971:x1830881261019264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.829465:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39400/0x14b4f8542d4f3059 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af84 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.829472:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.829478:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f3060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af7d expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.829557:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.829559:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.829567:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.829576:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.829576:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.829582:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.829586:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.829588:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.829591:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.829596:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.829596:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.829601:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.830182:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830189:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830195:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065122.830202:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065122.830268:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830274:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830278:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830283:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d39c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065122.830286:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830291:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830300:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065122.830302:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065122.830305:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830309:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39c00/0x14b4f8542d4f3067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065122.830380:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.830387:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.830395:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:1.0:1746065122.830401:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065122.830438:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.830442:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.830446:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.830449:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdc8000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065122.830451:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.830455:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.830460:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065122.830462:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065122.830465:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.830468:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc8000/0x14b4f8542d4f306e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.830844:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830853:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830857:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830861:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d38800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065122.830862:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830867:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830872:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205100) 00010000:00010000:2.0:1746065122.830874:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065122.830876:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830880:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38800/0x14b4f8542d4f3075 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.830975:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39400/0x14b4f8542d4f3059 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af84 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.830987:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af84 expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.830991:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.830992:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.830994:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065122.830996:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d38000, rc 0) 00010000:00010000:1.0:1746065122.830996:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.831000:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.831003:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdc9a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065122.831005:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.831009:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.831015:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205100) 00010000:00010000:1.0:1746065122.831016:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065122.831018:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.831022:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9a00/0x14b4f8542d4f307c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065122.831032:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28969:x1830881261019520:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1598us (1648us total) trans 8589943068 rc 0/0 00000100:00100000:2.0:1746065122.831039:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9017 00010000:00010000:1.0:1746065122.831044:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9800/0x14b4f8542d4f3060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af7d expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.831055:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af7d expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.831059:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.831061:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065122.831063:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935af800, rc 0) 00000100:00100000:1.0:1746065122.831079:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:28971:x1830881261019264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1760us (2535us total) trans 8589943069 rc 0/0 00000100:00100000:1.0:1746065122.831085:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9016 00000100:00100000:0.0:1746065122.832876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.832935:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261019776 00000100:00100000:3.0:1746065122.832944:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261019776 00000100:00100000:0.0:1746065122.833030:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3677 00000100:00100000:0.0:1746065122.833037:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:28971:x1830881261019776:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065122.833180:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:28971:x1830881261019776:12345-192.168.202.46@tcp:35:cat.0 Request processed in 143us (308us total) trans 8589943070 rc 0/0 00000100:00100000:0.0:1746065122.833187:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3677 00000100:00100000:0.0:1746065122.834412:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.834681:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020032 00000100:00100000:1.0:1746065122.834687:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020032 00000100:00100000:1.0:1746065122.835447:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9018 00000100:00100000:1.0:1746065122.835455:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:28967:x1830881261020032:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065122.835473:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.835489:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935afe00/0x14b4f8542d4f309f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af8b expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.835562:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.835574:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af84 expref: 248 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.835580:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af7d expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.835585:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.835611:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af7d expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.835621:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af7d expref: 11 pid: 16767 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.835631:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259722752:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.835712:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af84 expref: 248 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.835720:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af84 expref: 248 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.835726:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff20380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259722880:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.835744:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.836008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.836053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.836232:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020160 00000100:00100000:3.0:1746065122.836236:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020160 00000100:00100000:3.0:1746065122.836258:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10730 00000100:00100000:3.0:1746065122.836263:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:28971:x1830881261020160:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.836270:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.836280:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af92 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.836293:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.836294:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.836299:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af92 expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.836313:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af92 expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.836321:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a399c00, rc 0) 00000100:00100000:3.0:1746065122.836348:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:28971:x1830881261020160:12345-192.168.202.46@tcp:101:cat.0 Request processed in 85us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.836352:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10730 00000100:00100000:2.0:1746065122.836402:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020416 00000100:00100000:2.0:1746065122.836410:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020416 00000100:00100000:2.0:1746065122.836435:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9019 00000100:00100000:2.0:1746065122.836441:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28972:x1830881261020416:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.836450:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.836457:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39800/0x14b4f8542d4f30b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5af99 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.836493:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.836501:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065122.836508:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065122.836519:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065122.836603:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39800/0x14b4f8542d4f30b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af99 expref: 252 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.836614:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af99 expref: 251 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.836620:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.836623:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065122.836625:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.836630:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.836634:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d38200, rc 0) 00000100:00100000:2.0:1746065122.836655:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28972:x1830881261020416:12345-192.168.202.46@tcp:101:cat.0 Request processed in 214us (601us total) trans 8589943071 rc 0/0 00000100:00100000:2.0:1746065122.836660:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9019 00000100:00100000:0.0:1746065122.839607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.839639:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259722752:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065122.839640:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065122.839649:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff20380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259722880:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065122.839667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065122.839673:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065122.839722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.839746:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020544 00000100:00100000:2.0:1746065122.839754:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020544 00010000:00010000:2.0:1746065122.839775:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af7d expref: 12 pid: 16767 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065122.839778:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020672 00000100:00100000:3.0:1746065122.839781:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020672 00010000:00010000:3.0:1746065122.839792:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af84 expref: 251 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065122.840043:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5335 00000100:00100000:2.0:1746065122.840051:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261020544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065122.840053:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5336 00000100:00100000:3.0:1746065122.840058:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881261020672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.840061:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.840063:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.840065:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af7d expref: 12 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.840066:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af84 expref: 251 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.840074:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af84 expref: 251 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746065122.840128:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020800 00000100:00100000:0.0:1746065122.840132:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020800 00000100:00100000:0.0:1746065122.840156:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020928 00000100:00100000:0.0:1746065122.840159:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020928 00000100:00100000:0.0:1746065122.840179:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9020 00000100:00100000:0.0:1746065122.840186:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:28971:x1830881261020800:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065122.840200:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065122.840214:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f30c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afa0 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.840305:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af7d expref: 14 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.840318:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935af800/0x14b4f8542d4f3091 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af7d expref: 14 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.840340:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.840343:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.840350:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.840354:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.840381:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261020544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 332us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.840386:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5335 00000100:00100000:2.0:1746065122.840405:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9021 00000100:00100000:2.0:1746065122.840409:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:28972:x1830881261020928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.840417:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.840422:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39000/0x14b4f8542d4f30d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afa7 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.840445:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f30c9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa0 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.840458:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f30c9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa0 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.840473:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065122.840475:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065122.840477:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc0e00, rc 0) 00000100:00100000:0.0:1746065122.840494:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:28971:x1830881261020800:12345-192.168.202.46@tcp:101:cat.0 Request processed in 309us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.840499:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9020 00010000:00010000:3.0:1746065122.840561:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38000/0x14b4f8542d4f3083 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af84 expref: 253 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.840576:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.840579:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.840583:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.840587:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.840598:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065122.840606:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.840611:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065122.840613:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:1960:x1830881261020672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 556us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.840621:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5336 00000004:00200000:1.0:1746065122.840624:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065122.840716:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065122.840723:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 2/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.840731:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065122.840742:0:14644:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.840748:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065122.841076:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935afe00/0x14b4f8542d4f309f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af8b expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.841109:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af8b expref: 12 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.841116:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af8b expref: 12 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.841121:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdc9600, rc 0) 00000100:00100000:1.0:1746065122.841153:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:28967:x1830881261020032:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5698us (6742us total) trans 8589943072 rc 0/0 00000100:00100000:1.0:1746065122.841159:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9018 00000100:00100000:0.0:1746065122.851058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.851110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.851176:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261021312 00000100:00100000:2.0:1746065122.851184:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261021312 00000100:00100000:3.0:1746065122.851188:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261021056 00000100:00100000:3.0:1746065122.851193:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261021056 00010000:00010000:3.0:1746065122.851216:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af8b expref: 12 pid: 16767 timeout: 822 lvb_type: 0 00002000:00100000:2.0:1746065122.851221:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009009c700 x1830881261021312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.851229:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009c700 with x1830881261021312 ext(0->1048575) 00002000:00010000:2.0:1746065122.851233:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009c700 00000100:00100000:3.0:1746065122.851240:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5337 00000100:00100000:3.0:1746065122.851246:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261021056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065122.851248:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4899 00000100:00100000:2.0:1746065122.851253:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261021312:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065122.851257:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065122.851262:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af8b expref: 12 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.851272:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af8b expref: 12 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.851290:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdc9600/0x14b4f8542d4f30a6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af8b expref: 12 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.851317:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.851322:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065122.851329:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065122.851345:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065122.851363:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065122.851396:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261021056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 150us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.851402:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5337 00010000:00010000:3.0:1746065122.851432:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065122.851439:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065122.851471:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065122.851475:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065122.851488:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065122.851515:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d39000/0x14b4f8542d4f30d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa7 expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.851527:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa7 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.851532:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.851535:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065122.851537:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d38c00, rc 0) 00000100:00100000:3.0:1746065122.851559:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:28972:x1830881261020928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11149us (11837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.851564:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9021 00000100:00100000:0.0:1746065122.855901:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.855951:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261021440 00000100:00100000:3.0:1746065122.855957:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261021440 00000100:00100000:3.0:1746065122.856007:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10731 00000100:00100000:3.0:1746065122.856014:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28972:x1830881261021440:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.856031:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.856047:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afae expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.856067:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.856068:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.856074:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afae expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.856087:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afae expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.856095:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4bf0600, rc 0) 00000100:00100000:3.0:1746065122.856139:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28972:x1830881261021440:12345-192.168.202.46@tcp:101:cat.0 Request processed in 125us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.856144:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10731 00000100:00100000:2.0:1746065122.858383:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261021312:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7120us (7263us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065122.858393:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4899 00002000:00100000:2.0:1746065122.858402:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009009c700 x1830881261021312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.858411:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009c700 with x1830881261021312 ext(0->1048575) 00002000:00010000:2.0:1746065122.858415:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009c700 00000100:00100000:2.0:1746065122.861982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.862068:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261021696 00000100:00100000:3.0:1746065122.862075:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261021696 00002000:00100000:3.0:1746065122.862106:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880095354e00 x1830881261021696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.862114:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354e00 with x1830881261021696 ext(0->1048575) 00002000:00010000:3.0:1746065122.862118:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354e00 00000100:00100000:3.0:1746065122.862140:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4900 00000100:00100000:3.0:1746065122.862146:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881261021696:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065122.866004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.866065:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261021824 00000100:00100000:2.0:1746065122.866073:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261021824 00000100:00100000:2.0:1746065122.866124:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10732 00000100:00100000:2.0:1746065122.866132:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:28971:x1830881261021824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.866147:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.866168:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afb5 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.866186:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.866188:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.866194:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afb5 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.866207:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afb5 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.866215:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d39400, rc 0) 00000100:00100000:2.0:1746065122.867259:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:28971:x1830881261021824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1125us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.867265:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10732 00000100:00100000:3.0:1746065122.868596:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881261021696:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6448us (6619us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.868607:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4900 00002000:00100000:3.0:1746065122.868614:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880095354e00 x1830881261021696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.868623:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354e00 with x1830881261021696 ext(0->1048575) 00002000:00010000:3.0:1746065122.868627:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354e00 00000100:00100000:0.0:1746065122.872153:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.872249:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261022080 00000100:00100000:3.0:1746065122.872256:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261022080 00002000:00100000:3.0:1746065122.872290:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009009c380 x1830881261022080/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.872299:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009c380 with x1830881261022080 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.872304:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009009c380 00000100:00100000:3.0:1746065122.872329:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4901 00000100:00100000:3.0:1746065122.872347:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881261022080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065122.877353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.877409:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261022208 00000100:00100000:3.0:1746065122.877416:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261022208 00000100:00100000:3.0:1746065122.877464:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10733 00000100:00100000:3.0:1746065122.877471:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:28972:x1830881261022208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.877487:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.877502:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afbc expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.877523:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.877524:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.877530:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afbc expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.877547:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afbc expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.877555:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982b7000, rc 0) 00000100:00100000:3.0:1746065122.877603:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:28972:x1830881261022208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 133us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.877608:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10733 00000100:00100000:3.0:1746065122.881182:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881261022080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8838us (9025us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.881193:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4901 00002000:00100000:3.0:1746065122.881206:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009009c380 x1830881261022080/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.881214:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009c380 with x1830881261022080 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.881220:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009009c380 00000100:00100000:1.0:1746065122.882104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.882178:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261022464 00000100:00100000:3.0:1746065122.882185:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261022464 00002000:00100000:3.0:1746065122.882215:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009ff20380 x1830881261022464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.882222:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20380 with x1830881261022464 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.882225:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff20380 00000100:00100000:3.0:1746065122.882251:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4902 00000100:00100000:3.0:1746065122.882258:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261022464:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065122.887113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.887478:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261022592 00000100:00100000:2.0:1746065122.887485:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261022592 00000100:00100000:2.0:1746065122.887533:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10734 00000100:00100000:2.0:1746065122.887540:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+24:28971:x1830881261022592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.887555:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.887570:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afc3 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.887597:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.887598:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.887605:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afc3 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.887617:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afc3 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.887626:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d38800, rc 0) 00000100:00100000:2.0:1746065122.888246:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+25:28971:x1830881261022592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 703us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.888253:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10734 00000100:00100000:3.0:1746065122.889934:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261022464:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7672us (7827us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.889946:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4902 00002000:00100000:3.0:1746065122.889955:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009ff20380 x1830881261022464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.889964:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff20380 with x1830881261022464 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.889968:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff20380 00000100:00100000:0.0:1746065122.892560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.892636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.892705:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261022848 00000100:00100000:3.0:1746065122.892713:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261022848 00002000:00100000:3.0:1746065122.892747:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094246d80 x1830881261022848/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.892757:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094246d80 with x1830881261022848 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.892761:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094246d80 00000100:00100000:3.0:1746065122.892778:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4903 00000100:00100000:3.0:1746065122.892785:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261022848:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065122.893891:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261022976 00000100:00100000:2.0:1746065122.893897:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261022976 00000100:00100000:2.0:1746065122.893920:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10735 00000100:00100000:2.0:1746065122.893926:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:28972:x1830881261022976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.893935:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.893948:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afca expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.893966:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.893967:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.893974:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afca expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.893988:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afca expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.893996:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d39200, rc 0) 00000100:00100000:2.0:1746065122.894041:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28972:x1830881261022976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 114us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.894047:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10735 00000100:00100000:0.0:1746065122.898596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.898662:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261023232 00000100:00100000:2.0:1746065122.898670:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261023232 00002000:00100000:2.0:1746065122.898707:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094244380 x1830881261023232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.898717:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244380 with x1830881261023232 ext(1048576->2097151) 00002000:00010000:2.0:1746065122.898721:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094244380 00000100:00100000:2.0:1746065122.898754:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4904 00000100:00100000:2.0:1746065122.898761:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881261023232:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065122.901502:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261022848:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8711us (8978us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.901511:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4903 00002000:00100000:3.0:1746065122.901520:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094246d80 x1830881261022848/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.901527:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094246d80 with x1830881261022848 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.901532:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094246d80 00000100:00100000:2.0:1746065122.905927:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881261023232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7158us (7331us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065122.905938:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4904 00002000:00100000:2.0:1746065122.905949:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094244380 x1830881261023232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.905957:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244380 with x1830881261023232 ext(1048576->2097151) 00002000:00010000:2.0:1746065122.905963:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094244380 00000100:00100000:0.0:1746065122.908392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.908870:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261023360 00000100:00100000:2.0:1746065122.908878:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261023360 00000100:00100000:2.0:1746065122.908921:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10736 00000100:00100000:2.0:1746065122.908929:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:28971:x1830881261023360:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.908945:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.908958:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afd1 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.908979:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.908981:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.908987:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd1 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.908999:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd1 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.909008:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d38400, rc 0) 00000100:00100000:2.0:1746065122.909737:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:28971:x1830881261023360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 806us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.909744:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10736 00000100:00100000:0.0:1746065122.913675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.914040:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261023488 00000100:00100000:2.0:1746065122.914048:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261023488 00000100:00100000:2.0:1746065122.914084:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10737 00000100:00100000:2.0:1746065122.914090:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28972:x1830881261023488:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.914106:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.914121:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afd8 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.914144:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.914146:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.914152:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd8 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.914170:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd8 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.914178:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d39a00, rc 0) 00000100:00100000:2.0:1746065122.914232:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28972:x1830881261023488:12345-192.168.202.46@tcp:101:cat.0 Request processed in 141us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.914238:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10737 00000100:00100000:0.0:1746065122.915100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.915163:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261023744 00000100:00100000:2.0:1746065122.915167:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261023744 00002000:00100000:2.0:1746065122.915192:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094246a00 x1830881261023744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.915200:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094246a00 with x1830881261023744 ext(1048576->2097151) 00002000:00010000:2.0:1746065122.915205:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094246a00 00000100:00100000:2.0:1746065122.915233:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4905 00000100:00100000:2.0:1746065122.915238:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881261023744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065122.918682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.918943:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261024000 00000100:00100000:3.0:1746065122.918951:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261024000 00002000:00100000:3.0:1746065122.918987:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094247800 x1830881261024000/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.919003:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094247800 with x1830881261024000 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.919008:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094247800 00000100:00100000:3.0:1746065122.919026:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4906 00000100:00100000:3.0:1746065122.919033:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881261024000:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065122.924949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.927367:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261024256 00000100:00100000:3.0:1746065122.927379:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261024256 00000100:00100000:2.0:1746065122.927714:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881261023744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12474us (12614us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065122.927724:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4905 00002000:00100000:2.0:1746065122.927732:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094246a00 x1830881261023744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065122.927741:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094246a00 with x1830881261023744 ext(1048576->2097151) 00002000:00010000:2.0:1746065122.927747:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094246a00 00000100:00100000:1.0:1746065122.927785:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9022 00000100:00100000:1.0:1746065122.927797:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:28967:x1830881261024256:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065122.927832:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065122.927835:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065122.927856:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f30c9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa0 expref: 11 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.927872:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.927876:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065122.927885:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c600/0x14b4f8542d4f3116 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afdf expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.927929:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.927941:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af76 expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.927947:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af99 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.927953:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa7 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.927958:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 6/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.927981:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa7 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.927991:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa7 expref: 250 pid: 14644 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.928001:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723008:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.928060:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af99 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.928067:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af99 expref: 250 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.928074:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff20e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723136:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065122.928095:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af76 expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065122.928103:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af76 expref: 7 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.928110:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723264:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.928124:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.931884:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.931910:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261024384 00000100:00100000:0.0:1746065122.931917:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261024384 00010000:00010000:0.0:1746065122.931960:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa7 expref: 251 pid: 14644 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.932080:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723008:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065122.932089:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff20e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723136:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.932469:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881261024000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13435us (13794us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065122.932479:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4906 00002000:00100000:3.0:1746065122.932486:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094247800 x1830881261024000/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.932494:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094247800 with x1830881261024000 ext(1048576->2097151) 00002000:00010000:3.0:1746065122.932497:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094247800 00000100:00100000:3.0:1746065122.932532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.933440:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.933456:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261024512 00000100:00100000:0.0:1746065122.933461:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261024512 00000100:00100000:2.0:1746065122.933521:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5338 00000100:00100000:2.0:1746065122.933530:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:1960:x1830881261024384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.933541:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.933548:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa7 expref: 252 pid: 14644 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.933559:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa7 expref: 252 pid: 14644 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.933577:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38c00/0x14b4f8542d4f30de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afa7 expref: 252 pid: 14644 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.933596:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.933600:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.933606:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065122.933610:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.933631:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881261024384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 103us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.933636:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5338 00000100:00100000:0.0:1746065122.933644:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723264:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065122.933666:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.933945:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af99 expref: 250 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.933977:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5339 00000100:00100000:1.0:1746065122.933982:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1961:x1830881261024512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.933989:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.933993:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af99 expref: 250 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.934000:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af99 expref: 250 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.934011:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38200/0x14b4f8542d4f30bb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af99 expref: 250 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.934021:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.934028:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.934036:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.934041:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.934058:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:1961:x1830881261024512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.934063:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5339 00000100:00100000:1.0:1746065122.934383:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261024640 00000100:00100000:1.0:1746065122.934386:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261024640 00010000:00010000:1.0:1746065122.934398:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af76 expref: 8 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.934413:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5340 00000100:00100000:1.0:1746065122.934418:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261024640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.934425:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.934429:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af76 expref: 8 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.934436:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af76 expref: 8 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.934446:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d38600/0x14b4f8542d4f3052 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af76 expref: 8 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065122.934455:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065122.934458:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.934468:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.934473:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.934487:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.934502:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261024640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 83us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.934507:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5340 00010000:00010000:1.0:1746065122.934525:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065122.934530:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:02000000:1.0:1746065122.934566:0:16767:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:3.0:1746065122.934880:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.934896:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261024768 00000100:00100000:3.0:1746065122.934899:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261024768 00000100:00100000:3.0:1746065122.934919:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9023 00000100:00100000:3.0:1746065122.934924:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:28971:x1830881261024768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.934936:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.934945:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afe6 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.934979:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.934985:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.934995:0:14644:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065122.935003:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.935011:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.935014:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065122.935016:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.935022:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd8a600, rc 0) 00000100:00100000:3.0:1746065122.935047:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:28971:x1830881261024768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 123us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.935052:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9023 00000040:00080000:1.0:1746065122.935394:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2529, 88 off212368 00000004:00080000:1.0:1746065122.935400:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722226584072ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.935646:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2470, 88 off207000 00000004:00080000:1.0:1746065122.935650:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722226834957ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.935675:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2471, 88 off207088 00000004:00080000:1.0:1746065122.935678:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722226862257ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.935685:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2530, 88 off212456 00000004:00080000:1.0:1746065122.935687:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722226872218ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.935692:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2531, 88 off212544 00000004:00080000:1.0:1746065122.935694:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722226879195ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.935849:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2472, 88 off207176 00000004:00080000:1.0:1746065122.935858:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722227042097ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.936179:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2473, 88 off207264 00000004:00080000:1.0:1746065122.936185:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722227369476ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.936196:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2474, 88 off207352 00000004:00080000:1.0:1746065122.936200:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722227384476ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.936212:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2532, 88 off212632 00000004:00080000:1.0:1746065122.936215:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722227399438ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.937077:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2475, 88 off207440 00000004:00080000:1.0:1746065122.937082:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722228266586ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.937091:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2533, 88 off212720 00000004:00080000:1.0:1746065122.937094:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722228278353ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.937100:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2476, 88 off207528 00000004:00080000:1.0:1746065122.937102:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722228286726ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065122.937108:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2534, 88 off212808 00000004:00080000:1.0:1746065122.937110:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722228294898ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.937116:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2535, 88 off212896 00000004:00080000:1.0:1746065122.937119:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722228303288ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.937166:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2537, 88 off213080 00000004:00080000:1.0:1746065122.937169:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722228353831ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.937177:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2538, 88 off213168 00000004:00080000:1.0:1746065122.937179:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 722228363796ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065122.937186:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2477, 88 off207616 00000004:00080000:1.0:1746065122.937188:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722228372695ns, next at 666938887344ns, rc = 0 00000100:00100000:0.0:1746065122.938056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.938182:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261024896 00000100:00100000:3.0:1746065122.938191:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261024896 00000100:00100000:3.0:1746065122.938236:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9024 00000100:00100000:3.0:1746065122.938245:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28972:x1830881261024896:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.938263:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.938279:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5afed expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.938328:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.938351:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.938362:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065122.938364:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065122.938368:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.938375:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd8aa00, rc 0) 00000100:00100000:3.0:1746065122.938424:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28972:x1830881261024896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 178us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065122.938430:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9024 00000001:00080000:3.0:1746065122.961378:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943070 is committed 00000001:00080000:3.0:1746065122.961389:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943073 is committed 00000004:00080000:3.0:1746065122.961391:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1770 committed 00010000:00010000:2.0:1746065122.961465:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.961477:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065122.961480:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065122.961483:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.961496:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.961502:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.961509:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.961516:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.961521:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.961552:0:16767:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.961564:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723392:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.961641:0:16767:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.961649:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723520:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065122.961666:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2d80 going to sleep for 11 seconds 00000004:00080000:3.0:1746065122.961698:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1831 committed 00000004:00080000:3.0:1746065122.961704:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1830 committed 00000004:00080000:3.0:1746065122.961705:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1829 committed 00000004:00080000:3.0:1746065122.961706:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1828 committed 00000004:00080000:3.0:1746065122.961708:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1769 committed 00000004:00080000:3.0:1746065122.961709:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1827 committed 00000004:00080000:3.0:1746065122.961710:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1768 committed 00000004:00080000:3.0:1746065122.961711:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1826 committed 00000004:00080000:3.0:1746065122.961712:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1767 committed 00000004:00080000:3.0:1746065122.961713:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1766 committed 00000004:00080000:3.0:1746065122.961715:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1765 committed 00000004:00080000:3.0:1746065122.961716:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1825 committed 00000004:00080000:3.0:1746065122.961718:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1824 committed 00000004:00080000:3.0:1746065122.961719:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1764 committed 00000004:00080000:3.0:1746065122.961721:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1763 committed 00000004:00080000:3.0:1746065122.961722:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1823 committed 00000001:00080000:3.0:1746065122.961732:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943071 is committed 00000001:00080000:3.0:1746065122.961739:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943067 is committed 00000100:00100000:0.0:1746065122.962131:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259724032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.962164:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.962180:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259724544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.962193:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.962207:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065122.962212:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259723904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.962225:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.962236:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259724416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.962250:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065122.962270:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259724032 00000100:00100000:0.0:1746065122.962276:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259724032 00000100:00100000:0.0:1746065122.962301:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259724544 00000100:00100000:0.0:1746065122.962303:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259724544 00000100:00100000:0.0:1746065122.962311:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259723904 00000100:00100000:0.0:1746065122.962313:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259723904 00000100:00100000:0.0:1746065122.962320:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259724416 00000100:00100000:0.0:1746065122.962322:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259724416 00000100:00100000:0.0:1746065122.962346:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10738 00000100:00100000:0.0:1746065122.962352:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:3296:x1830881259724032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.962653:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259723776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.962674:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.962688:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259724288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.962702:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.962714:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065122.962718:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259723648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.962734:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.962741:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259724160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.962752:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065122.962768:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259723776 00000100:00100000:3.0:1746065122.962770:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259723776 00000100:00100000:3.0:1746065122.962781:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259724288 00000100:00100000:3.0:1746065122.962783:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259724288 00000100:00100000:3.0:1746065122.962788:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259723648 00000100:00100000:3.0:1746065122.962789:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259723648 00000100:00100000:3.0:1746065122.962794:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259724160 00000100:00100000:3.0:1746065122.962795:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259724160 00000100:00100000:3.0:1746065122.962801:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10739 00000100:00100000:3.0:1746065122.962805:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259724544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065122.962958:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259724544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (762us total) trans 21474840041 rc 0/0 00000100:00100000:3.0:1746065122.962967:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10739 00000100:00100000:3.0:1746065122.962983:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10740 00000100:00100000:3.0:1746065122.962987:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259723904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065122.963053:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065122.963056:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.963058:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.963060:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.963061:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746065122.963079:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259723904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (853us total) trans 21474840042 rc 0/0 00000100:00100000:3.0:1746065122.963084:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10740 00000100:00100000:3.0:1746065122.963093:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10741 00000100:00100000:3.0:1746065122.963097:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259724416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065122.963156:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065122.963158:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.963159:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.963161:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.963162:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065122.963179:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259724416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (928us total) trans 21474840043 rc 0/0 00000100:00100000:3.0:1746065122.963185:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10741 00000100:00100000:3.0:1746065122.963194:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10742 00000100:00100000:3.0:1746065122.963199:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3298:x1830881259723776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065122.963260:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065122.963263:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.963265:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.963267:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.963269:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065122.963288:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3298:x1830881259723776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (614us total) trans 21474840044 rc 0/0 00000100:00100000:3.0:1746065122.963293:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10742 00000100:00100000:3.0:1746065122.963302:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10743 00000100:00100000:3.0:1746065122.963306:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3298:x1830881259724288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065122.963374:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065122.963376:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.963378:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.963380:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.963381:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065122.963397:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3298:x1830881259724288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (694us total) trans 21474840045 rc 0/0 00000100:00100000:3.0:1746065122.963402:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10743 00000100:00100000:3.0:1746065122.963409:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10744 00000100:00100000:3.0:1746065122.963413:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3298:x1830881259723648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065122.963471:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065122.963474:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.963475:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.963477:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065122.963478:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065122.963495:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3298:x1830881259723648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (760us total) trans 21474840046 rc 0/0 00000100:00100000:3.0:1746065122.963499:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10744 00000100:00100000:3.0:1746065122.963507:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10745 00000100:00100000:3.0:1746065122.963511:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3298:x1830881259724160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065122.963570:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:3.0:1746065122.963572:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065122.963574:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065122.963575:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065122.963577:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:3.0:1746065122.963593:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3298:x1830881259724160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (841us total) trans 21474840047 rc 0/0 00000100:00100000:3.0:1746065122.963598:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10745 00000004:00080000:3.0:1746065122.963626:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff20e00/2, rc 0, transno 21474840046 00000100:00100000:3.0:1746065122.963630:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259723648:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065122.963637:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d3100/2, rc 0, transno 21474840047 00000100:00100000:3.0:1746065122.963639:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259724160:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065122.963645:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff20a80/2, rc 0, transno 21474840044 00000100:00100000:3.0:1746065122.963647:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259723776:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065122.963652:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d3480/2, rc 0, transno 21474840045 00000100:00100000:3.0:1746065122.963654:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259724288:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065122.963667:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d2d80/2, rc 0, transno 21474840042 00000100:00100000:3.0:1746065122.963669:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259723904:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065122.963674:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d1f80/2, rc 0, transno 21474840043 00000100:00100000:3.0:1746065122.963676:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259724416:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065122.963681:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d0000/2, rc 0, transno 21474840041 00000100:00100000:3.0:1746065122.963684:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259724544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.964026:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259724032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1674us (1861us total) trans 21474840048 rc 0/0 00000100:00100000:0.0:1746065122.964031:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10738 00000100:00100000:0.0:1746065122.964256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.964278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.964733:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259724672:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.964755:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.964786:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259725184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.964799:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.964809:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065122.964834:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259724800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.964851:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.964862:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259725312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.964873:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.964888:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259724928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.964901:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.964911:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259725440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.964922:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.964932:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065122.964935:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259725056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.964947:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.964956:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259725568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.964968:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065122.964986:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259724672 00000100:00100000:2.0:1746065122.964991:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259724672 00000100:00100000:2.0:1746065122.965011:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259725184 00000100:00100000:2.0:1746065122.965013:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259725184 00000100:00100000:2.0:1746065122.965019:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259724800 00000100:00100000:2.0:1746065122.965020:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259724800 00000100:00100000:2.0:1746065122.965027:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259725312 00000100:00100000:2.0:1746065122.965028:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259725312 00000100:00100000:2.0:1746065122.965033:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259724928 00000100:00100000:2.0:1746065122.965034:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259724928 00000100:00100000:2.0:1746065122.965040:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259725440 00000100:00100000:2.0:1746065122.965041:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259725440 00000100:00100000:2.0:1746065122.965046:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259725056 00000100:00100000:2.0:1746065122.965047:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259725056 00000100:00100000:2.0:1746065122.965052:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259725568 00000100:00100000:2.0:1746065122.965053:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259725568 00000100:00100000:2.0:1746065122.965061:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10746 00000100:00100000:2.0:1746065122.965065:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3297:x1830881259724672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065122.965180:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065122.965183:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065122.965185:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065122.965186:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065122.965188:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:2.0:1746065122.965211:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3297:x1830881259724672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 145us (454us total) trans 17179872809 rc 0/0 00000100:00100000:2.0:1746065122.965217:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10746 00000100:00100000:2.0:1746065122.965229:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10747 00000100:00100000:2.0:1746065122.965233:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3297:x1830881259725184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065122.965294:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065122.965296:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.965297:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.965299:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065122.965300:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065122.965318:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3297:x1830881259725184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (517us total) trans 17179872810 rc 0/0 00000100:00100000:1.0:1746065122.965375:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10748 00000100:00100000:1.0:1746065122.965381:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3297:x1830881259724800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065122.965455:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065122.965457:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.965459:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.965461:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.965462:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065122.965483:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3297:x1830881259724800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (631us total) trans 17179872811 rc 0/0 00000100:00100000:1.0:1746065122.965487:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10748 00000100:00100000:1.0:1746065122.965498:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10749 00000100:00100000:1.0:1746065122.965503:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3297:x1830881259725312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065122.965559:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065122.965561:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.965563:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.965564:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.965566:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065122.965583:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3297:x1830881259725312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (709us total) trans 17179872812 rc 0/0 00000100:00100000:1.0:1746065122.965588:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10749 00000100:00100000:1.0:1746065122.965597:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10750 00000100:00100000:1.0:1746065122.965601:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3295:x1830881259724928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065122.965661:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:1.0:1746065122.965663:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.965664:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.965666:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065122.965668:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5699 -> 5699 00000100:00100000:1.0:1746065122.965688:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3295:x1830881259724928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (786us total) trans 17179872813 rc 0/0 00000100:00100000:1.0:1746065122.965693:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10750 00000100:00100000:1.0:1746065122.965701:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10751 00000100:00100000:1.0:1746065122.965705:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3295:x1830881259725440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065122.965777:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3295:x1830881259725440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (854us total) trans 17179872814 rc 0/0 00000100:00100000:1.0:1746065122.965782:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10751 00000100:00100000:1.0:1746065122.965790:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10752 00000100:00100000:1.0:1746065122.965794:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3295:x1830881259725056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065122.965860:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065122.965862:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.965863:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.965865:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065122.965866:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065122.965881:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3295:x1830881259725056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (933us total) trans 17179872815 rc 0/0 00000100:00100000:1.0:1746065122.965885:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10752 00000100:00100000:1.0:1746065122.965892:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10753 00000100:00100000:1.0:1746065122.965895:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3295:x1830881259725568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065122.965955:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3295:x1830881259725568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (986us total) trans 17179872816 rc 0/0 00000100:00100000:1.0:1746065122.965959:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10753 00000004:00080000:1.0:1746065122.965989:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fbb80/2, rc 0, transno 17179872815 00000100:00100000:1.0:1746065122.965997:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259725056:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065122.966003:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fb100/2, rc 0, transno 17179872816 00000100:00100000:1.0:1746065122.966006:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259725568:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065122.966011:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3e300/2, rc 0, transno 17179872813 00000100:00100000:1.0:1746065122.966013:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259724928:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065122.966019:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fa300/2, rc 0, transno 17179872814 00000100:00100000:1.0:1746065122.966021:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259725440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065122.966174:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261025024 00000100:00100000:0.0:1746065122.966178:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261025024 00000100:00100000:0.0:1746065122.966198:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261025152 00000100:00100000:0.0:1746065122.966201:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261025152 00000100:00100000:0.0:1746065122.966214:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3678 00000100:00100000:0.0:1746065122.966219:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:28971:x1830881261025024:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065122.966307:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:28971:x1830881261025024:12345-192.168.202.46@tcp:49:cat.0 Request processed in 86us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.966312:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3678 00000100:00100000:0.0:1746065122.966326:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3679 00000100:00100000:0.0:1746065122.966330:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28972:x1830881261025152:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065122.966579:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28972:x1830881261025152:12345-192.168.202.46@tcp:49:cat.0 Request processed in 247us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.966584:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3679 00000100:00100000:0.0:1746065122.966624:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723392:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065122.966634:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259723520:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065122.966664:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c600/0x14b4f8542d4f3116 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 10 pid: 16767 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065122.966682:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.966700:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505c800, rc 0) 00000100:00100000:0.0:1746065122.966717:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:28967:x1830881261024256:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 38925us (41780us total) trans 8589943073 rc 0/0 00000100:00100000:0.0:1746065122.966723:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9022 00000100:00100000:2.0:1746065122.966794:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10747 00000100:00100000:2.0:1746065122.966838:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259725696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.966863:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065122.966886:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3f480/2, rc 0, transno 17179872811 00000100:00100000:2.0:1746065122.966889:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259724800:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065122.966896:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fb480/2, rc 0, transno 17179872812 00000100:00100000:2.0:1746065122.966898:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259725312:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065122.966904:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3ed80/2, rc 0, transno 17179872809 00000100:00100000:2.0:1746065122.966906:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259724672:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065122.966912:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f8a80/2, rc 0, transno 17179872810 00000100:00100000:2.0:1746065122.966913:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259725184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.966925:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259725696 00000100:00100000:2.0:1746065122.966927:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259725696 00000100:00100000:2.0:1746065122.966941:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10754 00000100:00100000:2.0:1746065122.966945:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:3297:x1830881259725696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065122.967036:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3297:x1830881259725696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (172us total) trans 17179872817 rc 0/0 00000100:00100000:2.0:1746065122.967041:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10754 00000004:00080000:2.0:1746065122.967061:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7adc00/2, rc 0, transno 17179872817 00000100:00100000:2.0:1746065122.967064:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259725696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065122.967228:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3d1c00/2, rc 0, transno 21474840048 00000100:00100000:3.0:1746065122.967232:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259724032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065122.975769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.975859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.975906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.975924:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261025408 00000100:00100000:2.0:1746065122.975933:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261025408 00000100:00100000:3.0:1746065122.976006:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261025280 00000100:00100000:3.0:1746065122.976011:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261025280 00000100:00100000:3.0:1746065122.976039:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3680 00000100:00100000:2.0:1746065122.976041:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261025536 00000100:00100000:2.0:1746065122.976043:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261025536 00000100:00100000:3.0:1746065122.976046:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28969:x1830881261025280:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:2.0:1746065122.976058:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10755 00000100:00100000:2.0:1746065122.976062:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+20:28967:x1830881261025408:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065122.976071:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.976086:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5aff4 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.976111:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af61 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.976119:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd8 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.976125:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd1 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.976131:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.976132:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.976135:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1257472->1957887] (req 1257472->1957887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 21 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.976154:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28969:x1830881261025280:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 107us (421us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065122.976159:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd1 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.976160:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3680 00010000:00010000:2.0:1746065122.976169:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd1 expref: 21 pid: 8851 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065122.976179:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259725824:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065122.976198:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10756 00000100:00100000:3.0:1746065122.976204:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:28971:x1830881261025536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065122.976211:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065122.976219:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5affb expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.976231:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065122.976232:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.976236:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd8 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065122.976237:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5affb expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.976244:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd8 expref: 31 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.976248:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5affb expref: 22 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.976252:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259725952:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065122.976256:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c871000, rc 0) 00000100:00100000:3.0:1746065122.976273:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+22:28971:x1830881261025536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 69us (366us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065122.976273:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af61 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.976280:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af61 expref: 13 pid: 4545 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746065122.976281:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10756 00000100:00100000:2.0:1746065122.976437:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259726080:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.976469:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.977382:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259725824:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.977390:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259725952:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.977396:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259726080:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.977412:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1257472->1957887] (req 1257472->1957887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 21 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.977421:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d39000, rc 0) 00000100:00100000:2.0:1746065122.977666:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+21:28967:x1830881261025408:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1602us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.977672:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10755 00000100:00100000:0.0:1746065122.978095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.978131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.978165:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261025664 00000100:00100000:3.0:1746065122.978169:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261025664 00010000:00010000:3.0:1746065122.978186:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd1 expref: 21 pid: 8851 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065122.978209:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261025792 00000100:00100000:3.0:1746065122.978211:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261025792 00010000:00010000:3.0:1746065122.978220:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af61 expref: 14 pid: 4545 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746065122.978227:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5341 00000100:00100000:0.0:1746065122.978234:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261025664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065122.978243:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065122.978250:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5342 00000100:00100000:3.0:1746065122.978254:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881261025792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065122.978259:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065122.978260:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd1 expref: 21 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.978265:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af61 expref: 14 pid: 4545 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746065122.978269:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd1 expref: 21 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.978281:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af61 expref: 14 pid: 4545 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746065122.978296:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d38400/0x14b4f8542d4f3108 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd1 expref: 21 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065122.978299:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f2ffe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af61 expref: 14 pid: 4545 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065122.978306:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065122.978306:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065122.978328:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881261025792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.978328:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261025664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.978343:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5341 00000100:00100000:3.0:1746065122.978347:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5342 00000100:00100000:0.0:1746065122.978462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.978672:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261025920 00000100:00100000:2.0:1746065122.978675:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261025920 00010000:00010000:2.0:1746065122.978688:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd8 expref: 32 pid: 8851 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065122.978719:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5343 00000100:00100000:2.0:1746065122.978725:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261025920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.978731:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.978739:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd8 expref: 32 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.978747:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd8 expref: 32 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.978758:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d39a00/0x14b4f8542d4f310f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afd8 expref: 32 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.978766:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.978767:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.978772:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.978779:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.978797:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065122.978805:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259726208:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065122.979438:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.980398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.980466:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261026176 00000100:00100000:3.0:1746065122.980472:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261026176 00002000:00100000:3.0:1746065122.980499:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ba3c700 x1830881261026176/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.980507:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c700 with x1830881261026176 ext(2097152->3145727) 00002000:00010000:3.0:1746065122.980512:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3c700 00000100:00100000:3.0:1746065122.980544:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4907 00000100:00100000:3.0:1746065122.980553:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261026176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065122.981366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.981384:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.981618:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261026304 00000100:00100000:2.0:1746065122.981623:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261026304 00000100:00100000:2.0:1746065122.982315:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261026432 00000100:00100000:2.0:1746065122.982319:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261026432 00000100:00100000:2.0:1746065122.982352:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10757 00000100:00100000:2.0:1746065122.982359:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28969:x1830881261026304:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065122.982372:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.982386:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b009 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.982409:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af53 expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.982416:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afbc expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.982423:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afb5 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.982428:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.982430:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.982433:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [1122304->2093055] (req 1122304->2093055) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.982456:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afb5 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.982466:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afb5 expref: 24 pid: 8851 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065122.982476:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259726336:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.982543:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afbc expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.982551:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afbc expref: 31 pid: 8851 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065122.982558:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259726464:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.982582:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af53 expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065122.982589:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af53 expref: 17 pid: 4545 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746065122.982596:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259726592:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.982619:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065122.982645:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259726208:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065122.982659:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065122.982685:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261025920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3959us (4223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.982758:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10758 00000100:00100000:0.0:1746065122.982766:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28972:x1830881261026432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065122.982773:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065122.982781:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b002 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.982791:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065122.982792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065122.982792:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065122.982797:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b002 expref: 33 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.982807:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b002 expref: 33 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065122.982837:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261026688 00000100:00100000:3.0:1746065122.982841:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261026688 00000100:00100000:2.0:1746065122.982843:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5343 00002000:00100000:3.0:1746065122.982861:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1257472->1261567) req@ffff88009b9fea00 x1830881261026688/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.982869:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fea00 with x1830881261026688 ext(1257472->1261567) 00002000:00010000:3.0:1746065122.982872:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fea00 00000100:00100000:3.0:1746065122.982889:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4908 00000100:00100000:3.0:1746065122.982894:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261026688:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:0.0:1746065122.982932:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009118e600, rc 0) 00000100:00100000:0.0:1746065122.982953:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28972:x1830881261026432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 189us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065122.982958:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10758 00000100:00100000:3.0:1746065122.982983:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261026688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 88us (190us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065122.982988:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4908 00002000:00100000:3.0:1746065122.982993:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1257472->1261567) req@ffff88009b9fea00 x1830881261026688/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.982999:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fea00 with x1830881261026688 ext(1257472->1261567) 00002000:00010000:3.0:1746065122.983002:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fea00 00000100:00100000:0.0:1746065122.986849:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.986922:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259726336:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.986932:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259726464:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065122.986940:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259726592:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065122.986964:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [1122304->2093055] (req 1122304->2093055) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.986975:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d39800, rc 0) 00000100:00100000:2.0:1746065122.987014:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28969:x1830881261026304:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4655us (5648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.987020:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10757 00000100:00100000:0.0:1746065122.988000:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261026816 00000100:00100000:0.0:1746065122.988006:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261026816 00010000:00010000:0.0:1746065122.988026:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afbc expref: 31 pid: 8851 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746065122.988055:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5344 00000100:00100000:0.0:1746065122.988061:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261026816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065122.988070:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065122.988085:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afbc expref: 31 pid: 8851 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065122.988091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.988104:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261026944 00000100:00100000:2.0:1746065122.988108:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261026944 00000100:00100000:1.0:1746065122.988115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065122.988121:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af53 expref: 18 pid: 4545 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746065122.988128:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261027072 00000100:00100000:1.0:1746065122.988131:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261027072 00000100:00100000:2.0:1746065122.988136:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5345 00000100:00100000:2.0:1746065122.988140:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1961:x1830881261026944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065122.988142:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afb5 expref: 25 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.988146:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065122.988153:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af53 expref: 18 pid: 4545 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746065122.988156:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5346 00000100:00100000:1.0:1746065122.988160:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261027072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065122.988163:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af53 expref: 18 pid: 4545 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746065122.988165:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065122.988171:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afb5 expref: 25 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.988180:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f2ff7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af53 expref: 18 pid: 4545 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746065122.988188:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afb5 expref: 25 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065122.988194:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065122.988198:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261026176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7645us (7801us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746065122.988199:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d39400/0x14b4f8542d4f30ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afb5 expref: 25 pid: 8851 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065122.988205:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4907 00000100:00100000:2.0:1746065122.988209:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1961:x1830881261026944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065122.988209:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065122.988212:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009ba3c700 x1830881261026176/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065122.988214:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5345 00000100:00100000:1.0:1746065122.988219:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261027072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (104us total) trans 0 rc 0/0 00002000:00100000:3.0:1746065122.988220:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c700 with x1830881261026176 ext(2097152->3145727) 00002000:00010000:3.0:1746065122.988224:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3c700 00000100:00100000:1.0:1746065122.988226:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5346 00010000:00010000:0.0:1746065122.988267:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afbc expref: 31 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746065122.988279:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982b7000/0x14b4f8542d4f30f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afbc expref: 31 pid: 8851 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746065122.988288:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065122.988289:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065122.988295:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.988301:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065122.988406:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065122.988416:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259726720:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065122.988483:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065122.990591:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065122.991232:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261027328 00000100:00100000:3.0:1746065122.991239:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261027328 00002000:00100000:3.0:1746065122.991270:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88008fd05f80 x1830881261027328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.991278:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05f80 with x1830881261027328 ext(2097152->3145727) 00002000:00010000:3.0:1746065122.991281:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05f80 00000100:00100000:3.0:1746065122.991310:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4909 00000100:00100000:3.0:1746065122.991316:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261027328:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065122.991723:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259726720:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065122.991740:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065122.991784:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261026816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3722us (4975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065122.991791:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5344 00000100:00100000:0.0:1746065122.993848:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065122.993903:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065122.993973:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261027456 00000100:00100000:2.0:1746065122.993980:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261027456 00000100:00100000:2.0:1746065122.994011:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10759 00000100:00100000:2.0:1746065122.994017:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:28971:x1830881261027456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065122.994033:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065122.994048:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b010 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.994067:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.994068:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065122.994075:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b010 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.994087:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b010 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065122.994096:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd37200, rc 0) 00000100:00100000:2.0:1746065122.994123:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:28971:x1830881261027456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065122.994128:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10759 00000100:00100000:3.0:1746065122.994191:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261027712 00000100:00100000:3.0:1746065122.994195:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261027712 00002000:00100000:3.0:1746065122.994219:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1953792->1957887) req@ffff88008fd04a80 x1830881261027712/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/0 e 0 to 0 dl 1746065133 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.994227:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04a80 with x1830881261027712 ext(1953792->1957887) 00002000:00010000:3.0:1746065122.994231:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04a80 00000100:00100000:3.0:1746065122.994244:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4910 00000100:00100000:3.0:1746065122.994249:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261027712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065122.995197:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261027712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 945us (1291us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065122.995203:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4910 00002000:00100000:3.0:1746065122.995208:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1953792->1957887) req@ffff88008fd04a80 x1830881261027712/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:38/0 lens 488/4536 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065122.995214:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04a80 with x1830881261027712 ext(1953792->1957887) 00002000:00010000:3.0:1746065122.995217:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04a80 00000100:00100000:0.0:1746065123.000993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.001081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.001208:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261027968 00000100:00100000:2.0:1746065123.001216:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261027968 00000100:00100000:2.0:1746065123.001261:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3681 00000100:00100000:2.0:1746065123.001268:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:28967:x1830881261027968:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065123.001498:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:28967:x1830881261027968:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 229us (512us total) trans 8589943074 rc 0/0 00000100:00100000:2.0:1746065123.001503:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3681 00000100:00100000:2.0:1746065123.001522:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261028224 00000100:00100000:2.0:1746065123.001525:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261028224 00002000:00100000:2.0:1746065123.001544:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (2088960->2093055) req@ffff88008fd05500 x1830881261028224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.001552:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05500 with x1830881261028224 ext(2088960->2093055) 00002000:00010000:2.0:1746065123.001556:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05500 00000100:00100000:2.0:1746065123.001568:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4911 00000100:00100000:2.0:1746065123.001572:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881261028224:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.001663:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881261028224:12345-192.168.202.46@tcp:3:cat.0 Request processed in 90us (581us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065123.001668:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4911 00002000:00100000:2.0:1746065123.001672:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (2088960->2093055) req@ffff88008fd05500 x1830881261028224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/4536 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.001678:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05500 with x1830881261028224 ext(2088960->2093055) 00002000:00010000:2.0:1746065123.001680:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05500 00000100:00100000:3.0:1746065123.002025:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261027328:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10708us (11439us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.002031:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4909 00002000:00100000:3.0:1746065123.002035:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88008fd05f80 x1830881261027328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:38/0 lens 488/440 e 0 to 0 dl 1746065133 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.002042:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05f80 with x1830881261027328 ext(2097152->3145727) 00002000:00010000:3.0:1746065123.002044:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05f80 00000100:00100000:0.0:1746065123.006067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.006412:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.006466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.006563:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261028480 00000100:00100000:2.0:1746065123.006570:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261028480 00002000:00100000:2.0:1746065123.006616:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88008fd04e00 x1830881261028480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.006627:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04e00 with x1830881261028480 ext(2097152->3145727) 00002000:00010000:2.0:1746065123.006631:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd04e00 00000100:00100000:2.0:1746065123.006642:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261028736 00000100:00100000:2.0:1746065123.006644:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261028736 00002000:00100000:2.0:1746065123.006651:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009baa3100 x1830881261028736/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.006657:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3100 with x1830881261028736 ext(3145728->4194303) 00002000:00010000:2.0:1746065123.006659:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa3100 00000100:00100000:2.0:1746065123.006668:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4912 00000100:00100000:2.0:1746065123.006674:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261028480:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065123.006891:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4913 00000100:00100000:3.0:1746065123.007580:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261028736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065123.008033:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261028992 00000100:00100000:1.0:1746065123.008038:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261028992 00000100:00100000:1.0:1746065123.008073:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3682 00000100:00100000:1.0:1746065123.008079:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:28969:x1830881261028992:12345-192.168.202.46@tcp:35:multiop.0 00000100:00080000:2.0:1746065123.010279:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746065123.010286:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065123.010489:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.011054:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28969:x1830881261028992:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 2972us (4584us total) trans 8589943075 rc 0/0 00000100:00100000:1.0:1746065123.011066:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3682 00000100:00100000:1.0:1746065123.011126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.011176:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261029376 00000100:00100000:1.0:1746065123.011183:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261029376 00000100:00100000:1.0:1746065123.011223:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10760 00000100:00100000:1.0:1746065123.011229:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28972:x1830881261029376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065123.011246:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.011262:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b017 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.011286:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.011287:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.011295:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b017 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.011313:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b017 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.011323:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc0800, rc 0) 00000100:00100000:1.0:1746065123.011370:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28972:x1830881261029376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 141us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.011375:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10760 00000100:00100000:1.0:1746065123.012840:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261029248 00000100:00100000:1.0:1746065123.012847:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261029248 00000100:00080000:2.0:1746065123.012867:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:1.0:1746065123.012883:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88008fc5a300 x1830881261029248/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.012892:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5a300 with x1830881261029248 ext(3145728->4194303) 00002000:00010000:1.0:1746065123.012897:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5a300 00000100:00100000:1.0:1746065123.012910:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4914 00000100:00100000:1.0:1746065123.012916:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261029248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.019245:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261028480:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12561us (13176us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.019256:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4912 00002000:00100000:2.0:1746065123.019266:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88008fd04e00 x1830881261028480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.019274:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04e00 with x1830881261028480 ext(2097152->3145727) 00002000:00010000:2.0:1746065123.019279:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd04e00 00000100:00100000:3.0:1746065123.023776:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261028736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16871us (17356us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.023788:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4913 00002000:00100000:3.0:1746065123.023798:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009baa3100 x1830881261028736/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.023807:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3100 with x1830881261028736 ext(3145728->4194303) 00002000:00010000:3.0:1746065123.023835:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa3100 00000100:00100000:1.0:1746065123.024543:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261029248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11626us (14056us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065123.024550:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4914 00002000:00100000:1.0:1746065123.024555:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88008fc5a300 x1830881261029248/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.024562:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5a300 with x1830881261029248 ext(3145728->4194303) 00002000:00010000:1.0:1746065123.024566:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5a300 00000100:00100000:0.0:1746065123.028197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.028247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.028400:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261029760 00000100:00100000:1.0:1746065123.028408:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261029760 00000100:00100000:3.0:1746065123.028439:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261029888 00000100:00100000:3.0:1746065123.028442:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261029888 00002000:00100000:1.0:1746065123.028447:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880095355880 x1830881261029760/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.028456:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355880 with x1830881261029760 ext(2097152->3145727) 00002000:00100000:3.0:1746065123.028460:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880095355f80 x1830881261029888/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746065123.028461:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355880 00002000:00100000:3.0:1746065123.028465:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355f80 with x1830881261029888 ext(3145728->4194303) 00002000:00010000:3.0:1746065123.028467:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355f80 00000100:00100000:1.0:1746065123.028488:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4915 00000100:00100000:3.0:1746065123.028491:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4916 00000100:00100000:1.0:1746065123.028494:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261029760:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065123.028495:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261029888:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.033513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.033606:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261030144 00000100:00100000:2.0:1746065123.033614:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261030144 00002000:00100000:2.0:1746065123.033654:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880095354000 x1830881261030144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.033664:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354000 with x1830881261030144 ext(3145728->4194303) 00002000:00010000:2.0:1746065123.033668:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354000 00000100:00100000:2.0:1746065123.033685:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4917 00000100:00100000:2.0:1746065123.033692:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261030144:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.039404:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.039559:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261030272 00000100:00100000:2.0:1746065123.039569:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261030272 00000100:00100000:2.0:1746065123.039609:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10761 00000100:00100000:2.0:1746065123.039616:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261030272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.039636:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.039652:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f315c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b01e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.039702:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259726848:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065123.039793:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065123.040108:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261029760:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11612us (11917us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065123.040117:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4915 00002000:00100000:1.0:1746065123.040125:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880095355880 x1830881261029760/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.040133:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355880 with x1830881261029760 ext(2097152->3145727) 00002000:00010000:1.0:1746065123.040137:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355880 00000100:00100000:3.0:1746065123.044253:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261029888:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15748us (15997us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.044263:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4916 00002000:00100000:3.0:1746065123.044273:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880095355f80 x1830881261029888/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.044283:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355f80 with x1830881261029888 ext(3145728->4194303) 00002000:00010000:3.0:1746065123.044288:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355f80 00000100:00100000:2.0:1746065123.044468:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259726848:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.044492:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f315c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b01e expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.044504:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f315c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b01e expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.044524:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15d000, rc 0) 00000100:00100000:2.0:1746065123.044551:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261030272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4936us (5156us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.044557:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10761 00000100:00100000:2.0:1746065123.047793:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261030144:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14094us (14280us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.047802:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4917 00002000:00100000:2.0:1746065123.047812:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880095354000 x1830881261030144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.047837:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354000 with x1830881261030144 ext(3145728->4194303) 00002000:00010000:2.0:1746065123.047841:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354000 00000100:00100000:0.0:1746065123.048245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.048292:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261030528 00000100:00100000:3.0:1746065123.048300:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261030528 00002000:00100000:3.0:1746065123.048341:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880094244000 x1830881261030528/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.048349:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244000 with x1830881261030528 ext(4194304->5029887) 00002000:00010000:3.0:1746065123.048353:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094244000 00000100:00100000:3.0:1746065123.048367:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4918 00000100:00100000:3.0:1746065123.048373:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1959:x1830881261030528:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065123.053174:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1959:x1830881261030528:12345-192.168.202.46@tcp:3:cat.0 Request processed in 4799us (4928us total) trans 0 rc 835584/835584 00000100:00100000:0.0:1746065123.053174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.053184:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4918 00002000:00100000:3.0:1746065123.053193:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880094244000 x1830881261030528/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.053202:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094244000 with x1830881261030528 ext(4194304->5029887) 00002000:00010000:3.0:1746065123.053207:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094244000 00000100:00100000:2.0:1746065123.053212:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261030656 00000100:00100000:2.0:1746065123.053219:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261030656 00000100:00100000:2.0:1746065123.053246:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10762 00000100:00100000:2.0:1746065123.053252:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261030656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.053265:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.053279:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f3163 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b025 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.053320:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259726976:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065123.053406:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00002000:00010000:2.0:1746065123.055862:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065123 -> 1746065124 00000100:00100000:2.0:1746065123.055883:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259726976:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.055908:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f3163 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b025 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.055920:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd36200/0x14b4f8542d4f3163 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b025 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.055947:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36200, rc 0) 00000100:00100000:2.0:1746065123.055994:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261030656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2740us (2827us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.056001:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10762 00000100:00100000:0.0:1746065123.058236:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.058302:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261030784 00000100:00100000:2.0:1746065123.058309:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261030784 00000100:00100000:2.0:1746065123.058361:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10763 00000100:00100000:2.0:1746065123.058368:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261030784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.058383:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.058396:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f316a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b02c expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.058440:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727104:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065123.058516:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00002000:00010000:2.0:1746065123.059460:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime: 1746065123 -> 1746065124 00000100:00100000:2.0:1746065123.059477:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727104:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.059495:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f316a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b02c expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.059504:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f316a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b02c expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.059524:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36600, rc 0) 00000100:00100000:2.0:1746065123.059555:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261030784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1186us (1325us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.059560:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10763 00000100:00100000:0.0:1746065123.062201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.062403:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261030912 00000100:00100000:2.0:1746065123.062410:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261030912 00000100:00100000:2.0:1746065123.062458:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10764 00000100:00100000:2.0:1746065123.062465:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261030912:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.062482:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.062497:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f3171 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b033 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.062538:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727232:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065123.062618:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.063055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.063308:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261031168 00000100:00100000:3.0:1746065123.063314:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261031168 00002000:00100000:3.0:1746065123.063359:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012f3d3b80 x1830881261031168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.063367:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3b80 with x1830881261031168 ext(4194304->5029887) 00002000:00010000:3.0:1746065123.063372:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d3b80 00000100:00100000:3.0:1746065123.063413:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4919 00000100:00100000:3.0:1746065123.063422:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261031168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.066604:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727232:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.066630:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f3171 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b033 expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.066640:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f3171 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b033 expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.066649:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36400, rc 0) 00000100:00100000:2.0:1746065123.066691:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261030912:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4226us (4496us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.066697:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10764 00000100:00100000:3.0:1746065123.070642:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261031168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7215us (7580us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065123.070651:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4919 00002000:00100000:3.0:1746065123.070661:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012f3d3b80 x1830881261031168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.070669:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3b80 with x1830881261031168 ext(4194304->5029887) 00002000:00010000:3.0:1746065123.070674:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d3b80 00000100:00100000:0.0:1746065123.075787:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.076199:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261031296 00000100:00100000:2.0:1746065123.076209:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261031296 00000100:00100000:2.0:1746065123.076465:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10765 00000100:00100000:2.0:1746065123.076476:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881261031296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.076491:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.076505:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd36800/0x14b4f8542d4f3178 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b03a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.076547:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259727360:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065123.076617:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.079026:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259727360:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.079050:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd36800/0x14b4f8542d4f3178 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b03a expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.079060:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd36800/0x14b4f8542d4f3178 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b03a expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.079226:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36800, rc 0) 00000100:00100000:2.0:1746065123.079279:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881261031296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2803us (3501us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.079286:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10765 00000100:00100000:0.0:1746065123.082955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.083124:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261031424 00000100:00100000:2.0:1746065123.083132:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261031424 00000100:00100000:2.0:1746065123.083173:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10766 00000100:00100000:2.0:1746065123.083180:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261031424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.083194:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.083208:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd36a00/0x14b4f8542d4f317f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b041 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.083254:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259727488:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065123.083324:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.084669:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259727488:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.084690:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd36a00/0x14b4f8542d4f317f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b041 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.084706:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd36a00/0x14b4f8542d4f317f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b041 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.084730:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36a00, rc 0) 00000100:00100000:2.0:1746065123.084768:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261031424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1587us (1820us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.084775:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10766 00000100:00100000:0.0:1746065123.087787:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.087902:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261031680 00000100:00100000:1.0:1746065123.087908:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261031680 00000100:00100000:1.0:1746065123.087941:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3683 00000100:00100000:1.0:1746065123.087947:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:28972:x1830881261031680:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065123.088240:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28972:x1830881261031680:12345-192.168.202.46@tcp:35:cat.0 Request processed in 292us (457us total) trans 8589943076 rc 0/0 00000100:00100000:1.0:1746065123.088247:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3683 00000100:00100000:0.0:1746065123.125737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.125859:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261031936 00000100:00100000:2.0:1746065123.125871:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261031936 00000100:00100000:2.0:1746065123.125913:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9025 00000100:00100000:2.0:1746065123.125921:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:28979:x1830881261031936:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065123.125942:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.125956:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f3186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b048 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.126037:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126047:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126055:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126066:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126071:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126077:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126244:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126252:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126257:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065123.126264:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065123.126326:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126341:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126346:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126351:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd36600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.126354:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126359:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126368:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065123.126371:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065123.126374:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126382:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36600/0x14b4f8542d4f318d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126408:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126413:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126417:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126421:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd36200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.126423:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126427:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126433:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012dc07b00) 00010000:00010000:2.0:1746065123.126435:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065123.126437:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126441:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36200/0x14b4f8542d4f3194 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.126471:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36400/0x14b4f8542d4f3186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b048 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.126481:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b048 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.126491:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.126493:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065123.126495:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36a00, rc 0) 00000100:00100000:2.0:1746065123.126952:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:28979:x1830881261031936:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1030us (1221us total) trans 8589943077 rc 0/0 00000100:00100000:2.0:1746065123.126958:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9025 00000100:00100000:0.0:1746065123.130876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.131007:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261032064 00000100:00100000:2.0:1746065123.131015:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261032064 00000100:00100000:2.0:1746065123.131049:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10767 00000100:00100000:2.0:1746065123.131056:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:28979:x1830881261032064:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065123.131070:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.131084:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b04f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.131107:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af6f expref: 16 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.131115:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b017 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.131121:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b010 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.131126:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.131128:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.131131:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3391488->3420159] (req 3391488->3420159) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.131156:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b010 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.131166:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b010 expref: 26 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.131177:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727616:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.131257:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b017 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.131265:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b017 expref: 30 pid: 21998 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.131272:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727744:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.131297:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af6f expref: 16 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.131304:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af6f expref: 16 pid: 4545 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746065123.131311:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727872:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.131324:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.133860:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727616:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.133870:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727744:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.133876:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259727872:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.133898:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3391488->3420159] (req 3391488->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.133912:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd36800, rc 0) 00000100:00100000:2.0:1746065123.134028:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+26:28979:x1830881261032064:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2972us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.134035:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10767 00000100:00100000:0.0:1746065123.137289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.137539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.137577:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.137599:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261032192 00000100:00100000:2.0:1746065123.137604:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261032320 00000100:00100000:2.0:1746065123.137607:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261032320 00000100:00100000:1.0:1746065123.137607:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261032192 00010000:00010000:1.0:1746065123.137636:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b010 expref: 26 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.137663:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5347 00000100:00100000:1.0:1746065123.137670:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261032192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.137681:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065123.137698:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b010 expref: 26 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065123.137707:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b010 expref: 26 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065123.137725:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd37200/0x14b4f8542d4f314e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b010 expref: 26 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.137914:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261032576 00000100:00100000:3.0:1746065123.137918:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261032576 00000100:00100000:3.0:1746065123.137945:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9026 00000100:00100000:3.0:1746065123.137949:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:28981:x1830881261032576:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065123.137967:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.137978:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870000/0x14b4f8542d4f31b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b056 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.138054:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138064:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138071:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138080:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138085:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138089:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138168:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138174:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138178:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065123.138185:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065123.138247:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138256:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138260:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138265:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c870a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065123.138268:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138273:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138280:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065123.138282:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065123.138285:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138289:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870a00/0x14b4f8542d4f31b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138299:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138304:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138308:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138312:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c871c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065123.138314:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138320:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138325:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f041e00) 00010000:00010000:3.0:1746065123.138327:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065123.138329:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138344:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f31be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.138371:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c870000/0x14b4f8542d4f31b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b056 expref: 253 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.138381:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b056 expref: 252 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.138386:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.138388:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065123.138390:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c871e00, rc 0) 00010000:00010000:1.0:1746065123.138394:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065123.138488:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af6f expref: 17 pid: 4545 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746065123.138518:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5348 00000100:00100000:2.0:1746065123.138527:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1960:x1830881261032320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.138536:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.138545:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af6f expref: 17 pid: 4545 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746065123.138555:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af6f expref: 17 pid: 4545 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746065123.138574:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36c00/0x14b4f8542d4f3005 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af6f expref: 17 pid: 4545 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746065123.138587:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.139444:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:28981:x1830881261032576:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1491us (2159us total) trans 8589943078 rc 0/0 00000100:00100000:3.0:1746065123.139451:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9026 00000100:00100000:1.0:1746065123.139452:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261032192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1781us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.139458:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5347 00000100:00100000:2.0:1746065123.139747:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1960:x1830881261032320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1219us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.139752:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5348 00000100:00100000:0.0:1746065123.140735:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.141243:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261032704 00000100:00100000:2.0:1746065123.141250:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261032704 00010000:00010000:2.0:1746065123.141273:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b017 expref: 31 pid: 21998 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.141307:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5349 00000100:00100000:2.0:1746065123.141313:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881261032704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.141322:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.141349:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b017 expref: 31 pid: 21998 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.141360:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b017 expref: 31 pid: 21998 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.141377:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f3155 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b017 expref: 31 pid: 21998 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.141388:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.141389:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.141395:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.141402:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.141427:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.141437:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259728000:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065123.141499:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.143593:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259728000:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065123.143610:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.143690:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881261032704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2374us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.143698:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5349 00000100:00100000:0.0:1746065123.145412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.145567:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261032960 00000100:00100000:3.0:1746065123.145575:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261032960 00002000:00100000:3.0:1746065123.145609:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3416064->3420159) req@ffff88009f15dc00 x1830881261032960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.145617:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15dc00 with x1830881261032960 ext(3416064->3420159) 00002000:00010000:3.0:1746065123.145622:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15dc00 00000100:00100000:3.0:1746065123.145647:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4920 00000100:00100000:3.0:1746065123.145654:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261032960:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065123.145832:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261032960:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 160us (405us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065123.145838:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4920 00002000:00100000:3.0:1746065123.145843:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3416064->3420159) req@ffff88009f15dc00 x1830881261032960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/4536 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.145849:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15dc00 with x1830881261032960 ext(3416064->3420159) 00002000:00010000:3.0:1746065123.145852:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15dc00 00000100:00100000:0.0:1746065123.148929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.148988:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261033216 00000100:00100000:1.0:1746065123.148994:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261033216 00000100:00100000:1.0:1746065123.149116:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3684 00000100:00100000:1.0:1746065123.149125:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:28979:x1830881261033216:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065123.149363:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:28979:x1830881261033216:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 239us (440us total) trans 8589943079 rc 0/0 00000100:00100000:1.0:1746065123.149369:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3684 00000100:00100000:0.0:1746065123.210453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.210905:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261033472 00000100:00100000:3.0:1746065123.210916:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261033472 00000100:00100000:3.0:1746065123.210965:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9027 00000100:00100000:3.0:1746065123.210975:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:28985:x1830881261033472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.210999:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.211016:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b200/0x14b4f8542d4f31d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b05d expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.211106:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.211120:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.211131:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065123.211142:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065123.211267:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b200/0x14b4f8542d4f31d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b05d expref: 255 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.211315:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b05d expref: 254 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.211322:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.211325:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065123.211328:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd8b000, rc 0) 00000100:00100000:3.0:1746065123.211390:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28985:x1830881261033472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 415us (942us total) trans 8589943080 rc 0/0 00000100:00100000:3.0:1746065123.211396:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9027 00000100:00100000:0.0:1746065123.212871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.213021:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261033600 00000100:00100000:2.0:1746065123.213028:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261033600 00000100:00100000:2.0:1746065123.213086:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10768 00000100:00100000:2.0:1746065123.213095:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261033600:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.213110:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.213124:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b15d600/0x14b4f8542d4f31e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b064 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.213173:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259728128:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065123.213269:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.215387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.215445:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261033728 00000100:00100000:1.0:1746065123.215450:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261033728 00000100:00100000:1.0:1746065123.215485:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10769 00000100:00100000:1.0:1746065123.215491:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261033728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065123.215506:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.215518:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a505dc00/0x14b4f8542d4f31ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b06b expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.215548:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259728256:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065123.215624:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746065123.215855:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065123 -> 1746065124 00002000:00010000:2.0:1746065123.215860:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065123 -> 1746065124 00000100:00100000:2.0:1746065123.215878:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259728128:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.215902:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b15d600/0x14b4f8542d4f31e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b064 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.215913:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b15d600/0x14b4f8542d4f31e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b064 expref: 33 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.215927:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15d600, rc 0) 00000100:00100000:2.0:1746065123.215961:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261033600:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2866us (3091us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.215967:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10768 00002000:00010000:1.0:1746065123.218078:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065123 -> 1746065124 00002000:00010000:1.0:1746065123.218085:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065123 -> 1746065124 00002000:00010000:1.0:1746065123.218087:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065123 -> 1746065124 00000100:00100000:1.0:1746065123.218106:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259728256:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065123.218135:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a505dc00/0x14b4f8542d4f31ef lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b06b expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.218148:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a505dc00/0x14b4f8542d4f31ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b06b expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.218163:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505dc00, rc 0) 00000100:00100000:1.0:1746065123.218227:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261033728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2733us (2841us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065123.218235:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10769 00000100:00100000:0.0:1746065123.225527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.225621:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261033984 00000100:00100000:2.0:1746065123.225627:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261033984 00002000:00100000:2.0:1746065123.225665:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012e8b5880 x1830881261033984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.225674:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5880 with x1830881261033984 ext(0->1048575) 00002000:00010000:2.0:1746065123.225678:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b5880 00000100:00100000:2.0:1746065123.226008:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4921 00000100:00100000:2.0:1746065123.226018:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881261033984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.228625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.228704:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261034240 00000100:00100000:3.0:1746065123.228710:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261034240 00002000:00100000:3.0:1746065123.228742:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd72300 x1830881261034240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 504/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.228751:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72300 with x1830881261034240 ext(1048576->2097151) 00002000:00010000:3.0:1746065123.228756:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72300 00000100:00100000:3.0:1746065123.228788:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4922 00000100:00100000:3.0:1746065123.228796:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881261034240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.229804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.229903:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261034496 00000100:00100000:1.0:1746065123.229908:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261034496 00002000:00100000:1.0:1746065123.229927:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88008fd70700 x1830881261034496/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.229939:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70700 with x1830881261034496 ext(1048576->2097151) 00002000:00010000:1.0:1746065123.229943:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd70700 00000100:00100000:1.0:1746065123.229955:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4923 00000100:00100000:1.0:1746065123.229960:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881261034496:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065123.234976:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881261034240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6174us (6349us total) trans 0 rc 77824/77824 00000100:00100000:3.0:1746065123.234984:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4922 00002000:00100000:3.0:1746065123.234994:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd72300 x1830881261034240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 504/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 77824/77824 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.235002:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72300 with x1830881261034240 ext(1048576->2097151) 00002000:00010000:3.0:1746065123.235007:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72300 00000100:00100000:2.0:1746065123.235541:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881261033984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9525us (10019us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.235548:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4921 00002000:00100000:2.0:1746065123.235553:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012e8b5880 x1830881261033984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.235560:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5880 with x1830881261033984 ext(0->1048575) 00002000:00010000:2.0:1746065123.235564:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b5880 00000100:00100000:1.0:1746065123.238032:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881261034496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8061us (8219us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065123.238043:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4923 00002000:00100000:1.0:1746065123.238054:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88008fd70700 x1830881261034496/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.238062:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70700 with x1830881261034496 ext(1048576->2097151) 00002000:00010000:1.0:1746065123.238067:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd70700 00000100:00100000:0.0:1746065123.245142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.245206:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261034624 00000100:00100000:1.0:1746065123.245213:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261034624 00000100:00100000:2.0:1746065123.246419:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10770 00000100:00100000:2.0:1746065123.246430:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28985:x1830881261034624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.246445:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.246459:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b072 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.246484:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.246491:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065123.246492:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065123.246495:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 33 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.246519:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 19 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.246711:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 19 pid: 21235 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.246725:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259728384:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.247773:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.250464:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259728384:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.250489:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 33 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.250503:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf00200, rc 0) 00000100:00100000:2.0:1746065123.250536:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28985:x1830881261034624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4107us (5401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.250543:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10770 00000100:00100000:0.0:1746065123.251447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.251552:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261034752 00000100:00100000:1.0:1746065123.251559:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261034752 00002000:00100000:1.0:1746065123.251590:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1257472->1957887) req@ffff88008fd73480 x1830881261034752/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.251602:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73480 with x1830881261034752 ext(1257472->1957887) 00010000:00010000:1.0:1746065123.251609:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 20 pid: 21235 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065123.251620:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 20 pid: 21235 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746065123.251630:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd73480 00000100:00100000:1.0:1746065123.251654:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1509 00000100:00100000:1.0:1746065123.251659:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261034752:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065123.262526:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261034752:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 10859us (11073us total) trans 17179872818 rc 0/0 00000100:00100000:1.0:1746065123.262537:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1509 00002000:00100000:1.0:1746065123.262547:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1257472->1957887) req@ffff88008fd73480 x1830881261034752/t17179872818(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/448 e 0 to 0 dl 1746065134 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.262555:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73480 with x1830881261034752 ext(1257472->1957887) 00010000:00010000:1.0:1746065123.262564:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 22 pid: 21235 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065123.262577:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 22 pid: 21235 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746065123.262582:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd73480 00000100:00100000:0.0:1746065123.265479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.265971:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261034880 00000100:00100000:2.0:1746065123.265980:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261034880 00010000:00010000:2.0:1746065123.266010:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 22 pid: 21235 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.266081:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5350 00000100:00100000:2.0:1746065123.266090:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881261034880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.266101:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.266118:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 22 pid: 21235 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.266129:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 22 pid: 21235 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.266148:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d39000/0x14b4f8542d4f3132 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1957887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5aff4 expref: 22 pid: 21235 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.266254:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.266256:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.266263:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 32 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.266271:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 32 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.266298:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 32 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.266307:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259728512:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065123.266586:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.269438:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.269560:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259728512:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065123.269575:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.269605:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881261034880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3516us (4132us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.269614:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5350 00000100:00100000:1.0:1746065123.269647:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261035136 00000100:00100000:1.0:1746065123.269652:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261035136 00002000:00100000:1.0:1746065123.269682:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88008fd73100 x1830881261035136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.269689:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73100 with x1830881261035136 ext(1048576->2097151) 00002000:00010000:1.0:1746065123.269693:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd73100 00000100:00100000:1.0:1746065123.269714:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4924 00000100:00100000:1.0:1746065123.269721:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881261035136:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065123.278092:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881261035136:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8362us (8651us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065123.278102:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4924 00002000:00100000:1.0:1746065123.278112:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88008fd73100 x1830881261035136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.278120:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73100 with x1830881261035136 ext(1048576->2097151) 00002000:00010000:1.0:1746065123.278125:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd73100 00000100:00100000:0.0:1746065123.285729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.285860:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261035264 00000100:00100000:2.0:1746065123.285867:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261035264 00000100:00100000:2.0:1746065123.285916:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10771 00000100:00100000:2.0:1746065123.285924:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:28985:x1830881261035264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.285939:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.285954:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b079 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.285976:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.285983:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065123.285985:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065123.285988:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.286018:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.286030:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 24 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.286041:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259728640:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.286118:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.288376:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259728640:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.288389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065123.288400:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.288413:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15d000, rc 0) 00000100:00100000:1.0:1746065123.288435:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261035392 00000100:00100000:1.0:1746065123.288439:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261035392 00000100:00100000:0.0:1746065123.288440:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28985:x1830881261035264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2517us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.288446:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10771 00002000:00100000:1.0:1746065123.288466:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3391488->3420159) req@ffff880094ff4000 x1830881261035392/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.288473:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4000 with x1830881261035392 ext(3391488->3420159) 00010000:00010000:1.0:1746065123.288479:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 25 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065123.288489:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 25 pid: 8429 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746065123.288495:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ff4000 00000100:00100000:1.0:1746065123.288513:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1510 00000100:00100000:1.0:1746065123.288518:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261035392:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065123.291397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.291585:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261035520 00000100:00100000:2.0:1746065123.291590:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261035520 00000100:00100000:2.0:1746065123.291616:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10772 00000100:00100000:2.0:1746065123.291620:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881261035520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.291632:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.291643:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15d800/0x14b4f8542d4f3204 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b080 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.291674:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259728768:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065123.291739:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.292240:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.292261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.292308:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261035648 00000100:00100000:0.0:1746065123.292312:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261035648 00000100:00100000:0.0:1746065123.292361:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261035776 00000100:00100000:0.0:1746065123.292364:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261035776 00000100:00100000:0.0:1746065123.292392:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10773 00000100:00100000:0.0:1746065123.292398:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261035648:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065123.292405:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065123.292414:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b087 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.292428:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.292429:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.292435:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b087 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.292446:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b087 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.292454:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc0e00, rc 0) 00000100:00100000:0.0:1746065123.292484:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261035648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.292490:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10773 00000100:00100000:0.0:1746065123.292506:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10774 00000100:00100000:0.0:1746065123.292511:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881261035776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065123.292517:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065123.292523:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f3212 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b08e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065123.292545:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259728896:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065123.292577:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065123.292614:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881261035392:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 4093us (4223us total) trans 21474840049 rc 0/0 00000100:00100000:1.0:1746065123.292624:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1510 00002000:00100000:1.0:1746065123.292631:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3391488->3420159) req@ffff880094ff4000 x1830881261035392/t21474840049(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/448 e 0 to 0 dl 1746065134 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.292639:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4000 with x1830881261035392 ext(3391488->3420159) 00010000:00010000:1.0:1746065123.292644:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 31 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065123.292654:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 31 pid: 8429 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746065123.292660:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094ff4000 00000100:00100000:1.0:1746065123.294424:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259728896:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065123.294449:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f3212 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b08e expref: 30 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.294458:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1400/0x14b4f8542d4f3212 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b08e expref: 30 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.294471:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1400, rc 0) 00000100:00100000:1.0:1746065123.294701:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881261035776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2187us (2437us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065123.294708:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10774 00002000:00010000:2.0:1746065123.295097:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065123 -> 1746065124 00002000:00010000:2.0:1746065123.295100:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065123 -> 1746065124 00000100:00100000:2.0:1746065123.295110:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259728768:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.295124:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15d800/0x14b4f8542d4f3204 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b080 expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.295131:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15d800/0x14b4f8542d4f3204 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b080 expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.295150:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15d800, rc 0) 00000100:00100000:2.0:1746065123.295176:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881261035520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3555us (3785us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.295181:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10772 00000100:00100000:0.0:1746065123.296158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.296873:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261035904 00000100:00100000:2.0:1746065123.296879:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261035904 00010000:00010000:2.0:1746065123.296904:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 27 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.296938:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5351 00000100:00100000:2.0:1746065123.296944:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261035904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.296954:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.296968:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 27 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.296977:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 27 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.296992:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd36800/0x14b4f8542d4f31a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3420159) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b04f expref: 27 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.297004:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.297005:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.297010:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.297016:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.297039:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.297047:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259729024:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065123.297105:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.297609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.297673:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261036032 00000100:00100000:2.0:1746065123.297676:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261036032 00000100:00100000:2.0:1746065123.297706:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10775 00000100:00100000:2.0:1746065123.297711:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:28981:x1830881261036032:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065123.297722:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.297731:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b095 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.297748:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af5a expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.297755:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afca expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.297763:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afc3 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.297768:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.297769:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.297772:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1445888->2097151] (req 1445888->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 32 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.297788:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afc3 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.297803:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afc3 expref: 26 pid: 21998 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.297812:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259729152:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.297891:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afca expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.297898:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afca expref: 32 pid: 21998 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.297906:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259729280:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.297929:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af5a expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.297950:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af5a expref: 15 pid: 4544 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746065123.297957:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259729408:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.297987:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.299608:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259729024:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065123.299622:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.300084:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881261035904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3138us (3925us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.300091:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5351 00000100:00100000:0.0:1746065123.300189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.300354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.300375:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259729152:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.300384:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259729280:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.300391:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259729408:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.300414:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1445888->2097151] (req 1445888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 32 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.300426:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911f6800, rc 0) 00000100:00100000:2.0:1746065123.300442:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261036416 00000100:00100000:2.0:1746065123.300446:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261036416 00000100:00100000:3.0:1746065123.300447:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:28981:x1830881261036032:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2736us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.300452:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10775 00010000:00010000:2.0:1746065123.300462:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afc3 expref: 26 pid: 21998 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.300476:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261036288 00000100:00100000:3.0:1746065123.300480:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261036288 00000100:00100000:2.0:1746065123.300487:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5352 00000100:00100000:2.0:1746065123.300493:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261036416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.300502:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746065123.300513:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8800a5880000 x1830881261036288/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065123.300519:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afc3 expref: 26 pid: 21998 timeout: 822 lvb_type: 0 00002000:00100000:3.0:1746065123.300520:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880000 with x1830881261036288 ext(0->1048575) 00002000:00010000:3.0:1746065123.300523:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5880000 00010000:00010000:2.0:1746065123.300528:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afc3 expref: 26 pid: 21998 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.300534:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4925 00000100:00100000:3.0:1746065123.300538:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881261036288:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065123.300548:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d38800/0x14b4f8542d4f30fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afc3 expref: 26 pid: 21998 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.300561:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.300576:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261036416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.300581:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5352 00000100:00100000:1.0:1746065123.304872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.304910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.304941:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.304961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.305140:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261036544 00000100:00100000:2.0:1746065123.305148:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261036544 00010000:00010000:2.0:1746065123.305176:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afca expref: 32 pid: 21998 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.305197:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261036672 00000100:00100000:2.0:1746065123.305199:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261036672 00010000:00010000:2.0:1746065123.305209:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af5a expref: 16 pid: 4544 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746065123.305227:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5353 00000100:00100000:2.0:1746065123.305233:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261036544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.305244:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.305261:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afca expref: 32 pid: 21998 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.305271:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afca expref: 32 pid: 21998 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.305294:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d39200/0x14b4f8542d4f3101 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afca expref: 32 pid: 21998 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.305307:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.305349:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261036544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 116us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.305355:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5353 00000100:00100000:2.0:1746065123.305391:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5354 00000100:00100000:2.0:1746065123.305395:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1960:x1830881261036672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.305401:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.305407:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af5a expref: 16 pid: 4544 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746065123.305415:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af5a expref: 16 pid: 4544 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746065123.305424:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f109400/0x14b4f8542d4f2fe9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af5a expref: 16 pid: 4544 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746065123.305432:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.305433:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.305438:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.305445:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.305476:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.305486:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259729536:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065123.305528:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.305541:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261037056 00000100:00100000:2.0:1746065123.305543:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261037056 00002000:00100000:2.0:1746065123.305563:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009b9ff100 x1830881261037056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.305572:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff100 with x1830881261037056 ext(3145728->4194303) 00002000:00010000:2.0:1746065123.305575:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9ff100 00000100:00100000:2.0:1746065123.305591:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261036928 00000100:00100000:2.0:1746065123.305593:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261036928 00002000:00100000:2.0:1746065123.305604:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009b9fc380 x1830881261036928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.305609:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fc380 with x1830881261036928 ext(2097152->3145727) 00002000:00010000:2.0:1746065123.305612:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fc380 00000100:00100000:2.0:1746065123.305621:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4926 00000100:00100000:2.0:1746065123.305626:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261037056:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065123.305640:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4927 00000100:00100000:3.0:1746065123.305648:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261036928:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065123.311352:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881261036288:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10805us (11156us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.311364:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4925 00002000:00100000:3.0:1746065123.311374:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8800a5880000 x1830881261036288/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.311382:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880000 with x1830881261036288 ext(0->1048575) 00002000:00010000:3.0:1746065123.311387:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5880000 00000100:00100000:2.0:1746065123.316675:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259729536:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065123.316692:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.316733:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1960:x1830881261036672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 11336us (11825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.316746:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5354 00000100:00100000:0.0:1746065123.317342:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.317527:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261037056:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11898us (12583us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.317535:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4926 00002000:00100000:3.0:1746065123.317544:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009b9ff100 x1830881261037056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.317553:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff100 with x1830881261037056 ext(3145728->4194303) 00002000:00010000:3.0:1746065123.317557:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9ff100 00000100:00100000:3.0:1746065123.317569:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261037440 00000100:00100000:3.0:1746065123.317574:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261037440 00002000:00100000:3.0:1746065123.317594:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1445888->1449983) req@ffff8800a6144380 x1830881261037440/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.317601:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144380 with x1830881261037440 ext(1445888->1449983) 00002000:00010000:3.0:1746065123.317603:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6144380 00000100:00100000:3.0:1746065123.317614:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4928 00000100:00100000:3.0:1746065123.317619:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261037440:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065123.317723:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261037440:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 103us (395us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065123.317728:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4928 00002000:00100000:3.0:1746065123.317733:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1445888->1449983) req@ffff8800a6144380 x1830881261037440/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/4536 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.317740:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144380 with x1830881261037440 ext(1445888->1449983) 00002000:00010000:3.0:1746065123.317742:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6144380 00000100:00100000:3.0:1746065123.320044:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261036928:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 14391us (15075us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.320053:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4927 00002000:00100000:3.0:1746065123.320061:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009b9fc380 x1830881261036928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.320068:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fc380 with x1830881261036928 ext(2097152->3145727) 00002000:00010000:3.0:1746065123.320073:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fc380 00000100:00100000:0.0:1746065123.321617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.321696:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261037568 00000100:00100000:3.0:1746065123.321703:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261037568 00000100:00100000:3.0:1746065123.321746:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10776 00000100:00100000:3.0:1746065123.321754:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:28988:x1830881261037568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.321766:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.321779:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b09c expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.321801:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.321807:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.321809:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.321812:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.321871:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.321882:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 30 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.321892:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259729664:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.322098:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.323039:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259729664:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.323182:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.323192:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd8bc00, rc 0) 00000100:00100000:3.0:1746065123.323231:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+26:28988:x1830881261037568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1478us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.323238:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10776 00000100:00100000:0.0:1746065123.324088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.324186:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261037696 00000100:00100000:3.0:1746065123.324192:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261037696 00002000:00100000:3.0:1746065123.324219:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x379:0x0] (1122304->2093055) req@ffff8800a6144a80 x1830881261037696/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.324227:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144a80 with x1830881261037696 ext(1122304->2093055) 00010000:00010000:3.0:1746065123.324233:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 31 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.324248:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 31 pid: 8429 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746065123.324254:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6144a80 00000100:00100000:3.0:1746065123.324279:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1511 00000100:00100000:3.0:1746065123.324284:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881261037696:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065123.328867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.329121:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261037824 00000100:00100000:3.0:1746065123.329128:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261037824 00000100:00100000:1.0:1746065123.329277:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10777 00000100:00100000:1.0:1746065123.329290:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261037824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065123.329306:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.329321:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd01c00/0x14b4f8542d4f3227 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0a3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.329372:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259729792:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065123.329525:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.330686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.330848:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261037952 00000100:00100000:3.0:1746065123.330853:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261037952 00000100:00100000:3.0:1746065123.330886:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10778 00000100:00100000:3.0:1746065123.330891:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:28981:x1830881261037952:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065123.330901:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.330940:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0aa expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.330959:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 34 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.330967:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b087 expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.330973:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.330975:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.330977:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 34 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.331005:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b087 expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.331014:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b087 expref: 21 pid: 8427 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746065123.331022:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259729920:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.331029:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259729792:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065123.331048:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd01c00/0x14b4f8542d4f3227 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0a3 expref: 34 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.331058:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd01c00/0x14b4f8542d4f3227 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0a3 expref: 34 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.331070:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd01c00, rc 0) 00010000:00010000:3.0:1746065123.331075:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 34 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.331082:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.331087:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261037824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1804us (2228us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065123.331089:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259730048:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.331093:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10777 00000100:00100000:3.0:1746065123.331103:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.333361:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.333439:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259729920:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.333448:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259730048:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.333472:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 34 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.333484:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd8b600, rc 0) 00000100:00100000:3.0:1746065123.333512:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:28981:x1830881261037952:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2620us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.333522:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10778 00000100:00100000:3.0:1746065123.333552:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261038080 00000100:00100000:3.0:1746065123.333556:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261038080 00010000:00010000:3.0:1746065123.333571:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b087 expref: 22 pid: 8427 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746065123.333586:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5355 00000100:00100000:3.0:1746065123.333591:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881261038080:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.333600:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.333614:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b087 expref: 22 pid: 8427 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.333622:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b087 expref: 22 pid: 8427 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.333639:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0e00/0x14b4f8542d4f320b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b087 expref: 22 pid: 8427 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.333651:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.333664:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261038080:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.333669:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5355 00000100:00100000:0.0:1746065123.334112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.334130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.334385:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261038336 00000100:00100000:3.0:1746065123.334389:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261038336 00000100:00100000:3.0:1746065123.334412:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261038208 00000100:00100000:3.0:1746065123.334414:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261038208 00000100:00100000:3.0:1746065123.334429:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10779 00000100:00100000:3.0:1746065123.334433:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261038336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.334444:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.334452:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b200/0x14b4f8542d4f3235 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0b8 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.334463:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.334468:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b200/0x14b4f8542d4f3235 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0b8 expref: 35 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.334475:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b200/0x14b4f8542d4f3235 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0b8 expref: 35 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.334481:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd8b200, rc 0) 00000100:00100000:3.0:1746065123.334497:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261038336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (386us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065123.334501:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10779 00000100:00100000:3.0:1746065123.334509:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10780 00000100:00100000:3.0:1746065123.334513:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261038208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.334517:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.334523:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd8a000/0x14b4f8542d4f323c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0b1 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.334546:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259730176:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065123.334582:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.335173:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.335241:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261038464 00000100:00100000:3.0:1746065123.335245:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261038464 00010000:00010000:3.0:1746065123.335259:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.335275:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5356 00000100:00100000:3.0:1746065123.335280:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261038464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.335287:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.335299:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.335307:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.335319:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf00200/0x14b4f8542d4f31f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b072 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.335327:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.335337:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.335343:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 33 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.335349:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 33 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.335369:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 33 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.335377:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259730304:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065123.335412:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.336496:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259730176:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065123.336513:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd8a000/0x14b4f8542d4f323c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0b1 expref: 34 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.336521:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd8a000/0x14b4f8542d4f323c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0b1 expref: 34 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.336529:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd8a000, rc 0) 00000100:00100000:3.0:1746065123.336551:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261038208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2037us (2420us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065123.336556:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10780 00000100:00100000:3.0:1746065123.336969:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259730304:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065123.336980:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.337006:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261038464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1726us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.337012:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5356 00000100:00100000:0.0:1746065123.338388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.338454:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261038592 00000100:00100000:3.0:1746065123.338460:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261038592 00000100:00100000:0.0:1746065123.338785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.338920:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10781 00000100:00100000:3.0:1746065123.338928:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261038592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.338943:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.338956:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f3243 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0bf expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.339000:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259730432:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065123.339054:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.339174:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261037696:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 14888us (15085us total) trans 21474840050 rc 0/0 00000100:00100000:2.0:1746065123.339182:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1511 00002000:00100000:2.0:1746065123.339189:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x379:0x0] (1122304->2093055) req@ffff8800a6144a80 x1830881261037696/t21474840050(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/448 e 0 to 0 dl 1746065134 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.339198:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144a80 with x1830881261037696 ext(1122304->2093055) 00010000:00010000:2.0:1746065123.339204:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 35 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.339214:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 35 pid: 8429 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746065123.339220:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6144a80 00000100:00100000:2.0:1746065123.339231:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261038848 00000100:00100000:2.0:1746065123.339234:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261038848 00002000:00100000:2.0:1746065123.339252:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1392640->1396735) req@ffff8800a6146680 x1830881261038848/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.339259:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6146680 with x1830881261038848 ext(1392640->1396735) 00002000:00010000:2.0:1746065123.339262:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6146680 00000100:00100000:2.0:1746065123.339283:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4929 00000100:00100000:2.0:1746065123.339289:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261038848:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.339401:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261038848:12345-192.168.202.46@tcp:3:cat.0 Request processed in 111us (616us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065123.339409:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4929 00002000:00100000:2.0:1746065123.339413:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1392640->1396735) req@ffff8800a6146680 x1830881261038848/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/4536 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.339419:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6146680 with x1830881261038848 ext(1392640->1396735) 00002000:00010000:2.0:1746065123.339421:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6146680 00000100:00100000:3.0:1746065123.341117:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259730432:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065123.341143:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f3243 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0bf expref: 34 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.341153:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c871c00/0x14b4f8542d4f3243 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0bf expref: 34 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.341162:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c871c00, rc 0) 00000100:00100000:3.0:1746065123.341191:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261038592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2264us (2807us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065123.341197:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10781 00000100:00100000:0.0:1746065123.341380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.341785:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261039104 00000100:00100000:1.0:1746065123.341790:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261039104 00000100:00100000:1.0:1746065123.341853:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3685 00000100:00100000:1.0:1746065123.341859:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28981:x1830881261039104:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065123.342101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.342165:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261039232 00000100:00100000:2.0:1746065123.342169:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261039232 00000100:00100000:1.0:1746065123.342223:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:28981:x1830881261039104:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 364us (844us total) trans 8589943081 rc 0/0 00000100:00100000:1.0:1746065123.342230:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3685 00010000:00010000:2.0:1746065123.342265:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 33 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.342326:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5357 00000100:00100000:2.0:1746065123.342346:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881261039232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.342356:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.342369:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 33 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.342380:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 33 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.342397:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d39800/0x14b4f8542d4f3140 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->2093055) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b009 expref: 33 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.342413:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.342415:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.342421:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.342431:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.342454:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.342464:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259730560:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065123.342835:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.344864:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259730560:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065123.344881:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.344922:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881261039232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2576us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.344930:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5357 00000100:00100000:0.0:1746065123.347268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.347314:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261039488 00000100:00100000:3.0:1746065123.347321:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261039488 00002000:00100000:3.0:1746065123.347368:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a6147100 x1830881261039488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.347377:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6147100 with x1830881261039488 ext(1048576->2097151) 00002000:00010000:3.0:1746065123.347381:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6147100 00000100:00100000:3.0:1746065123.347411:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4930 00000100:00100000:3.0:1746065123.347418:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881261039488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.359855:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881261039488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12428us (12583us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.359864:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4930 00002000:00100000:2.0:1746065123.359874:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a6147100 x1830881261039488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.359883:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6147100 with x1830881261039488 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.359887:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6147100 00000100:00100000:0.0:1746065123.365724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.366964:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261039616 00000100:00100000:3.0:1746065123.366972:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261039616 00000100:00100000:3.0:1746065123.367021:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10782 00000100:00100000:3.0:1746065123.367030:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:28988:x1830881261039616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.367044:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.367060:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0c6 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.367085:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.367092:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.367093:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.367097:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.367121:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.367131:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 31 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.367141:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259730688:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.367209:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065123.369385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.369423:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261039872 00000100:00100000:1.0:1746065123.369429:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261039872 00000100:00100000:1.0:1746065123.369476:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9028 00000100:00100000:1.0:1746065123.369482:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:28992:x1830881261039872:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065123.369500:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.369514:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f3251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0cd expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065123.369728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065123.369962:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.369974:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b048 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.369980:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b056 expref: 254 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.369985:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.370009:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b056 expref: 254 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.370017:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b056 expref: 254 pid: 16767 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.370027:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259730816:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.370086:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b048 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.370093:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b048 expref: 14 pid: 16767 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.370100:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259730944:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.370117:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.370553:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259730688:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.370575:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.370587:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c870800, rc 0) 00000100:00100000:3.0:1746065123.370628:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+27:28988:x1830881261039616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3596us (4908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.370635:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10782 00000100:00100000:2.0:1746065123.370746:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261040000 00000100:00100000:2.0:1746065123.370752:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261040000 00002000:00100000:2.0:1746065123.370777:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1445888->2097151) req@ffff8800a6147800 x1830881261040000/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.370790:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6147800 with x1830881261040000 ext(1445888->2097151) 00010000:00010000:2.0:1746065123.370797:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 32 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.370805:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 32 pid: 8429 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746065123.370811:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6147800 00000100:00100000:2.0:1746065123.370851:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1512 00000100:00100000:2.0:1746065123.370857:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881261040000:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065123.372725:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259730816:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.372734:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259730944:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.372754:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065123.372956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.373003:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261040128 00000100:00100000:2.0:1746065123.373008:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261040128 00000100:00100000:0.0:1746065123.373021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065123.373032:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b056 expref: 255 pid: 16767 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.374262:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261040256 00000100:00100000:2.0:1746065123.374268:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261040256 00010000:00010000:2.0:1746065123.374288:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b048 expref: 15 pid: 16767 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.374307:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5358 00000100:00100000:0.0:1746065123.374319:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5359 00000100:00100000:0.0:1746065123.374326:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261040256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065123.374348:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065123.374354:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b048 expref: 15 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746065123.374364:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b048 expref: 15 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746065123.374380:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36a00/0x14b4f8542d4f319b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b048 expref: 15 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746065123.374401:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065123.374405:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065123.374411:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065123.374416:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065123.374445:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261040256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 120us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.374450:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5359 00000100:00100000:2.0:1746065123.374571:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1960:x1830881261040128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.374583:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.374588:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b056 expref: 255 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.374599:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b056 expref: 255 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.374609:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c871e00/0x14b4f8542d4f31c5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b056 expref: 255 pid: 16767 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.374631:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.374634:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.374640:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.374646:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.374662:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065123.374735:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065123.374742:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065123.374796:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1960:x1830881261040128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 482us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.374802:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5358 00000004:00200000:0.0:1746065123.375007:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065123.375116:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f3251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0cd expref: 15 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.375127:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0cd expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.375132:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065123.375134:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065123.375137:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd01600, rc 0) 00000100:00100000:0.0:1746065123.375174:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:28992:x1830881261039872:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5692us (5794us total) trans 8589943082 rc 0/0 00000100:00100000:0.0:1746065123.375184:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9028 00000100:00100000:2.0:1746065123.383299:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261040000:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12433us (13563us total) trans 21474840051 rc 0/0 00000100:00100000:2.0:1746065123.383394:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1512 00002000:00100000:2.0:1746065123.383407:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1445888->2097151) req@ffff8800a6147800 x1830881261040000/t21474840051(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/448 e 0 to 0 dl 1746065134 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.383416:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6147800 with x1830881261040000 ext(1445888->2097151) 00010000:00010000:2.0:1746065123.383425:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.383438:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746065123.383444:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6147800 00000100:00100000:3.0:1746065123.386193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.387007:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261040384 00000100:00100000:0.0:1746065123.387014:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261040384 00010000:00010000:0.0:1746065123.387183:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746065123.387223:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5360 00000100:00100000:0.0:1746065123.387230:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881261040384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065123.387243:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065123.387258:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065123 -> 1746065124 00002000:00010000:0.0:1746065123.387260:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065123 -> 1746065124 00010000:00010000:0.0:1746065123.387265:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746065123.387276:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746065123.387295:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800911f6800/0x14b4f8542d4f3219 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1445888->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b095 expref: 34 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746065123.387308:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.387310:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.387315:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.387323:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.387381:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065123.387392:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259731072:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065123.387475:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.390462:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6d90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259731072:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065123.390480:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065123.391076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.391096:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881261040384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3865us (4909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.391107:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5360 00000100:00100000:3.0:1746065123.391184:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261040640 00000100:00100000:3.0:1746065123.391190:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261040640 00002000:00100000:3.0:1746065123.391219:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6d90380 x1830881261040640/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.391227:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90380 with x1830881261040640 ext(1048576->2097151) 00002000:00010000:3.0:1746065123.391231:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d90380 00000100:00100000:3.0:1746065123.391245:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4931 00000100:00100000:3.0:1746065123.391250:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261040640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065123.400585:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261040640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9326us (9504us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.400596:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4931 00002000:00100000:3.0:1746065123.400606:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6d90380 x1830881261040640/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.400615:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90380 with x1830881261040640 ext(1048576->2097151) 00002000:00010000:3.0:1746065123.400619:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d90380 00000100:00100000:0.0:1746065123.405716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.405847:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261040768 00000100:00100000:3.0:1746065123.405857:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261040768 00000100:00100000:3.0:1746065123.406122:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10783 00000100:00100000:3.0:1746065123.406131:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:28988:x1830881261040768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.406147:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.406161:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0d4 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.406187:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 32 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.406194:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.406196:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.406199:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.406223:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 32 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.406234:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 32 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.406245:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259731200:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.406320:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.408738:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.408806:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261040896 00000100:00100000:2.0:1746065123.409016:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261040896 00002000:00100000:2.0:1746065123.409059:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1396735) req@ffff8800a6d90a80 x1830881261040896/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.409067:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90a80 with x1830881261040896 ext(1048576->1396735) 00010000:00010000:2.0:1746065123.409075:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 33 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.409087:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 33 pid: 8429 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746065123.409092:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6d90a80 00000100:00100000:3.0:1746065123.409114:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259731200:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.409136:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.409147:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c870a00, rc 0) 00000100:00100000:3.0:1746065123.409191:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+22:28988:x1830881261040768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3060us (3482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.409200:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10783 00000100:00100000:2.0:1746065123.409265:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1513 00000100:00100000:2.0:1746065123.409270:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261040896:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065123.417065:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881261040896:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7783us (8324us total) trans 17179872819 rc 0/0 00000100:00100000:2.0:1746065123.417078:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1513 00002000:00100000:2.0:1746065123.417090:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1396735) req@ffff8800a6d90a80 x1830881261040896/t17179872819(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/448 e 0 to 0 dl 1746065134 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.417099:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90a80 with x1830881261040896 ext(1048576->1396735) 00010000:00010000:2.0:1746065123.417109:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 35 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.417124:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 35 pid: 8429 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746065123.417130:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6d90a80 00000100:00100000:0.0:1746065123.421611:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.421957:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261041024 00000100:00100000:2.0:1746065123.421968:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261041024 00010000:00010000:2.0:1746065123.422004:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 35 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.422060:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5361 00000100:00100000:2.0:1746065123.422070:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261041024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.422084:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.422105:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 35 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.422117:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 35 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.422141:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd8b600/0x14b4f8542d4f322e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0aa expref: 35 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.422405:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.422408:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.422417:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.422425:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.422461:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.422474:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259731328:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065123.422587:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.427475:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259731328:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065123.427492:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.427531:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261041024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5463us (5931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.427540:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5361 00000100:00100000:0.0:1746065123.432201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.433140:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261041280 00000100:00100000:2.0:1746065123.433150:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261041280 00002000:00100000:2.0:1746065123.433206:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a6d91180 x1830881261041280/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.433222:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d91180 with x1830881261041280 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.433227:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6d91180 00000100:00100000:2.0:1746065123.433251:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4932 00000100:00100000:2.0:1746065123.433260:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881261041280:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.438609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.438774:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261041408 00000100:00100000:1.0:1746065123.438781:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261041408 00000100:00100000:1.0:1746065123.438855:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9029 00000100:00100000:1.0:1746065123.438861:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:28993:x1830881261041408:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065123.438883:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.438897:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00c00/0x14b4f8542d4f326d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0db expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.438938:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.438947:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.438955:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.438965:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.438970:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.438974:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.439049:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.439056:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0cd expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.439061:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.439082:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0cd expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.439091:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0cd expref: 13 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.439101:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259731456:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.439155:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746065123.439237:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065123.442675:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259731456:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.442696:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065123.443512:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881261041280:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10250us (11318us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.443523:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4932 00002000:00100000:2.0:1746065123.443532:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a6d91180 x1830881261041280/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.443541:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d91180 with x1830881261041280 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.443546:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6d91180 00000100:00100000:0.0:1746065123.443730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.444369:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261041536 00000100:00100000:2.0:1746065123.444376:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261041536 00010000:00010000:2.0:1746065123.444399:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0cd expref: 14 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.444431:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5362 00000100:00100000:2.0:1746065123.444438:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:1959:x1830881261041536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.444448:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.444453:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0cd expref: 14 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.444462:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0cd expref: 14 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.444479:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01600/0x14b4f8542d4f3258 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0cd expref: 14 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.444501:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.444505:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.444512:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.444518:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.444554:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.444587:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:1959:x1830881261041536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 147us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.444593:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5362 00010000:00010000:1.0:1746065123.444744:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444750:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065123.444780:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:1.0:1746065123.444784:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065123.444796:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444803:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444811:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444833:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444837:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444841:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd00a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065123.444844:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444850:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444858:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065123.444859:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065123.444862:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444866:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f3274 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444888:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444893:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444896:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444900:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd00800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065123.444902:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444906:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444912:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715200) 00010000:00010000:1.0:1746065123.444913:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065123.444915:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444919:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f327b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.444945:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00c00/0x14b4f8542d4f326d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0db expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.444954:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0db expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.444963:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.444965:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065123.444967:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd00600, rc 0) 00000100:00100000:1.0:1746065123.444990:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28993:x1830881261041408:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 6129us (6393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.444996:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9029 00000100:00100000:0.0:1746065123.447899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.447952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.448018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.448460:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261041664 00000100:00100000:2.0:1746065123.448471:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261041664 00000100:00100000:2.0:1746065123.448502:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261041792 00000100:00100000:2.0:1746065123.448505:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261041792 00000100:00100000:2.0:1746065123.448514:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261041920 00000100:00100000:2.0:1746065123.448516:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261041920 00000100:00100000:2.0:1746065123.448537:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10784 00000100:00100000:2.0:1746065123.448543:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1960:x1830881261041664:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065123.448558:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.448574:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0e2 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.448599:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.448601:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.448608:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e2 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.448621:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e2 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.448630:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facfa00, rc 0) 00000100:00100000:2.0:1746065123.448665:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1960:x1830881261041664:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 121us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.448670:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10784 00000100:00100000:2.0:1746065123.448683:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10785 00000100:00100000:2.0:1746065123.448687:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1961:x1830881261041792:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065123.448693:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.448700:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0e9 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.448701:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10786 00000100:00100000:3.0:1746065123.448708:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261041920:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065123.448709:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.448710:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.448714:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.448714:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e9 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.448721:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0f0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.448721:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e9 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.448730:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.448731:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.448732:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facf400, rc 0) 00010000:00010000:3.0:1746065123.448735:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f0 expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.448744:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f0 expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065123.448745:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1961:x1830881261041792:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 58us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.448749:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10785 00010000:00010000:3.0:1746065123.448750:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ac400, rc 0) 00000100:00100000:3.0:1746065123.448762:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261041920:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 56us (747us total) trans 0 rc 0/0 00000100:00080000:2.0:1746065123.448765:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065123.448766:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10786 00000100:00100000:0.0:1746065123.450728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.450789:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261042048 00000100:00100000:2.0:1746065123.450796:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261042048 00000100:00100000:1.0:1746065123.451169:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10787 00000100:00100000:1.0:1746065123.451179:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1961:x1830881261042048:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065123.451192:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.451205:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0f7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.451227:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.451228:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.451235:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f7 expref: 18 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.451247:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f7 expref: 18 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.451255:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd00400, rc 0) 00000100:00100000:1.0:1746065123.451293:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1961:x1830881261042048:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 116us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.451298:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10787 00000100:00100000:0.0:1746065123.454263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.457078:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261042304 00000100:00100000:1.0:1746065123.457088:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261042304 00000100:00100000:1.0:1746065123.457133:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9030 00000100:00100000:1.0:1746065123.457140:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28993:x1830881261042304:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065123.457158:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.457174:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00000/0x14b4f8542d4f32a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b0fe expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.457258:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.457272:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0db expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.457278:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.457323:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0db expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.457346:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0db expref: 8 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.457357:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259731584:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.457475:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065123.463471:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259731584:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.463493:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065123.463856:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.463929:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.464001:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261042432 00000100:00100000:2.0:1746065123.464007:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261042432 00010000:00010000:2.0:1746065123.464032:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0db expref: 9 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.464093:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5363 00000100:00100000:2.0:1746065123.464100:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881261042432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.464110:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065123.464115:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261042560 00010000:00010000:2.0:1746065123.464115:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0db expref: 9 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.464119:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261042560 00010000:00010000:2.0:1746065123.464124:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0db expref: 9 pid: 24350 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.464141:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00600/0x14b4f8542d4f3282 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0db expref: 9 pid: 24350 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.464154:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10788 00000100:00100000:3.0:1746065123.464160:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+27:28988:x1830881261042560:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.464173:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.464185:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b105 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.464199:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.464201:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.464207:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b105 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.464218:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b105 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.464227:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ac800, rc 0) 00000100:00100000:3.0:1746065123.464258:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+28:28988:x1830881261042560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.464264:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10788 00010000:00010000:2.0:1746065123.465085:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.465090:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.465098:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.465104:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.465249:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.465467:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881261042432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1363us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.465474:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5363 00010000:00010000:1.0:1746065123.465557:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.465565:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065123.465582:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065123.465712:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00000/0x14b4f8542d4f32a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0fe expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.465755:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0fe expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.465762:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.465765:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065123.465767:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd00200, rc 0) 00000100:00100000:1.0:1746065123.465892:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28993:x1830881261042304:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 8750us (11635us total) trans 8589943083 rc 0/0 00000100:00100000:1.0:1746065123.465898:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9030 00000100:00100000:0.0:1746065123.466980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.467033:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261042816 00000100:00100000:1.0:1746065123.467037:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261042816 00000100:00100000:1.0:1746065123.467066:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9031 00000100:00100000:1.0:1746065123.467071:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:28996:x1830881261042816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065123.467084:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.467094:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00c00/0x14b4f8542d4f32c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b10c expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.467155:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467162:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467169:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467179:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467183:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467187:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467254:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467260:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467265:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065123.467270:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065123.467310:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467315:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467320:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467324:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd00800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065123.467337:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467344:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467351:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065123.467353:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065123.467356:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467481:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00800/0x14b4f8542d4f32c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467490:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467494:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467498:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467502:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd00a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065123.467504:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467507:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467513:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715d00) 00010000:00010000:1.0:1746065123.467514:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065123.467516:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467519:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00a00/0x14b4f8542d4f32cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.467541:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00c00/0x14b4f8542d4f32c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b10c expref: 257 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.467548:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b10c expref: 256 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.467553:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.467555:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065123.467556:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd01200, rc 0) 00000100:00100000:1.0:1746065123.468296:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:28996:x1830881261042816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1219us (1312us total) trans 8589943084 rc 0/0 00000100:00100000:1.0:1746065123.468302:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9031 00000100:00100000:0.0:1746065123.472545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.472731:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261043072 00000100:00100000:1.0:1746065123.472739:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261043072 00000100:00100000:1.0:1746065123.472784:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9032 00000100:00100000:1.0:1746065123.472792:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28993:x1830881261043072:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065123.472810:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.472935:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065123.472955:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd00200/0x14b4f8542d4f32ac lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0fe expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.472969:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.472972:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065123.472982:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01000/0x14b4f8542d4f32e4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b113 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.473050:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.473060:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.473068:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.473076:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.473081:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065123.473176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065123.473231:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.473236:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd01a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065123.473239:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.473244:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.473251:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.473254:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065123.473256:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.473260:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01a00/0x14b4f8542d4f32eb lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.473280:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01000/0x14b4f8542d4f32e4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b113 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.473289:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01000/0x14b4f8542d4f32e4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b113 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.473295:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd01000, rc 0) 00000100:00100000:1.0:1746065123.473311:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261043328 00000100:00100000:1.0:1746065123.473314:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261043328 00000100:00100000:1.0:1746065123.473353:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3686 00000100:00100000:1.0:1746065123.473359:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:28996:x1830881261043328:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065123.474493:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:28996:x1830881261043328:12345-192.168.202.46@tcp:35:cat.0 Request processed in 1130us (1313us total) trans 8589943085 rc 0/0 00000100:00100000:1.0:1746065123.474500:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3686 00000100:00100000:1.0:1746065123.474551:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28993:x1830881261043072:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1760us (2012us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065123.474556:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9032 00000100:00100000:0.0:1746065123.477919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.477955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.477983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.478028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.478087:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261043456 00000100:00100000:3.0:1746065123.478093:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261043456 00000100:00100000:3.0:1746065123.478125:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261043584 00000100:00100000:3.0:1746065123.478127:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261043584 00000100:00100000:3.0:1746065123.478136:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261043712 00000100:00100000:3.0:1746065123.478138:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261043712 00000100:00100000:3.0:1746065123.478150:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10789 00000100:00100000:3.0:1746065123.478156:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881261043456:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065123.478186:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10790 00000100:00100000:2.0:1746065123.478196:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261043584:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.478211:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.478227:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b121 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.478246:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.478248:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.478257:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b121 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.478269:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b121 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.478278:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facf600, rc 0) 00000100:00100000:2.0:1746065123.478340:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261043584:12345-192.168.202.46@tcp:101:cat.0 Request processed in 146us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.478346:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10790 00000100:00100000:2.0:1746065123.478361:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10791 00000100:00100000:2.0:1746065123.478366:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881261043712:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.478372:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.478380:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b128 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.478391:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.478392:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.478396:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b128 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.478404:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b128 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.478411:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facf200, rc 0) 00000100:00100000:2.0:1746065123.478425:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261043712:12345-192.168.202.46@tcp:101:cat.0 Request processed in 60us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.478430:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10791 00010000:00010000:3.0:1746065123.478490:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.478496:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b11a expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.478505:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.478506:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.478510:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b11a expref: 35 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.478517:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b11a expref: 35 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.478522:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ad000, rc 0) 00000100:00100000:3.0:1746065123.478535:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261043456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 380us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.478540:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10789 00000100:00100000:1.0:1746065123.478596:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261043968 00000100:00100000:1.0:1746065123.478599:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261043968 00000100:00100000:1.0:1746065123.478618:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3687 00000100:00100000:1.0:1746065123.478622:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:28993:x1830881261043968:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065123.478745:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:28993:x1830881261043968:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 121us (716us total) trans 8589943086 rc 0/0 00000100:00100000:1.0:1746065123.478750:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3687 00000100:00100000:0.0:1746065123.478885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.479084:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261044224 00000100:00100000:3.0:1746065123.479087:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261044224 00002000:00100000:3.0:1746065123.479107:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a6d91f80 x1830881261044224/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.479115:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d91f80 with x1830881261044224 ext(2097152->3145727) 00002000:00010000:3.0:1746065123.479119:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d91f80 00000100:00100000:3.0:1746065123.479131:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4933 00000100:00100000:3.0:1746065123.479136:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881261044224:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065123.479766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.479807:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261044480 00000100:00100000:0.0:1746065123.479810:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261044480 00002000:00100000:0.0:1746065123.479849:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d509500 x1830881261044480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065123.479855:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d509500 with x1830881261044480 ext(3145728->4194303) 00002000:00010000:0.0:1746065123.479857:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d509500 00000100:00100000:0.0:1746065123.479881:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4934 00000100:00100000:0.0:1746065123.479886:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881261044480:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.488201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.489959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.491036:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261044736 00000100:00100000:3.0:1746065123.491037:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261044992 00000100:00100000:3.0:1746065123.491045:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261044992 00000100:00100000:2.0:1746065123.491045:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261044736 00000100:00100000:0.0:1746065123.491057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065123.491077:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6d92680 x1830881261044992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.491077:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a6d92300 x1830881261044736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.491087:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d92680 with x1830881261044992 ext(1048576->2097151) 00002000:00100000:2.0:1746065123.491087:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d92300 with x1830881261044736 ext(1048576->2097151) 00002000:00010000:3.0:1746065123.491091:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d92680 00002000:00010000:2.0:1746065123.491091:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d92300 00000100:00100000:2.0:1746065123.491107:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261045248 00000100:00100000:2.0:1746065123.491109:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261045248 00000100:00100000:3.0:1746065123.491112:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4935 00000100:00100000:3.0:1746065123.491118:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881261044736:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:2.0:1746065123.491119:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a6d90000 x1830881261045248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.491126:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90000 with x1830881261045248 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.491128:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6d90000 00000100:00100000:2.0:1746065123.491139:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4936 00000100:00100000:2.0:1746065123.491144:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881261044992:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065123.491392:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4937 00000100:00100000:1.0:1746065123.491402:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261045248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.491524:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881261044224:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12386us (12637us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065123.491530:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4933 00002000:00100000:0.0:1746065123.491535:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a6d91f80 x1830881261044224/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065123.491541:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d91f80 with x1830881261044224 ext(2097152->3145727) 00002000:00010000:0.0:1746065123.491544:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d91f80 00000100:00100000:1.0:1746065123.492939:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881261044480:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13048us (13169us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065123.492947:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4934 00002000:00100000:1.0:1746065123.492953:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d509500 x1830881261044480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.492961:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d509500 with x1830881261044480 ext(3145728->4194303) 00002000:00010000:1.0:1746065123.492965:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d509500 00000100:00100000:2.0:1746065123.500996:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881261044992:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9843us (11043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.501005:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4936 00002000:00100000:2.0:1746065123.501014:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6d92680 x1830881261044992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.501022:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d92680 with x1830881261044992 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.501027:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d92680 00000100:00100000:3.0:1746065123.501256:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261044736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10137us (13063us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.501261:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4935 00002000:00100000:3.0:1746065123.501266:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a6d92300 x1830881261044736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.501272:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d92300 with x1830881261044736 ext(1048576->2097151) 00002000:00010000:3.0:1746065123.501275:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d92300 00000100:00100000:1.0:1746065123.503280:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261045248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11873us (12216us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065123.503288:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4937 00002000:00100000:1.0:1746065123.503296:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a6d90000 x1830881261045248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.503305:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90000 with x1830881261045248 ext(1048576->2097151) 00002000:00010000:1.0:1746065123.503309:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6d90000 00000100:00100000:0.0:1746065123.545734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.545801:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261045376 00000100:00100000:1.0:1746065123.545809:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261045376 00000100:00100000:1.0:1746065123.545884:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10792 00000100:00100000:1.0:1746065123.545891:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+22:28992:x1830881261045376:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065123.545907:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.545921:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b12f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.545944:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.545956:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b128 expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.545963:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f0 expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.545969:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.545971:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.545974:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [2052096->2097151] (req 2052096->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.545998:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f0 expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.546007:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f0 expref: 13 pid: 4544 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746065123.546017:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259731712:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.546108:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b128 expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.546116:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b128 expref: 34 pid: 8851 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746065123.546124:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259731840:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.546148:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.546155:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 23 pid: 4544 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.546162:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259731968:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.546176:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065123.548032:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259731712:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.548043:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259731840:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.548049:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259731968:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.548071:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [2052096->2097151] (req 2052096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.548085:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8b1200, rc 0) 00000100:00100000:1.0:1746065123.549728:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:28992:x1830881261045376:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2233us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.549744:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10792 00000100:00100000:0.0:1746065123.550437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.550504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.550540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.550563:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261045504 00000100:00100000:0.0:1746065123.550570:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261045504 00010000:00010000:0.0:1746065123.550596:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f0 expref: 14 pid: 4544 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746065123.550615:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261045760 00000100:00100000:0.0:1746065123.550618:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261045760 00010000:00010000:0.0:1746065123.550625:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 23 pid: 4544 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746065123.551059:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261045632 00000100:00100000:0.0:1746065123.551063:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261045632 00010000:00010000:0.0:1746065123.551074:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b128 expref: 35 pid: 8851 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746065123.551112:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5364 00000100:00100000:3.0:1746065123.551120:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261045504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.551131:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.551148:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f0 expref: 14 pid: 4544 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.551158:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f0 expref: 14 pid: 4544 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.551175:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f3297 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f0 expref: 14 pid: 4544 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.551189:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.551225:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261045504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 108us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.551230:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5364 00000100:00100000:3.0:1746065123.551244:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5365 00000100:00100000:3.0:1746065123.551248:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261045760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.551253:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.551259:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 23 pid: 4544 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.551266:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 23 pid: 4544 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.551280:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c870a00/0x14b4f8542d4f3266 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0d4 expref: 23 pid: 4544 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.551287:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.551299:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261045760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.551303:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5365 00000100:00100000:3.0:1746065123.551312:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5366 00000100:00100000:3.0:1746065123.551316:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261045632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.551322:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.551344:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b128 expref: 35 pid: 8851 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.551352:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b128 expref: 35 pid: 8851 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.551361:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009facf200/0x14b4f8542d4f32f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b128 expref: 35 pid: 8851 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.551369:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.551371:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.551376:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.551383:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.551407:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.551417:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259732096:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065123.551453:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.552921:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259732096:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065123.552933:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.553551:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261045632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2231us (3008us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.553618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.553643:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046016 00000100:00100000:3.0:1746065123.553646:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5366 00000100:00100000:0.0:1746065123.553647:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046016 00002000:00100000:0.0:1746065123.553672:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (2052096->2056191) req@ffff880094247480 x1830881261046016/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065123.553683:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094247480 with x1830881261046016 ext(2052096->2056191) 00002000:00010000:0.0:1746065123.553686:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094247480 00000100:00100000:1.0:1746065123.553734:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4938 00000100:00100000:1.0:1746065123.553741:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261046016:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065123.553891:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261046016:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 151us (274us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065123.553896:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4938 00002000:00100000:1.0:1746065123.553901:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (2052096->2056191) req@ffff880094247480 x1830881261046016/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/4536 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.553909:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094247480 with x1830881261046016 ext(2052096->2056191) 00002000:00010000:1.0:1746065123.553911:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094247480 00000100:00100000:0.0:1746065123.555479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.555912:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046144 00000100:00100000:1.0:1746065123.555917:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046144 00000100:00100000:1.0:1746065123.555955:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10793 00000100:00100000:1.0:1746065123.555961:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+22:28992:x1830881261046144:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065123.555974:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.555987:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b136 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.556528:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af68 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.556537:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b002 expref: 33 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.556543:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5affb expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.556552:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.556554:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.556557:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3104767] (req 2097152->3104767) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.556581:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5affb expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.556592:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5affb expref: 23 pid: 8427 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.556603:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259732224:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.557889:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b002 expref: 33 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.557900:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b002 expref: 33 pid: 8427 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.558126:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259732352:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.558162:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af68 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.558170:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af68 expref: 12 pid: 8427 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746065123.558178:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259732480:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.558194:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.558587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.558723:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046400 00000100:00100000:1.0:1746065123.558728:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046400 00000100:00100000:1.0:1746065123.558944:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9033 00000100:00100000:1.0:1746065123.558952:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:29001:x1830881261046400:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065123.558971:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.558982:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0a00/0x14b4f8542d4f3315 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b13d expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.559064:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559074:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559082:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559093:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559098:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559103:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559187:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559195:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559200:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065123.559207:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065123.559269:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559279:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559284:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559289:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c8b0800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065123.559292:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559298:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559307:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065123.559309:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065123.559313:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559317:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f331c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559341:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559346:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559350:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559354:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c8b0600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065123.559356:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559363:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559369:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715f00) 00010000:00010000:1.0:1746065123.559370:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065123.559372:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559376:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3323 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.559405:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0a00/0x14b4f8542d4f3315 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b13d expref: 260 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.559414:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b13d expref: 259 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.559419:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.559421:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065123.559422:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8b0400, rc 0) 00000100:00100000:1.0:1746065123.559449:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:29001:x1830881261046400:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 499us (863us total) trans 8589943087 rc 0/0 00000100:00100000:1.0:1746065123.559455:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9033 00000100:00100000:1.0:1746065123.560150:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259732224:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.560158:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259732352:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.560165:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259732480:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.560182:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3104767] (req 2097152->3104767) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.560193:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8b1800, rc 0) 00000100:00100000:1.0:1746065123.560522:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:28992:x1830881261046144:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4560us (5047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.560528:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10793 00000100:00100000:0.0:1746065123.562354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.562660:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046528 00000100:00100000:3.0:1746065123.562666:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046528 00010000:00010000:3.0:1746065123.562689:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af68 expref: 13 pid: 8427 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746065123.562722:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5367 00000100:00100000:3.0:1746065123.562729:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261046528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.562739:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.562755:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af68 expref: 13 pid: 8427 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746065123.562778:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.562805:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046656 00000100:00100000:2.0:1746065123.562809:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046656 00010000:00010000:2.0:1746065123.562847:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5affb expref: 23 pid: 8427 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.562870:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5368 00000100:00100000:2.0:1746065123.562875:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261046656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.562880:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.562886:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5affb expref: 23 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.562895:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5affb expref: 23 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.562913:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c871000/0x14b4f8542d4f3139 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5affb expref: 23 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.562919:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af68 expref: 13 pid: 8427 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.562934:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f108c00/0x14b4f8542d4f2ff0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af68 expref: 13 pid: 8427 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746065123.562935:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065123.562941:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.562960:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261046528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 232us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.562960:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261046656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.562966:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5367 00000100:00100000:2.0:1746065123.563159:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5368 00000100:00100000:0.0:1746065123.564895:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.565088:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046784 00000100:00100000:2.0:1746065123.565094:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046784 00010000:00010000:2.0:1746065123.565112:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b002 expref: 34 pid: 8427 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.565143:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5369 00000100:00100000:2.0:1746065123.565149:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881261046784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.565158:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.565171:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b002 expref: 34 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.565180:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b002 expref: 34 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.565196:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009118e600/0x14b4f8542d4f3147 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b002 expref: 34 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746065123.565206:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.565208:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.565213:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.565220:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.565244:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.565254:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259732608:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065123.565677:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.566438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.566524:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046912 00000100:00100000:1.0:1746065123.566529:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046912 00000100:00100000:1.0:1746065123.566561:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10794 00000100:00100000:1.0:1746065123.566566:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:29001:x1830881261046912:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065123.566578:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.566589:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b144 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.566606:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.566614:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b11a expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.566620:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e2 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.566625:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.566627:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.566630:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [1290240->1482751] (req 1290240->1482751) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.566651:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e2 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.566660:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e2 expref: 17 pid: 21235 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746065123.566669:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259732736:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.566719:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b11a expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.566726:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b11a expref: 36 pid: 21998 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746065123.566733:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259732864:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.566788:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259732608:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065123.566800:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.566833:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881261046784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1666us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.566839:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5369 00010000:00010000:1.0:1746065123.567370:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.567378:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 27 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746065123.567386:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259732992:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065123.567946:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.568698:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.568704:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259732736:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.568940:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261047040 00000100:00100000:3.0:1746065123.568945:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261047040 00010000:00010000:3.0:1746065123.568965:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e2 expref: 18 pid: 21235 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746065123.568980:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259732864:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.568994:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5370 00000100:00100000:3.0:1746065123.569000:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1959:x1830881261047040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.569010:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.569025:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e2 expref: 18 pid: 21235 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.569033:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e2 expref: 18 pid: 21235 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.569048:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009facfa00/0x14b4f8542d4f3289 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e2 expref: 18 pid: 21235 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.569057:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.569082:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1959:x1830881261047040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.569113:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5370 00000100:00100000:1.0:1746065123.569203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.569268:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261047168 00000100:00100000:3.0:1746065123.569271:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261047168 00010000:00010000:3.0:1746065123.569286:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b11a expref: 37 pid: 21998 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746065123.569344:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259732992:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065123.569367:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1290240->1482751] (req 1290240->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 37 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.569375:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8b0e00, rc 0) 00000100:00100000:3.0:1746065123.569411:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5371 00000100:00100000:3.0:1746065123.569417:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261047168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.569446:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.569454:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b11a expref: 37 pid: 21998 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.569460:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b11a expref: 37 pid: 21998 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.569470:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad000/0x14b4f8542d4f3300 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b11a expref: 37 pid: 21998 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746065123.569477:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065123.569507:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:29001:x1830881261046912:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2941us (3070us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.569515:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10794 00000100:00100000:3.0:1746065123.569580:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881261047168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 162us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.569585:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5371 00000100:00100000:0.0:1746065123.570869:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.570947:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261047296 00000100:00100000:3.0:1746065123.570951:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261047296 00010000:00010000:3.0:1746065123.570967:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 28 pid: 8429 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.570993:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5372 00000100:00100000:3.0:1746065123.570999:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261047296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.571006:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.571017:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 28 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.571026:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 28 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.571038:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd8bc00/0x14b4f8542d4f3220 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b09c expref: 28 pid: 8429 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.571047:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.571049:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.571054:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.571060:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.571084:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.571094:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259733120:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065123.571200:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.572304:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259733120:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065123.572315:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.572355:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261047296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1355us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.572363:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5372 00000100:00100000:0.0:1746065123.572560:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.572643:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261047552 00000100:00100000:3.0:1746065123.572647:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261047552 00002000:00100000:3.0:1746065123.572669:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1290240->1294335) req@ffff88012bd3df80 x1830881261047552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.572681:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3df80 with x1830881261047552 ext(1290240->1294335) 00002000:00010000:3.0:1746065123.572685:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3df80 00000100:00100000:3.0:1746065123.572705:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4939 00000100:00100000:3.0:1746065123.572764:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881261047552:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065123.572962:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881261047552:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 250us (401us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065123.572968:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4939 00002000:00100000:3.0:1746065123.572972:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1290240->1294335) req@ffff88012bd3df80 x1830881261047552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/4536 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.572979:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3df80 with x1830881261047552 ext(1290240->1294335) 00002000:00010000:3.0:1746065123.572982:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3df80 00000100:00100000:0.0:1746065123.573145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.573197:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261047808 00000100:00100000:3.0:1746065123.573200:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261047808 00002000:00100000:3.0:1746065123.573214:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3100672->3104767) req@ffff88012bd3c380 x1830881261047808/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.573221:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c380 with x1830881261047808 ext(3100672->3104767) 00002000:00010000:3.0:1746065123.573224:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3c380 00000100:00100000:3.0:1746065123.573245:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4940 00000100:00100000:3.0:1746065123.573250:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261047808:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065123.573313:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261047808:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 63us (169us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065123.573318:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4940 00002000:00100000:3.0:1746065123.573322:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3100672->3104767) req@ffff88012bd3c380 x1830881261047808/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/4536 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.573339:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c380 with x1830881261047808 ext(3100672->3104767) 00002000:00010000:3.0:1746065123.573342:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3c380 00000100:00100000:0.0:1746065123.574655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.574718:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261048064 00000100:00100000:2.0:1746065123.574723:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261048064 00000100:00100000:2.0:1746065123.574757:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3688 00000100:00100000:2.0:1746065123.574762:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:28992:x1830881261048064:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065123.574920:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:28992:x1830881261048064:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 157us (266us total) trans 8589943088 rc 0/0 00000100:00100000:2.0:1746065123.574925:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3688 00000100:00100000:0.0:1746065123.575483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.575584:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261048320 00000100:00100000:3.0:1746065123.575587:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261048320 00002000:00100000:3.0:1746065123.575604:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1478656->1482751) req@ffff88012bd3f800 x1830881261048320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.575612:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f800 with x1830881261048320 ext(1478656->1482751) 00002000:00010000:3.0:1746065123.575615:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3f800 00000100:00100000:3.0:1746065123.575638:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4941 00000100:00100000:3.0:1746065123.575644:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261048320:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065123.575731:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261048320:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 86us (247us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065123.575736:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4941 00002000:00100000:3.0:1746065123.575741:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1478656->1482751) req@ffff88012bd3f800 x1830881261048320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/4536 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.575752:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f800 with x1830881261048320 ext(1478656->1482751) 00002000:00010000:3.0:1746065123.575755:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3f800 00000100:00100000:0.0:1746065123.577359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.577506:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261048576 00000100:00100000:2.0:1746065123.577511:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261048576 00000100:00100000:2.0:1746065123.577552:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3689 00000100:00100000:2.0:1746065123.577558:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:29001:x1830881261048576:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065123.577688:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:29001:x1830881261048576:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 129us (333us total) trans 8589943089 rc 0/0 00000100:00100000:2.0:1746065123.577695:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3689 00000100:00100000:0.0:1746065123.622609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.622707:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261048832 00000100:00100000:3.0:1746065123.622714:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261048832 00000100:00100000:1.0:1746065123.622900:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9034 00000100:00100000:1.0:1746065123.622910:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:29006:x1830881261048832:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065123.622930:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.622945:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f333f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b14b expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.623031:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623043:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623051:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623063:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623068:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623072:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623167:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623175:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623184:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065123.623192:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065123.623267:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623273:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623278:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623282:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c8b1c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065123.623285:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623290:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623298:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065123.623300:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065123.623302:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623306:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1c00/0x14b4f8542d4f3346 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623339:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623343:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623351:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623354:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c8b0c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065123.623355:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623359:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623364:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715500) 00010000:00010000:1.0:1746065123.623366:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065123.623368:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623371:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0c00/0x14b4f8542d4f334d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.623402:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0800/0x14b4f8542d4f333f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b14b expref: 17 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.623411:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b14b expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.623416:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.623417:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065123.623419:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8b0600, rc 0) 00000100:00100000:1.0:1746065123.623468:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:29006:x1830881261048832:12345-192.168.202.46@tcp:101:cat.0 Request processed in 560us (866us total) trans 8589943090 rc 0/0 00000100:00100000:1.0:1746065123.623474:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9034 00000100:00100000:0.0:1746065123.626553:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.626741:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261049088 00000100:00100000:2.0:1746065123.626749:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261049088 00000100:00100000:2.0:1746065123.626790:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3690 00000100:00100000:2.0:1746065123.626796:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:29006:x1830881261049088:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065123.627298:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:29006:x1830881261049088:12345-192.168.202.46@tcp:35:cat.0 Request processed in 500us (750us total) trans 8589943091 rc 0/0 00000100:00100000:2.0:1746065123.627306:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3690 00000100:00100000:0.0:1746065123.631170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.631224:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261049216 00000100:00100000:1.0:1746065123.631232:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261049216 00000100:00100000:1.0:1746065123.631279:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10795 00000100:00100000:1.0:1746065123.631287:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1959:x1830881261049216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065123.631301:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.631314:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0200/0x14b4f8542d4f3362 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b152 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.631365:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259733248:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065123.631450:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065123.633256:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d50a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259733248:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065123.633283:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0200/0x14b4f8542d4f3362 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b152 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.633294:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0200/0x14b4f8542d4f3362 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b152 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065123.633315:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8b0200, rc 0) 00000100:00100000:0.0:1746065123.633576:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1959:x1830881261049216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2288us (2411us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065123.633584:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10795 00000100:00100000:0.0:1746065123.638805:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.638943:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261049344 00000100:00100000:2.0:1746065123.638952:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261049344 00000100:00100000:2.0:1746065123.639006:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10796 00000100:00100000:2.0:1746065123.639013:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:29006:x1830881261049344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.639029:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.639043:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b159 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.639068:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.639076:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065123.639077:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065123.639082:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.639110:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.639120:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 34 pid: 8427 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746065123.639130:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259733376:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.639201:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.641564:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259733376:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.641593:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.641607:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facf000, rc 0) 00000100:00100000:2.0:1746065123.641639:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:29006:x1830881261049344:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2626us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.641646:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10796 00000100:00100000:0.0:1746065123.642292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.643045:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261049472 00000100:00100000:1.0:1746065123.643051:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261049472 00002000:00100000:1.0:1746065123.643081:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1290240->1482751) req@ffff88012b45f100 x1830881261049472/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.643089:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f100 with x1830881261049472 ext(1290240->1482751) 00010000:00010000:1.0:1746065123.643096:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 35 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065123.643113:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 35 pid: 8427 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746065123.643119:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b45f100 00000100:00100000:1.0:1746065123.643145:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1514 00000100:00100000:1.0:1746065123.643151:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881261049472:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065123.649886:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261049472:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 6727us (7587us total) trans 21474840052 rc 0/0 00000100:00100000:1.0:1746065123.650630:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1514 00002000:00100000:1.0:1746065123.650643:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1290240->1482751) req@ffff88012b45f100 x1830881261049472/t21474840052(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/448 e 0 to 0 dl 1746065134 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.650653:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f100 with x1830881261049472 ext(1290240->1482751) 00010000:00010000:1.0:1746065123.650662:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 37 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746065123.650676:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 37 pid: 8427 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746065123.650683:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b45f100 00000100:00100000:0.0:1746065123.651788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.651999:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261049600 00000100:00100000:3.0:1746065123.652006:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261049600 00010000:00010000:3.0:1746065123.652031:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 37 pid: 8427 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746065123.652066:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5373 00000100:00100000:3.0:1746065123.652072:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261049600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.652083:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.652099:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 37 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.652108:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 37 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.652128:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c8b0e00/0x14b4f8542d4f3338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->1482751) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b144 expref: 37 pid: 8427 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746065123.652144:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.652146:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.652152:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.652162:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.652190:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.652200:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259733504:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065123.652265:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.653292:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259733504:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065123.653306:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.653343:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881261049600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1271us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.653351:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5373 00000100:00100000:0.0:1746065123.657422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.657507:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261049856 00000100:00100000:2.0:1746065123.657514:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261049856 00002000:00100000:2.0:1746065123.657550:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b45df80 x1830881261049856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.657560:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45df80 with x1830881261049856 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.657564:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45df80 00000100:00100000:2.0:1746065123.657594:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4942 00000100:00100000:2.0:1746065123.657602:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261049856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065123.659133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.659698:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261050112 00000100:00100000:3.0:1746065123.659705:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261050112 00002000:00100000:3.0:1746065123.659736:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2052095) req@ffff88012d50a300 x1830881261050112/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.659744:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50a300 with x1830881261050112 ext(1048576->2052095) 00002000:00010000:3.0:1746065123.659748:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d50a300 00000100:00100000:3.0:1746065123.659777:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4943 00000100:00100000:3.0:1746065123.659784:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261050112:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.667713:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261049856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10102us (10288us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.667723:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4942 00002000:00100000:2.0:1746065123.667733:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b45df80 x1830881261049856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.667741:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45df80 with x1830881261049856 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.667746:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45df80 00000100:00100000:3.0:1746065123.668699:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261050112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8911us (9566us total) trans 0 rc 1003520/1003520 00000100:00100000:3.0:1746065123.668709:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4943 00002000:00100000:3.0:1746065123.668715:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2052095) req@ffff88012d50a300 x1830881261050112/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1003520/1003520 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.668722:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50a300 with x1830881261050112 ext(1048576->2052095) 00002000:00010000:3.0:1746065123.668725:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d50a300 00000100:00100000:1.0:1746065123.677472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.677518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.677537:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261050368 00000100:00100000:3.0:1746065123.677544:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261050368 00000100:00100000:2.0:1746065123.677578:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261050624 00000100:00100000:2.0:1746065123.677581:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261050624 00002000:00100000:3.0:1746065123.677583:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3104768->4153343) req@ffff88012d509c00 x1830881261050368/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.677592:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d509c00 with x1830881261050368 ext(3104768->4153343) 00002000:00100000:2.0:1746065123.677593:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4153344->4194303) req@ffff88012d50a680 x1830881261050624/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746065123.677597:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d509c00 00002000:00100000:2.0:1746065123.677598:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50a680 with x1830881261050624 ext(4153344->4194303) 00002000:00010000:2.0:1746065123.677600:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d50a680 00000100:00100000:3.0:1746065123.677643:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4944 00000100:00100000:2.0:1746065123.677647:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4945 00000100:00100000:3.0:1746065123.677650:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261050368:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.677650:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261050624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.679322:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261050624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1665us (1799us total) trans 0 rc 40960/40960 00000100:00100000:2.0:1746065123.679340:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4945 00002000:00100000:2.0:1746065123.679347:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4153344->4194303) req@ffff88012d50a680 x1830881261050624/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 40960/40960 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.679354:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d50a680 with x1830881261050624 ext(4153344->4194303) 00002000:00010000:2.0:1746065123.679358:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d50a680 00000100:00100000:3.0:1746065123.683488:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261050368:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5829us (6013us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.683499:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4944 00002000:00100000:3.0:1746065123.683508:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3104768->4153343) req@ffff88012d509c00 x1830881261050368/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.683517:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d509c00 with x1830881261050368 ext(3104768->4153343) 00002000:00010000:3.0:1746065123.683522:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d509c00 00000100:00100000:0.0:1746065123.689625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.692408:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261050880 00000100:00100000:3.0:1746065123.692419:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261050880 00002000:00100000:3.0:1746065123.692457:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012b45d180 x1830881261050880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.692473:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d180 with x1830881261050880 ext(4194304->5029887) 00002000:00010000:3.0:1746065123.692478:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45d180 00000100:00100000:3.0:1746065123.692517:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4946 00000100:00100000:3.0:1746065123.692525:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881261050880:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065123.698412:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.698472:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261051008 00000100:00100000:2.0:1746065123.698480:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261051008 00000100:00100000:2.0:1746065123.698622:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9035 00000100:00100000:2.0:1746065123.698630:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29007:x1830881261051008:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065123.698649:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.698662:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f3370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b160 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.698707:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698716:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698725:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698736:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698741:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698746:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:3.0:1746065123.698834:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881261050880:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6309us (9215us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065123.698843:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4946 00010000:00010000:2.0:1746065123.698845:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00002000:00100000:3.0:1746065123.698851:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012b45d180 x1830881261050880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065123.698853:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698858:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00002000:00100000:3.0:1746065123.698859:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d180 with x1830881261050880 ext(4194304->5029887) 00002000:00010000:3.0:1746065123.698863:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45d180 00000004:00200000:2.0:1746065123.698882:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065123.698885:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065123.698895:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698903:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698909:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698914:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698928:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698936:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009facfc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.698939:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698945:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698957:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065123.698960:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065123.698962:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698967:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f3377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698990:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698994:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.698998:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.699001:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009facf800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.699008:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.699013:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.699019:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012dc07b00) 00010000:00010000:2.0:1746065123.699021:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065123.699023:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.699027:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f337e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.699049:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f3370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b160 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.699059:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b160 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.699064:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.699066:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065123.699067:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facee00, rc 0) 00000100:00100000:2.0:1746065123.699102:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29007:x1830881261051008:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 472us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.699107:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9035 00000100:00100000:0.0:1746065123.701945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.701972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.702009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.702103:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261051264 00000100:00100000:3.0:1746065123.702110:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261051264 00000100:00100000:3.0:1746065123.702154:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261051136 00000100:00100000:3.0:1746065123.702157:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261051136 00000100:00100000:3.0:1746065123.702169:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261051392 00000100:00100000:3.0:1746065123.702171:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261051392 00000100:00100000:3.0:1746065123.702183:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10797 00000100:00100000:3.0:1746065123.702189:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261051264:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065123.702204:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.702219:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac000/0x14b4f8542d4f338c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b16e expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.702261:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259733632:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065123.702353:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.702374:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10798 00000100:00100000:3.0:1746065123.702379:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1960:x1830881261051136:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065123.702386:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.702395:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b167 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.702405:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.702407:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.702414:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b167 expref: 18 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.702426:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b167 expref: 18 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.702434:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3acc00, rc 0) 00000100:00100000:3.0:1746065123.702453:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1960:x1830881261051136:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 75us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.702459:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10798 00000100:00100000:3.0:1746065123.702470:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10799 00000100:00100000:3.0:1746065123.702475:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261051392:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065123.702480:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.702485:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f339a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b175 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.702503:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259733760:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065123.702527:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.704174:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259733632:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065123.704193:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac000/0x14b4f8542d4f338c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b16e expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.704202:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac000/0x14b4f8542d4f338c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b16e expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.704212:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ac000, rc 0) 00000100:00100000:3.0:1746065123.705461:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261051264:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3267us (3517us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065123.705468:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10797 00002000:00010000:3.0:1746065123.706248:0:21235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065123 -> 1746065124 00002000:00010000:3.0:1746065123.706251:0:21235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065123 -> 1746065124 00002000:00010000:3.0:1746065123.706253:0:21235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065123 -> 1746065124 00000100:00100000:3.0:1746065123.706266:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259733760:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065123.706288:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f339a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b175 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.706297:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac400/0x14b4f8542d4f339a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b175 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.706304:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ac400, rc 0) 00000100:00100000:3.0:1746065123.706369:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261051392:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3892us (4357us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065123.706377:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10799 00000100:00100000:1.0:1746065123.709517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.709621:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261051648 00000100:00100000:2.0:1746065123.709629:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261051648 00000100:00100000:2.0:1746065123.709679:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9036 00000100:00100000:2.0:1746065123.709686:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29007:x1830881261051648:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065123.709700:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.709714:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f33a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b17c expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.709786:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.709798:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b13d expref: 259 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.709805:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b14b expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.709812:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b160 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.710091:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.710116:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b160 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.710126:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b160 expref: 10 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.710141:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259733888:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.711453:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b14b expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.711464:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b14b expref: 16 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.711473:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259734016:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.711524:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b13d expref: 259 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.711531:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b13d expref: 259 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.711537:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259734144:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.712458:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.714039:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259733888:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.714049:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259734016:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.714457:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259734144:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.714481:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065123.714670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.714737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.714767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.714990:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261052032 00000100:00100000:2.0:1746065123.714990:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261051776 00000100:00100000:3.0:1746065123.714995:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261052032 00000100:00100000:2.0:1746065123.714995:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261051776 00010000:00010000:3.0:1746065123.715020:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b13d expref: 260 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.715020:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b160 expref: 11 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.715037:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261051904 00000100:00100000:3.0:1746065123.715039:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261051904 00000100:00100000:2.0:1746065123.715041:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5374 00010000:00010000:3.0:1746065123.715047:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b14b expref: 17 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.715047:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1960:x1830881261052032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.715057:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.715061:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b13d expref: 260 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.715065:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5375 00000100:00100000:3.0:1746065123.715069:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261051776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.715069:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b13d expref: 260 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.715075:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.715077:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b160 expref: 11 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.715086:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f332a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b13d expref: 260 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.715087:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b160 expref: 11 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.715096:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facee00/0x14b4f8542d4f3385 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b160 expref: 11 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.715100:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.715104:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.715110:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.715114:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065123.715138:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5376 00000100:00100000:0.0:1746065123.715144:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261051904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065123.715149:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065123.715153:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1960:x1830881261052032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 105us (415us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065123.715153:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b14b expref: 17 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.715158:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5374 00010000:00010000:3.0:1746065123.715335:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.715339:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.715344:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.715349:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065123.715395:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b14b expref: 17 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065123.715407:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0600/0x14b4f8542d4f3354 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b14b expref: 17 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065123.715419:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065123.715422:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065123.715428:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065123.715433:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065123.715453:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065123.715503:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.715508:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065123.715523:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000100:00100000:3.0:1746065123.715997:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261051776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 926us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.716004:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5375 00010000:00010000:2.0:1746065123.717684:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf800/0x14b4f8542d4f33a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b17c expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.717707:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b17c expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.717714:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.717717:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065123.717719:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facfc00, rc 0) 00000100:00100000:0.0:1746065123.717930:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261051904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2784us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.717953:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5376 00000100:00100000:2.0:1746065123.718035:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29007:x1830881261051648:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 8348us (8524us total) trans 8589943092 rc 0/0 00000100:00100000:2.0:1746065123.718041:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9036 00000100:00100000:0.0:1746065123.720762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.720812:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261052160 00000100:00100000:2.0:1746065123.720839:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261052160 00000100:00100000:2.0:1746065123.720877:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9037 00000100:00100000:2.0:1746065123.720884:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29007:x1830881261052160:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065123.720904:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.720920:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33b6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b183 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.720987:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.720998:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b17c expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.721004:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.721029:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b17c expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.721039:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b17c expref: 11 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.721049:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259734272:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.721478:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.723310:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.723449:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259734272:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.723468:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065123.723492:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261052288 00000100:00100000:1.0:1746065123.723498:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261052288 00010000:00010000:1.0:1746065123.723528:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b17c expref: 12 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065123.723743:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5377 00000100:00100000:1.0:1746065123.723751:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881261052288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.723762:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065123.723768:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b17c expref: 12 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.723777:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b17c expref: 12 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.723795:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfc00/0x14b4f8542d4f33a8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b17c expref: 12 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.723909:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.723914:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.723922:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.723928:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.723953:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065123.723976:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.723982:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065123.724015:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065123.724019:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065123.724033:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.724061:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33b6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b183 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.724095:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881261052288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 344us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.724104:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5377 00010000:00010000:2.0:1746065123.724162:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b183 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.724171:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.724173:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065123.724174:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009face800, rc 0) 00000100:00100000:2.0:1746065123.724198:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29007:x1830881261052160:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3315us (3442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.724204:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9037 00000100:00100000:0.0:1746065123.726039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.726146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.726213:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261052416 00000100:00100000:3.0:1746065123.726219:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261052416 00000100:00100000:3.0:1746065123.726250:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261052544 00000100:00100000:3.0:1746065123.726252:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261052544 00000100:00100000:1.0:1746065123.727732:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10800 00000100:00100000:1.0:1746065123.727744:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881261052416:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065123.727761:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.727777:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1400/0x14b4f8542d4f33c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b18a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.727839:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259734400:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065123.727902:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.727966:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10801 00000100:00100000:0.0:1746065123.727974:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261052544:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065123.727981:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065123.727988:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd00e00/0x14b4f8542d4f33cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b191 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065123.728012:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259734528:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065123.728037:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.731089:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259734400:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.731117:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1400/0x14b4f8542d4f33c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b18a expref: 15 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.731129:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1400/0x14b4f8542d4f33c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b18a expref: 15 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.731137:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8b1400, rc 0) 00000100:00100000:2.0:1746065123.731475:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881261052416:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3732us (5439us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.731482:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10800 00000100:00100000:2.0:1746065123.731536:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259734528:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.731550:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd00e00/0x14b4f8542d4f33cb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b191 expref: 13 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.731559:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd00e00/0x14b4f8542d4f33cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b191 expref: 13 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.731570:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd00e00, rc 0) 00000100:00100000:2.0:1746065123.731601:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261052544:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3628us (5455us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065123.731607:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10801 00000100:00100000:0.0:1746065123.732077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.732302:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261052672 00000100:00100000:3.0:1746065123.732307:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261052672 00000100:00100000:3.0:1746065123.732349:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10802 00000100:00100000:3.0:1746065123.732355:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261052672:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.732366:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.732376:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b198 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.732389:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.732391:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.732397:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b198 expref: 37 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.732408:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b198 expref: 37 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.732415:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ad200, rc 0) 00000100:00100000:3.0:1746065123.732441:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261052672:12345-192.168.202.46@tcp:101:cat.0 Request processed in 87us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.732448:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10802 00000100:00100000:0.0:1746065123.733175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.733758:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261052800 00000100:00100000:2.0:1746065123.733762:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261052800 00000100:00100000:0.0:1746065123.733995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.734213:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261052928 00000100:00100000:2.0:1746065123.734217:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261052928 00000100:00100000:3.0:1746065123.734245:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10803 00000100:00100000:3.0:1746065123.734258:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10804 00000100:00100000:3.0:1746065123.734263:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261052928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.734274:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.734453:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac600/0x14b4f8542d4f33d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1a6 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.734492:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259734656:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065123.734877:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261052800:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.734885:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.734893:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009facec00/0x14b4f8542d4f33e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b19f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.734914:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259734784:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065123.735019:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.735180:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.735464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.735593:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261053184 00000100:00100000:2.0:1746065123.735596:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261053184 00000100:00100000:2.0:1746065123.735631:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9038 00000100:00100000:2.0:1746065123.735636:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29007:x1830881261053184:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065123.735645:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.735655:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf200/0x14b4f8542d4f33e7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1ad expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.735743:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.735755:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.735764:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065123.735773:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065123.735875:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facf200/0x14b4f8542d4f33e7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ad expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.735887:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ad expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.735895:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.735897:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065123.735899:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facfe00, rc 0) 00000100:00100000:2.0:1746065123.735923:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29007:x1830881261053184:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 287us (460us total) trans 8589943093 rc 0/0 00000100:00100000:2.0:1746065123.735929:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9038 00000100:00100000:3.0:1746065123.738180:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259734656:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065123.738206:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac600/0x14b4f8542d4f33d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1a6 expref: 36 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.738216:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c3ac600/0x14b4f8542d4f33d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1a6 expref: 36 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.738470:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ac600, rc 0) 00000100:00100000:3.0:1746065123.738507:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261052928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4243us (4511us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065123.738512:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10804 00000100:00100000:2.0:1746065123.738641:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259734784:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065123.738657:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009facec00/0x14b4f8542d4f33e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b19f expref: 34 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.738665:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009facec00/0x14b4f8542d4f33e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b19f expref: 34 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.738672:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009facec00, rc 0) 00000100:00100000:0.0:1746065123.738680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.738893:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261052800:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4640us (5717us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065123.738897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.738898:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10803 00000100:00100000:2.0:1746065123.738910:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261053312 00000100:00100000:0.0:1746065123.738910:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261053568 00000100:00100000:2.0:1746065123.738914:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261053312 00000100:00100000:0.0:1746065123.738914:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261053568 00000100:00100000:0.0:1746065123.738939:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10805 00000100:00100000:0.0:1746065123.738944:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1960:x1830881261053568:12345-192.168.202.46@tcp:1:lfs.0 00000100:00100000:1.0:1746065123.739023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065123.739713:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.739727:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.739738:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b121 expref: 36 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.739743:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e9 expref: 18 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.739748:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.739749:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.739751:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.739774:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e9 expref: 18 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.739784:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e9 expref: 18 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065123.739982:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261053824 00000100:00100000:2.0:1746065123.739987:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261053824 00000100:00100000:2.0:1746065123.740017:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10806 00000100:00100000:2.0:1746065123.740022:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261053312:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065123.740039:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740048:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af4c expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.740055:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afae expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740061:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af92 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740066:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.740067:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.740069:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740082:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af92 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740094:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af92 expref: 21 pid: 8851 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.740103:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259735040:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.740149:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afae expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740156:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afae expref: 32 pid: 21998 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.740163:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259735168:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.740184:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af4c expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.740191:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af4c expref: 13 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065123.740197:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259735296:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.740208:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.740219:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10807 00000100:00100000:2.0:1746065123.740224:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261053824:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065123.740235:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740247:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740252:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065123.740253:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065123.740255:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740265:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.740271:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 21 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.740277:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259735424:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.740289:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.740526:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259734912:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065123.740575:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b121 expref: 36 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.740582:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b121 expref: 36 pid: 8851 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746065123.740590:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259735552:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065123.740611:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.740618:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 27 pid: 4544 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065123.740624:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259735680:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065123.740634:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065123.740929:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.740983:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261053440 00000100:00100000:2.0:1746065123.740986:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261053440 00000100:00100000:2.0:1746065123.741002:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10808 00000100:00100000:2.0:1746065123.741006:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+19:1960:x1830881261053440:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065123.741021:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.741030:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.741107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.741130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.741164:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261053696 00000100:00100000:3.0:1746065123.741168:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261053696 00000100:00100000:3.0:1746065123.741183:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261053952 00000100:00100000:3.0:1746065123.741185:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261053952 00000100:00100000:3.0:1746065123.741197:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10809 00000100:00100000:3.0:1746065123.741202:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261053696:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065123.741216:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741224:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741230:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.741231:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.741233:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741246:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 21 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741253:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 21 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.741261:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259735808:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.741286:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.741298:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10810 00000100:00100000:3.0:1746065123.741303:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+20:1960:x1830881261053952:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065123.741315:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741323:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 36 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741342:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b105 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741349:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f7 expref: 20 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.741354:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.741355:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.741357:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741371:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f7 expref: 20 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.741378:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f7 expref: 20 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:3.0:1746065123.741386:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259735936:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.741409:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b105 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741416:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b105 expref: 27 pid: 21998 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.741422:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259736064:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.741438:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 36 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.741444:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 36 pid: 8429 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.741449:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259736192:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.741459:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065123.741482:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b198 expref: 36 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.741489:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b167 expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.741494:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.741495:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.741497:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.741512:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b167 expref: 20 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.741519:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b167 expref: 20 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065123.741527:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259736320:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.741549:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b198 expref: 36 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.741555:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b198 expref: 36 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065123.741561:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259736448:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.741575:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.741581:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 27 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.741587:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259736576:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.741600:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.748137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.748157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.748170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.748181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.748195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.748207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.748221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.748233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.748486:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259736320:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.748487:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259735808:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.748496:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259736448:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.748503:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259736576:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.748511:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.748517:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.748535:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261054080 00000100:00100000:2.0:1746065123.748535:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259735040:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.748540:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261054080 00000100:00100000:2.0:1746065123.748543:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259735168:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.748549:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259735296:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.748566:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.748568:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af4c expref: 15 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065123.748581:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261054464 00000100:00100000:3.0:1746065123.748584:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261054336 00000100:00100000:2.0:1746065123.748584:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261054464 00000100:00100000:3.0:1746065123.748586:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261054336 00010000:00010000:3.0:1746065123.748594:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b121 expref: 37 pid: 8851 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065123.748597:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e9 expref: 21 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:3.0:1746065123.748603:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261054720 00000100:00100000:3.0:1746065123.748604:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261054720 00000100:00100000:2.0:1746065123.748612:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261054592 00010000:00010000:3.0:1746065123.748613:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afae expref: 33 pid: 21998 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.748614:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261054592 00010000:00010000:2.0:1746065123.748623:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 28 pid: 4544 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.748626:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261054976 00000100:00100000:3.0:1746065123.748628:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261054976 00000100:00100000:2.0:1746065123.748634:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5378 00010000:00010000:3.0:1746065123.748636:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af92 expref: 22 pid: 8851 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.748640:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1959:x1830881261054080:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065123.748646:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5379 00000100:00100000:3.0:1746065123.748651:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881261054336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.748651:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.748657:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.748668:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af4c expref: 15 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065123.748670:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b121 expref: 37 pid: 8851 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065123.748678:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b121 expref: 37 pid: 8851 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065123.748678:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af4c expref: 15 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065123.748695:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd37c00/0x14b4f8542d4f2fe2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af4c expref: 15 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065123.748696:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065123.748705:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.748726:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881261054336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 74us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.748732:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5379 00000100:00100000:3.0:1746065123.748743:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5380 00000100:00100000:3.0:1746065123.748748:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+21:1959:x1830881261054464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.748754:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.748761:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e9 expref: 21 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065123.748768:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e9 expref: 21 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065123.748777:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065123.748903:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5381 00000100:00100000:1.0:1746065123.748911:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261054720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.748917:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065123.748926:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afae expref: 33 pid: 21998 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.748933:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afae expref: 33 pid: 21998 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.748945:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4bf0600/0x14b4f8542d4f30e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afae expref: 33 pid: 21998 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.748962:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.749379:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1959:x1830881261054080:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 738us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.749385:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5378 00000100:00100000:2.0:1746065123.749396:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5382 00000100:00100000:2.0:1746065123.749400:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261054592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.749406:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.749414:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 28 pid: 4544 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.749421:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 28 pid: 4544 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.749431:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.749432:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.749436:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.749443:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.749454:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.749466:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261054592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.749470:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5382 00000100:00100000:2.0:1746065123.749478:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5383 00000100:00100000:2.0:1746065123.749482:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881261054976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.749486:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.749493:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af92 expref: 22 pid: 8851 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.749500:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af92 expref: 22 pid: 8851 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.749509:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a399c00/0x14b4f8542d4f30ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5af92 expref: 22 pid: 8851 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.749517:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.749518:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.749519:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.749523:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.749531:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.749540:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881261054976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.749543:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5383 00010000:00010000:2.0:1746065123.749553:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.749558:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.749568:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+21:1959:x1830881261054464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 817us (1395us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065123.749572:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.749573:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5380 00010000:00010000:2.0:1746065123.749578:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.749578:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261054720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 668us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.749584:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5381 00010000:00010000:2.0:1746065123.749585:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.749594:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009facfc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065123.749597:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.749604:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.749606:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259735936:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.749612:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259736064:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.749613:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.749618:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259736192:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.749618:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009facfc00/0x14b4f8542d4f3403 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.749625:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261054848 00000100:00100000:1.0:1746065123.749628:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261054848 00010000:00010000:3.0:1746065123.749629:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.749645:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10811 00000100:00100000:3.0:1746065123.749646:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259735424:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.749647:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261053312:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 9625us (10967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.749650:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:29012:x1830881261054848:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065123.749652:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10806 00010000:00010000:3.0:1746065123.749655:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.749660:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065123.749667:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261054208 00010000:00010000:1.0:1746065123.749669:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1b4 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.749670:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261054208 00002000:00010000:1.0:1746065123.749680:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e3, atime: 0x6812d6e3, ctime: 0x6812d6e3, blocks: 0x7f1 00002000:00100000:3.0:1746065123.749688:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3104767) req@ffff880093ba2300 x1830881261054208/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065123.749689:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.749690:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.749694:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1b4 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065123.749696:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2300 with x1830881261054208 ext(2097152->3104767) 00010000:00010000:3.0:1746065123.749700:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 21 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.749704:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1b4 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.749707:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 21 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.749711:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8b1000, rc 0) 00002000:00010000:3.0:1746065123.749713:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba2300 00000100:00100000:1.0:1746065123.749726:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:29012:x1830881261054848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 76us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.749731:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10811 00010000:00010000:1.0:1746065123.749760:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009facf400/0x14b4f8542d4f3290 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0e9 expref: 20 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065123.749768:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259734912:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.749777:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009facf600/0x14b4f8542d4f32f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b121 expref: 36 pid: 8851 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065123.749794:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259735552:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.749803:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c870800/0x14b4f8542d4f324a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0c6 expref: 27 pid: 4544 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065123.749810:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259735680:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.749838:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.749844:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.749849:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.749860:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.749866:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.749872:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1515 00010000:00010000:1.0:1746065123.749876:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.749879:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881261054208:12345-192.168.202.46@tcp:4:cat.0 00010000:00010000:1.0:1746065123.749880:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd01800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065123.749883:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.749888:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.749896:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.749901:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd01800/0x14b4f8542d4f33fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.749932:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+19:1960:x1830881261053568:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 10987us (11033us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.749938:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10805 00000100:00100000:0.0:1746065123.752119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.752191:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261055616 00000100:00100000:1.0:1746065123.752196:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261055616 00010000:00010000:1.0:1746065123.752216:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b105 expref: 27 pid: 21998 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065123.752246:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5384 00000100:00100000:1.0:1746065123.752252:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261055616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.752261:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065123.752275:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b105 expref: 27 pid: 21998 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.752284:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b105 expref: 27 pid: 21998 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.752428:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c3ac800/0x14b4f8542d4f32b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b105 expref: 27 pid: 21998 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.752440:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065123.753188:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881261055616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 934us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.753194:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5384 00000100:00100000:0.0:1746065123.753498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.753690:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261055232 00000100:00100000:1.0:1746065123.753694:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261055232 00010000:00010000:1.0:1746065123.753709:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f7 expref: 19 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065123.753725:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5385 00000100:00100000:1.0:1746065123.753730:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+19:1961:x1830881261055232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.753737:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065123.753748:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f7 expref: 19 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065123.753756:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f7 expref: 19 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065123.753770:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd00400/0x14b4f8542d4f329e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b0f7 expref: 19 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065123.753779:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065123.753795:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1961:x1830881261055232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.753800:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5385 00000100:00100000:2.0:1746065123.754150:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.754167:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.754245:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261055104 00000100:00100000:0.0:1746065123.754248:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261055104 00002000:00100000:0.0:1746065123.754271:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (2052096->2097151) req@ffff88012b4b1180 x1830881261055104/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065123.754279:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b1180 with x1830881261055104 ext(2052096->2097151) 00010000:00010000:0.0:1746065123.754285:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 23 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065123.754298:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 23 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065123.754303:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b1180 00000100:00100000:0.0:1746065123.754335:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1516 00000100:00100000:0.0:1746065123.754340:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261055104:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065123.754504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.754522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.754542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.754790:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261055488 00000100:00100000:1.0:1746065123.754793:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261055488 00010000:00010000:1.0:1746065123.754808:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b198 expref: 36 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065123.754843:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261055872 00000100:00100000:1.0:1746065123.754846:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261055872 00010000:00010000:1.0:1746065123.754855:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 37 pid: 8429 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065123.754867:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261055360 00000100:00100000:1.0:1746065123.754869:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261055360 00010000:00010000:1.0:1746065123.754876:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b167 expref: 18 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065123.754883:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261055744 00000100:00100000:1.0:1746065123.754885:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261055744 00010000:00010000:1.0:1746065123.754893:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 26 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065123.754907:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5386 00000100:00100000:1.0:1746065123.754912:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261055488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.754920:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065123.754932:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b198 expref: 37 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065123.754940:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b198 expref: 37 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065123.754952:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f33d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b198 expref: 37 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065123.754962:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065123.754983:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261055488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.754989:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5386 00000100:00100000:1.0:1746065123.755001:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5387 00000100:00100000:1.0:1746065123.755005:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881261055872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.755011:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065123.755018:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 35 pid: 8429 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.755025:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 35 pid: 8429 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.755039:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15d000/0x14b4f8542d4f31fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b079 expref: 35 pid: 8429 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.755047:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.755049:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.755052:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.755060:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.755079:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065123.755094:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881261055872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 88us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.755099:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5387 00000100:00100000:1.0:1746065123.755109:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5388 00000100:00100000:1.0:1746065123.755114:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+18:1960:x1830881261055360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.755121:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065123.755128:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b167 expref: 18 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065123.755134:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b167 expref: 18 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065123.755144:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c3acc00/0x14b4f8542d4f3393 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b167 expref: 18 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065123.755155:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065123.755169:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+17:1960:x1830881261055360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.755174:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5388 00000100:00100000:1.0:1746065123.755210:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5389 00000100:00100000:1.0:1746065123.755214:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261055744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.755220:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065123.755226:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 26 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.755233:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 26 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.755243:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009facf000/0x14b4f8542d4f3369 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b159 expref: 26 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.755250:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.755251:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.755253:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.755259:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.755270:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065123.755284:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261055744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.755288:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5389 00010000:00010000:2.0:1746065123.755729:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.755736:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.755758:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.755764:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.755771:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.755776:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf00c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065123.755780:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.755786:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.755795:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.755800:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf00c00/0x14b4f8542d4f3411 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.755871:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+16:1960:x1830881261053440:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 14863us (14941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.755877:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10808 00010000:00010000:2.0:1746065123.756057:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.756064:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.756076:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.756082:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.756087:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.756091:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c3adc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065123.756093:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.756098:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.756106:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.756111:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c3adc00/0x14b4f8542d4f341f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.756140:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1960:x1830881261053952:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 14836us (15008us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.756146:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10810 00000100:00100000:0.0:1746065123.760304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.760627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.760648:0:14642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261056256 00000100:00100000:0.0:1746065123.760655:0:14642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261056256 00000100:00100000:1.0:1746065123.760750:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261056128 00000100:00100000:1.0:1746065123.760753:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261056128 00002000:00100000:1.0:1746065123.760783:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880093ba2680 x1830881261056128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.760792:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2680 with x1830881261056128 ext(0->1048575) 00002000:00010000:1.0:1746065123.760796:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba2680 00000100:00100000:1.0:1746065123.760810:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4947 00000100:00100000:1.0:1746065123.760833:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261056128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.761429:0:14642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 173 00000100:00100000:0.0:1746065123.761436:0:14642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edf50a1e-6d84-485b-9392-04c729e87e94+15:1959:x1830881261056256:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1746065123.761483:0:14642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edf50a1e-6d84-485b-9392-04c729e87e94+15:1959:x1830881261056256:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 47us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.761489:0:14642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 173 00000100:00100000:1.0:1746065123.770602:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261056128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9764us (10298us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065123.770612:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4947 00002000:00100000:1.0:1746065123.770622:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880093ba2680 x1830881261056128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.770631:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2680 with x1830881261056128 ext(0->1048575) 00002000:00010000:1.0:1746065123.770635:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba2680 00000100:00100000:1.0:1746065123.773561:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261055104:12345-192.168.202.46@tcp:4:cat.0 Request processed in 19213us (19403us total) trans 17179872820 rc 0/0 00000100:00100000:1.0:1746065123.773569:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1516 00002000:00100000:1.0:1746065123.773579:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (2052096->2097151) req@ffff88012b4b1180 x1830881261055104/t17179872820(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/448 e 0 to 0 dl 1746065134 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.773587:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b1180 with x1830881261055104 ext(2052096->2097151) 00010000:00010000:1.0:1746065123.773837:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 25 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.773849:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 25 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:1.0:1746065123.773855:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4b1180 00000100:00100000:2.0:1746065123.776516:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881261054208:12345-192.168.202.46@tcp:4:cat.0 Request processed in 26631us (28351us total) trans 17179872821 rc 0/0 00000100:00100000:2.0:1746065123.776526:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1515 00002000:00100000:2.0:1746065123.776535:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3104767) req@ffff880093ba2300 x1830881261054208/t17179872821(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/448 e 0 to 0 dl 1746065134 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.776543:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2300 with x1830881261054208 ext(2097152->3104767) 00010000:00010000:2.0:1746065123.776550:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 25 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.776560:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 25 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746065123.776566:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba2300 00000100:00100000:0.0:1746065123.779426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.779473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.779514:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261056512 00000100:00100000:3.0:1746065123.779519:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261056384 00000100:00100000:2.0:1746065123.779521:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261056512 00000100:00100000:3.0:1746065123.779522:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261056384 00010000:00010000:2.0:1746065123.779548:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 25 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.779563:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10812 00000100:00100000:3.0:1746065123.779570:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:29012:x1830881261056384:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065123.779579:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5390 00010000:00010000:3.0:1746065123.779583:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065123.779585:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261056512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.779597:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.779598:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1bb expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065123.779614:0:21235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6e4, atime: 0x6812d6e4, ctime: 0x6812d6e4, blocks: 0x81d 00010000:00010000:2.0:1746065123.779617:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 25 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.779627:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.779629:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.779630:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 25 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.779635:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1bb expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.779645:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b12f expref: 25 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.779646:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1bb expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.779655:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc0800, rc 0) 00010000:00010000:2.0:1746065123.779668:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.779669:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.779673:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.779683:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:29012:x1830881261056384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 114us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.779688:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10812 00010000:00010000:2.0:1746065123.779713:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.779731:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.779748:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261056512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 163us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.779753:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5390 00010000:00010000:3.0:1746065123.779990:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.780000:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.780018:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.780026:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.780033:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.780038:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c3ad600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065123.780042:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.780049:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.780059:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.780065:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad600/0x14b4f8542d4f3418 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.780122:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261053696:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 38919us (39014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.780127:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10809 00000100:00100000:1.0:1746065123.786335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.786434:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261056640 00000100:00100000:2.0:1746065123.786441:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261056640 00010000:00010000:2.0:1746065123.786468:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 24 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.786495:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5391 00000100:00100000:2.0:1746065123.786501:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261056640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.786512:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.786535:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 24 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.786545:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 24 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.786563:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1800/0x14b4f8542d4f330e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3104767) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b136 expref: 24 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.786581:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.786582:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.786585:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.786592:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.786609:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.786646:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261056640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 145us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.786650:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5391 00010000:00010000:3.0:1746065123.786785:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.786793:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.786809:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.786834:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.786840:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.786846:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf01000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065123.786849:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.786855:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.786864:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.786868:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf01000/0x14b4f8542d4f340a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.786905:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261053824:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 46681us (47883us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.786911:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10807 00000100:00100000:0.0:1746065123.789443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.789532:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261056896 00000100:00100000:3.0:1746065123.789539:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261056896 00000100:00100000:3.0:1746065123.790206:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9039 00000100:00100000:3.0:1746065123.790214:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29007:x1830881261056896:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:3.0:1746065123.790254:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.790274:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f33bd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b183 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790288:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.790291:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065123.790312:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.790322:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 15 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790343:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790349:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790355:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b05d expref: 258 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790366:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b10c expref: 258 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790372:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.790394:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b10c expref: 258 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790403:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b10c expref: 258 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.790414:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259736704:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.790494:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b05d expref: 258 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790501:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b05d expref: 258 pid: 16767 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.790507:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259736832:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.790527:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790533:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 258 pid: 14644 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.790539:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259736960:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.790556:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790563:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 15 pid: 14644 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.790570:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259737088:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.790585:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 15 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.790591:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 15 pid: 16767 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.790597:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259737216:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.790621:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.793170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.793412:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261057152 00000100:00100000:3.0:1746065123.793420:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261057152 00002000:00100000:3.0:1746065123.793454:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b4b3100 x1830881261057152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.793462:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b3100 with x1830881261057152 ext(1048576->2097151) 00002000:00010000:3.0:1746065123.793466:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4b3100 00000100:00100000:3.0:1746065123.793495:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4948 00000100:00100000:3.0:1746065123.793502:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261057152:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.793543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.793569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.793582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.793596:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261057536 00000100:00100000:3.0:1746065123.793599:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261057536 00010000:00010000:3.0:1746065123.793615:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 16 pid: 14644 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.793633:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261057408 00000100:00100000:3.0:1746065123.793635:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261057408 00000100:00100000:0.0:1746065123.793641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065123.793644:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 259 pid: 14644 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.793655:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261057280 00000100:00100000:3.0:1746065123.793656:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261057280 00010000:00010000:3.0:1746065123.793663:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b10c expref: 260 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.793669:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261057664 00000100:00100000:3.0:1746065123.793671:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261057664 00010000:00010000:3.0:1746065123.793677:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 17 pid: 16767 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.793685:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5392 00000100:00100000:3.0:1746065123.793689:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881261057536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065123.793692:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5393 00010000:00010000:3.0:1746065123.793697:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065123.793699:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1960:x1830881261057408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.793702:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 17 pid: 14644 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.793706:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.793711:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 17 pid: 14644 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.793711:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 260 pid: 14644 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065123.793714:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5394 00000100:00100000:1.0:1746065123.793721:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1958:x1830881261057280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065123.793728:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.793730:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 260 pid: 14644 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.793731:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b10c expref: 260 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.793830:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.793835:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.793844:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.793876:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881261057536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 186us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.793882:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5392 00000100:00100000:3.0:1746065123.793897:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5395 00000100:00100000:3.0:1746065123.793902:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261057664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.793908:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.793912:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 16 pid: 16767 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.794014:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.794019:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.794024:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065123.794041:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1960:x1830881261057408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 343us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.794045:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5393 00000100:00100000:2.0:1746065123.794081:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259736704:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.794089:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259736832:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.794096:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f312b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afed expref: 259 pid: 14644 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.794108:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259736960:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.794115:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f3124 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afe6 expref: 16 pid: 14644 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.794122:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259737088:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.794128:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259737216:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.794151:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065123.794349:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b10c expref: 258 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.794360:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 15 pid: 16767 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.794375:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd01200/0x14b4f8542d4f32d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b10c expref: 258 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.794378:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c800/0x14b4f8542d4f311d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5afdf expref: 15 pid: 16767 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.794387:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.794390:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.794395:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065123.794395:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00000100:00100000:0.0:1746065123.794395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065123.794398:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065123.794403:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.794411:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261057664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 509us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.794416:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5395 00000100:00100000:1.0:1746065123.794419:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1958:x1830881261057280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 699us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.794424:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5394 00000100:00100000:3.0:1746065123.794425:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261057792 00000100:00100000:3.0:1746065123.794427:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261057792 00010000:00010000:3.0:1746065123.794436:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b05d expref: 257 pid: 16767 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.794448:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5396 00000100:00100000:3.0:1746065123.794453:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1959:x1830881261057792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.794458:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.794462:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b05d expref: 257 pid: 16767 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.794469:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b05d expref: 257 pid: 16767 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.794478:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f31da lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b05d expref: 257 pid: 16767 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.794485:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.794487:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.794493:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.794498:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.794510:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065123.794541:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065123.794542:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1959:x1830881261057792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 88us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.794547:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5396 00010000:00010000:0.0:1746065123.794547:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000040:00080000:0.0:1746065123.795077:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2539, 88 off213256 00000004:00080000:0.0:1746065123.795084:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723086268618ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065123.795122:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2478, 88 off207704 00000004:00080000:0.0:1746065123.795127:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723086311346ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065123.795138:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2479, 88 off207792 00000004:00080000:0.0:1746065123.795141:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723086325423ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065123.795148:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2540, 88 off213344 00000004:00080000:0.0:1746065123.795150:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723086334746ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065123.795155:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2541, 88 off213432 00000004:00080000:0.0:1746065123.795157:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723086342068ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065123.795163:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2480, 88 off207880 00000004:00080000:0.0:1746065123.795165:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723086350135ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065123.795171:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2481, 88 off207968 00000004:00080000:0.0:1746065123.795173:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723086357970ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065123.795179:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2482, 88 off208056 00000004:00080000:0.0:1746065123.795181:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723086365853ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065123.795187:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2542, 88 off213520 00000004:00080000:0.0:1746065123.795189:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723086374220ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065123.795195:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2483, 88 off208144 00000004:00080000:0.0:1746065123.795197:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723086382128ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065123.795203:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2543, 88 off213608 00000004:00080000:0.0:1746065123.795206:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723086390578ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065123.795212:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2484, 88 off208232 00000004:00080000:0.0:1746065123.795214:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723086399170ns, next at 666938887344ns, rc = 0 00000040:00080000:0.0:1746065123.795220:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2544, 88 off213696 00000004:00080000:0.0:1746065123.795222:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723086407263ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065123.795228:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2545, 88 off213784 00000004:00080000:0.0:1746065123.795231:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723086415375ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065123.795236:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2546, 88 off213872 00000004:00080000:0.0:1746065123.795238:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723086423263ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065123.795244:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2547, 88 off213960 00000004:00080000:0.0:1746065123.795246:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723086430898ns, next at 666984569566ns, rc = 0 00000040:00080000:0.0:1746065123.795252:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2485, 88 off208320 00000004:00080000:0.0:1746065123.795255:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723086439368ns, next at 666938887344ns, rc = 0 00000100:00100000:1.0:1746065123.799003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.799022:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261058048 00000100:00100000:2.0:1746065123.799029:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261058048 00000100:00100000:2.0:1746065123.799066:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9040 00000100:00100000:2.0:1746065123.799073:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:29015:x1830881261058048:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065123.799090:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.799103:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f400/0x14b4f8542d4f343b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1c2 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.799179:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.799190:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.799198:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.799208:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.799214:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.799219:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065123.804926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.804951:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261058304 00000100:00100000:1.0:1746065123.804957:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261058304 00000100:00100000:1.0:1746065123.804990:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9041 00000100:00100000:1.0:1746065123.804997:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:29016:x1830881261058304:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065123.805016:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.805030:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f3450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1c9 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.805110:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.805121:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.805131:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.805140:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.805146:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065123.805150:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:3.0:1746065123.810108:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261057152:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16599us (16937us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.810121:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4948 00002000:00100000:3.0:1746065123.810132:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b4b3100 x1830881261057152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.810140:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b3100 with x1830881261057152 ext(1048576->2097151) 00002000:00010000:3.0:1746065123.810145:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4b3100 00000100:00100000:1.0:1746065123.821500:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.821620:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261058432 00000100:00100000:3.0:1746065123.821628:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261058432 00000100:00100000:3.0:1746065123.821658:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10813 00000100:00100000:3.0:1746065123.821664:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:29012:x1830881261058432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.821678:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.821692:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1d0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065123.821712:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6e4, atime: 0x6812d6e3, ctime: 0x6812d6e4, blocks: 0x821 00010000:00010000:3.0:1746065123.821729:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.821730:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.821736:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d0 expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.821748:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d0 expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.821757:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f105e00, rc 0) 00000100:00100000:3.0:1746065123.821795:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:29012:x1830881261058432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 131us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.821804:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10813 00000100:00100000:2.0:1746065123.825360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.825646:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261058560 00000100:00100000:0.0:1746065123.825653:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261058560 00000100:00100000:0.0:1746065123.825699:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9042 00000100:00100000:0.0:1746065123.825706:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:29012:x1830881261058560:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065123.825720:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065123.825733:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1d7 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.825776:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065123.825785:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 259 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.825798:0:20754:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065123.825808:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 259 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.825840:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065123.825842:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065123.825846:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 259 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.825853:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ad200, rc 0) 00000100:00100000:0.0:1746065123.825886:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:29012:x1830881261058560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 181us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.825892:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9042 00010000:00010000:3.0:1746065123.826275:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1746065123.830012:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943094 is committed 00000004:00080000:3.0:1746065123.830021:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1778 committed 00000004:00010000:2.0:1746065123.830093:0:16767:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093ba3100 reply state ffff88012b913000 transno 8589943094 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065123.830103:0:16767:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746065123.830182:0:16767:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065123.830194:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29007:x1830881261056896:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 39978us (40755us total) trans 8589943094 rc 0/0 00000100:00100000:2.0:1746065123.830202:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9039 00010000:00010000:2.0:1746065123.830234:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.830246:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ad expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.830253:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.830280:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ad expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.830290:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ad expref: 11 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.830300:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259737344:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.830356:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2480 going to sleep for 11 seconds 00000004:00080000:3.0:1746065123.830361:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1840 committed 00000004:00080000:3.0:1746065123.830368:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1839 committed 00000004:00080000:3.0:1746065123.830370:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1838 committed 00000004:00080000:3.0:1746065123.830371:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1837 committed 00010000:00010000:2.0:1746065123.830371:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00000004:00080000:3.0:1746065123.830372:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1777 committed 00000004:00080000:3.0:1746065123.830374:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1836 committed 00000004:00080000:3.0:1746065123.830376:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1776 committed 00000004:00080000:3.0:1746065123.830377:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1835 committed 00000004:00080000:3.0:1746065123.830378:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1775 committed 00010000:00010000:2.0:1746065123.830378:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00000004:00080000:3.0:1746065123.830380:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1774 committed 00000004:00080000:3.0:1746065123.830382:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1773 committed 00000004:00080000:3.0:1746065123.830383:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1834 committed 00010000:00010000:2.0:1746065123.830383:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00080000:3.0:1746065123.830385:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1833 committed 00000004:00080000:3.0:1746065123.830386:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1772 committed 00000004:00080000:3.0:1746065123.830387:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1771 committed 00000004:00080000:3.0:1746065123.830388:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1832 committed 00010000:00010000:2.0:1746065123.830397:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 16767 initiator: MDT0 00000001:00080000:3.0:1746065123.830400:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943082 is committed 00000001:00080000:3.0:1746065123.830405:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943090 is committed 00010000:00010000:2.0:1746065123.830405:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 16767 initiator: MDT0 00000001:00080000:3.0:1746065123.830409:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943087 is committed 00010000:00010000:2.0:1746065123.830410:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.830414:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4cc1e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.830418:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.830423:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065123.830433:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.830436:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065123.830440:0:3282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 252 pid: 20754 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746065123.830445:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943091 is committed 00010000:00010000:2.0:1746065123.830447:0:3282:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 252 pid: 20754 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746065123.830448:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943089 is committed 00010000:00010000:2.0:1746065123.830453:0:3282:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 251 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.830469:0:3282:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 249 pid: 20754 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.830475:0:3282:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830881259737472:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065123.830491:0:3282:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.830588:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259737728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.830615:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.830629:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259738240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.830644:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.830654:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259738752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.830665:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.830674:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259739264:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.830685:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.830697:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746065123.830701:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259737856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.830714:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.830734:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259738368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.830743:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259737728 00000100:00100000:3.0:1746065123.830746:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065123.830749:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259737728 00000100:00100000:3.0:1746065123.830756:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259738880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.830767:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065123.830775:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259738240 00000100:00100000:3.0:1746065123.830777:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259739392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.830777:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259738240 00000100:00100000:1.0:1746065123.830782:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259738752 00000100:00100000:1.0:1746065123.830783:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259738752 00000100:00100000:1.0:1746065123.830789:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259739264 00000100:00100000:3.0:1746065123.830790:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065123.830790:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259739264 00000100:00100000:1.0:1746065123.830793:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259737856 00000100:00100000:1.0:1746065123.830794:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259737856 00000100:00100000:1.0:1746065123.830800:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259738368 00000100:00100000:1.0:1746065123.830801:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259738368 00000100:00100000:1.0:1746065123.830804:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259738880 00000100:00100000:3.0:1746065123.830806:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259739392 00000100:00100000:1.0:1746065123.830806:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259738880 00000100:00100000:3.0:1746065123.830809:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259739392 00000100:00100000:1.0:1746065123.830811:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10814 00000100:00100000:1.0:1746065123.830826:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+80:3295:x1830881259737728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065123.830833:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10815 00000100:00100000:0.0:1746065123.830843:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3295:x1830881259738240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.830987:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10816 00000100:00100000:1.0:1746065123.830992:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10817 00000100:00100000:3.0:1746065123.830993:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259738752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065123.830997:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259738240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (351us total) trans 17179872822 rc 0/0 00000100:00100000:1.0:1746065123.830998:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259739264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065123.831002:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10815 00000100:00100000:0.0:1746065123.831013:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10818 00000100:00100000:0.0:1746065123.831017:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:3295:x1830881259737856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.831022:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10819 00000100:00100000:3.0:1746065123.831026:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+80:3295:x1830881259738368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065123.831093:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:1.0:1746065123.831094:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+82:3295:x1830881259739264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (407us total) trans 17179872823 rc 0/0 00002000:00010000:0.0:1746065123.831096:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:0.0:1746065123.831098:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00000100:00100000:1.0:1746065123.831100:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10817 00002000:00010000:0.0:1746065123.831100:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:0.0:1746065123.831102:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:3.0:1746065123.831107:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259738368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (360us total) trans 21474840053 rc 0/0 00000100:00100000:1.0:1746065123.831110:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10820 00000100:00100000:3.0:1746065123.831113:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10819 00000100:00100000:1.0:1746065123.831115:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259738880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065123.831115:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259737728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 288us (500us total) trans 17179872824 rc 0/0 00000100:00100000:0.0:1746065123.831119:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10814 00000100:00100000:3.0:1746065123.831123:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10821 00000100:00100000:3.0:1746065123.831127:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+80:3295:x1830881259739392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065123.831168:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065123.831170:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065123.831172:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065123.831173:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065123.831175:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746065123.831185:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065123.831188:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.831190:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.831191:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:0.0:1746065123.831191:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259738752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 199us (525us total) trans 17179872825 rc 0/0 00002000:00010000:1.0:1746065123.831193:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065123.831196:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+82:3295:x1830881259739392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (405us total) trans 21474840055 rc 0/0 00000100:00100000:0.0:1746065123.831196:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10816 00000100:00100000:3.0:1746065123.831200:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10821 00000100:00100000:1.0:1746065123.831210:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+82:3295:x1830881259738880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (442us total) trans 21474840054 rc 0/0 00000100:00100000:1.0:1746065123.831215:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10820 00000100:00080000:1.0:1746065123.831229:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1746065123.831230:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba1180/2, rc 0, transno 21474840053 00000100:00080000:1.0:1746065123.831232:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065123.831234:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259738368:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065123.831241:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f045500/2, rc 0, transno 21474840054 00000100:00100000:3.0:1746065123.831243:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259738880:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065123.831249:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f046a00/2, rc 0, transno 21474840055 00000100:00100000:3.0:1746065123.831251:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259739392:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065123.831251:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065123.831253:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:0.0:1746065123.831254:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:0.0:1746065123.831256:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00000004:00080000:3.0:1746065123.831257:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49f800/2, rc 0, transno 17179872824 00002000:00010000:0.0:1746065123.831258:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065123.831262:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259737728:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065123.831268:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49fb80/2, rc 0, transno 17179872822 00000100:00100000:3.0:1746065123.831270:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259738240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065123.831273:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259737856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 256us (557us total) trans 21474840056 rc 0/0 00000004:00080000:3.0:1746065123.831275:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49d180/2, rc 0, transno 17179872825 00000100:00100000:3.0:1746065123.831277:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259738752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065123.831278:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10818 00000004:00080000:3.0:1746065123.831282:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49d500/2, rc 0, transno 17179872823 00000100:00100000:3.0:1746065123.831284:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259739264:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065123.831291:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba3b80/2, rc 0, transno 21474840056 00000100:00100000:3.0:1746065123.831293:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259737856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.831356:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259737600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.831533:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.831739:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259738112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.831758:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.831782:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259738624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.831796:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.831805:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259739136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.831836:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.831847:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259739648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.831860:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065123.831959:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259737600 00000100:00100000:1.0:1746065123.831963:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259737600 00000100:00100000:1.0:1746065123.831989:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259738112 00000100:00100000:1.0:1746065123.831992:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259738112 00000100:00100000:1.0:1746065123.832002:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259738624 00000100:00100000:1.0:1746065123.832004:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259738624 00000100:00100000:1.0:1746065123.832009:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259739136 00000100:00100000:3.0:1746065123.832010:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259739648 00000100:00100000:1.0:1746065123.832011:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259739136 00000100:00100000:3.0:1746065123.832012:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259739648 00000100:00100000:1.0:1746065123.832019:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10822 00000100:00100000:1.0:1746065123.832023:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+84:3298:x1830881259737600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.832033:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10823 00000100:00100000:3.0:1746065123.832037:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+84:3298:x1830881259738112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.832125:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+85:3298:x1830881259738112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (366us total) trans 21474840057 rc 0/0 00000100:00100000:3.0:1746065123.832130:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10823 00000100:00100000:3.0:1746065123.832138:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10824 00000100:00100000:3.0:1746065123.832142:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+84:3298:x1830881259738624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065123.832168:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10825 00000100:00100000:0.0:1746065123.832173:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3298:x1830881259739136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.832202:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10826 00000100:00100000:3.0:1746065123.832206:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+81:3298:x1830881259739648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.832253:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746065123.832261:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259737984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.832276:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.832278:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+82:3298:x1830881259739648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (417us total) trans 17179872826 rc 0/0 00000100:00100000:3.0:1746065123.832282:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10826 00000100:00100000:2.0:1746065123.832297:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259738496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.832298:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259737984 00000100:00100000:3.0:1746065123.832301:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259737984 00000100:00100000:3.0:1746065123.832310:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10827 00000100:00100000:2.0:1746065123.832311:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.832314:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+82:3298:x1830881259737984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.832319:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259739008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.832342:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.832349:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259739520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.832447:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259738496 00000100:00100000:1.0:1746065123.832450:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259738496 00000100:00100000:1.0:1746065123.832460:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259739008 00000100:00100000:1.0:1746065123.832462:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259739008 00000100:00100000:1.0:1746065123.832469:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10828 00000100:00100000:1.0:1746065123.832473:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3298:x1830881259738496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065123.832534:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065123.832537:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.832538:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.832540:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.832542:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065123.832700:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10829 00000100:00100000:0.0:1746065123.832705:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881259739008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065123.832768:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065123.832771:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065123.832772:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065123.832774:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065123.832776:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065123.832813:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+87:3298:x1830881259737984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 497us (535us total) trans 17179872827 rc 0/0 00000100:00100000:1.0:1746065123.832813:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+87:3298:x1830881259738496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 339us (500us total) trans 17179872828 rc 0/0 00000100:00100000:3.0:1746065123.832832:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10827 00002000:00010000:3.0:1746065123.832861:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00000100:00100000:2.0:1746065123.832861:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065123.832863:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065123.832865:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065123.832867:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065123.832868:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000004:00080000:2.0:1746065123.832881:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba0000/2, rc 0, transno 21474840057 00000100:00100000:3.0:1746065123.832883:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881259738624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 740us (1086us total) trans 21474840058 rc 0/0 00000100:00100000:2.0:1746065123.832884:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259738112:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065123.832889:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba1500/2, rc 0, transno 21474840058 00000100:00100000:2.0:1746065123.832892:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259738624:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065123.832897:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6d90e00/2, rc 0, transno 17179872826 00000100:00100000:2.0:1746065123.832900:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259739648:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065123.832912:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49e300/2, rc 0, transno 17179872827 00000100:00100000:2.0:1746065123.832914:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259737984:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065123.832919:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49d880/2, rc 0, transno 17179872828 00000100:00100000:2.0:1746065123.832922:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259738496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.832939:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259739520 00000100:00100000:2.0:1746065123.832942:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259739520 00000100:00100000:1.0:1746065123.832968:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10828 00000100:00100000:3.0:1746065123.833006:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10824 00000100:00100000:3.0:1746065123.833016:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10830 00000100:00100000:3.0:1746065123.833020:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881259739520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.833055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.833091:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+87:3298:x1830881259739520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (229us total) trans 17179872830 rc 0/0 00000100:00100000:3.0:1746065123.833095:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10830 00002000:00010000:3.0:1746065123.833166:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065123.833169:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:3.0:1746065123.833170:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:3.0:1746065123.833172:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:3.0:1746065123.833173:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065123.833191:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881259737600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1167us (1814us total) trans 21474840060 rc 0/0 00000100:00100000:3.0:1746065123.833196:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10822 00000004:00080000:3.0:1746065123.833216:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49c700/2, rc 0, transno 17179872830 00000100:00100000:3.0:1746065123.833219:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259739520:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065123.833225:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba0e00/2, rc 0, transno 21474840060 00000100:00100000:3.0:1746065123.833227:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259737600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065123.833432:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881259739008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 725us (1088us total) trans 17179872829 rc 0/0 00000100:00100000:0.0:1746065123.833438:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10829 00002000:00010000:0.0:1746065123.833473:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065123.833475:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065123.833477:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065123.833478:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065123.833480:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065123.833499:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3298:x1830881259739136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1325us (1661us total) trans 21474840059 rc 0/0 00000100:00100000:0.0:1746065123.833504:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10825 00000004:00080000:3.0:1746065123.833872:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49ca80/2, rc 0, transno 17179872829 00000100:00100000:3.0:1746065123.833876:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259739008:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065123.833884:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f047100/2, rc 0, transno 21474840059 00000100:00100000:3.0:1746065123.833886:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259739136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.834110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.834147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.834148:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261058816 00000100:00100000:3.0:1746065123.834151:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261058816 00010000:00010000:3.0:1746065123.834169:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ad expref: 8 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.834181:0:3282:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830881259737472:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065123.834189:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5397 00000100:00100000:3.0:1746065123.834193:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261058816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.834195:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.834200:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.834201:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f3434 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065123.834204:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ad expref: 8 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.834213:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ad expref: 7 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.834219:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259737344:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.834227:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009facfe00/0x14b4f8542d4f33ee lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ad expref: 7 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.834228:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.834235:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.834238:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065123.834241:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261058688 00000100:00100000:2.0:1746065123.834243:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261058688 00010000:00010000:3.0:1746065123.834245:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.834250:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.834256:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.834260:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.834265:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.834279:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065123.834314:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261058944 00000100:00100000:0.0:1746065123.834317:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261058944 00000100:00100000:2.0:1746065123.834672:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9043 00000100:00100000:2.0:1746065123.834678:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29007:x1830881261058688:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065123.834690:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.834698:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1de expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.834730:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1de expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.834737:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1de expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.834748:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.834750:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065123.834751:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd37800, rc 0) 00000100:00100000:3.0:1746065123.835108:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261058816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 912us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.835114:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5397 00010000:00010000:3.0:1746065123.835136:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835142:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065123.835153:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065123.835253:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835259:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835265:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835269:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009face800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065123.835271:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835276:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835283:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.835285:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065123.835287:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065123.835290:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3691 00010000:00010000:3.0:1746065123.835295:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009face800/0x14b4f8542d4f3473 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065123.835296:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29012:x1830881261058944:12345-192.168.202.46@tcp:49:cat.0 00010000:00010000:3.0:1746065123.835306:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835310:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835313:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835317:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009318f600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065123.835319:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835334:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835340:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065123.835342:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065123.835352:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835356:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f600/0x14b4f8542d4f3442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835364:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835368:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835372:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835377:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009318f800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065123.835379:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835383:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835389:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205600) 00010000:00010000:3.0:1746065123.835391:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065123.835393:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835397:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f800/0x14b4f8542d4f3449 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.835421:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f400/0x14b4f8542d4f343b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1c2 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.835426:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009318f400/0x14b4f8542d4f343b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1c2 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.835433:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009318f400, rc 0) 00000100:00100000:2.0:1746065123.835433:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29007:x1830881261058688:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 755us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.835438:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9043 00010000:00010000:2.0:1746065123.835457:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835462:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065123.835470:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065123.835503:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835508:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835513:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835517:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd37400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.835519:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835523:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835529:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.835530:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065123.835532:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835536:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f347a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835544:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835549:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835553:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835557:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c8b1200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.835559:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835563:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835568:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065123.835570:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065123.835572:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835576:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b1200/0x14b4f8542d4f3457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835583:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835588:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835592:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835595:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd8a600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.835597:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835602:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835608:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205600) 00010000:00010000:2.0:1746065123.835610:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065123.835612:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835616:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd8a600/0x14b4f8542d4f345e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.835637:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f3450 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1c9 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.835644:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c8b0400/0x14b4f8542d4f3450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1c9 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.835652:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c8b0400, rc 0) 00000100:00100000:0.0:1746065123.835928:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29012:x1830881261058944:12345-192.168.202.46@tcp:49:cat.0 Request processed in 631us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.835935:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3691 00000100:00100000:3.0:1746065123.836049:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29015:x1830881261058048:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 36975us (37050us total) trans 8589943095 rc 301/301 00000100:00100000:3.0:1746065123.836054:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9040 00000100:00100000:2.0:1746065123.836513:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:29016:x1830881261058304:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 31515us (31590us total) trans 8589943096 rc 301/301 00000100:00100000:2.0:1746065123.836519:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9041 00000100:00100000:0.0:1746065123.838421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.838487:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261059200 00000100:00100000:2.0:1746065123.838493:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261059200 00000100:00100000:2.0:1746065123.838519:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3692 00000100:00100000:2.0:1746065123.838524:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29007:x1830881261059200:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:2.0:1746065123.839298:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29007:x1830881261059200:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 771us (878us total) trans 8589943097 rc 0/0 00000100:00100000:2.0:1746065123.839305:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3692 00000100:00100000:3.0:1746065123.852596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.852639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.852691:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261059712 00000100:00100000:0.0:1746065123.852699:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261059712 00002000:00100000:0.0:1746065123.852731:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6d92d80 x1830881261059712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065123.852740:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d92d80 with x1830881261059712 ext(1048576->2097151) 00002000:00010000:0.0:1746065123.852744:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d92d80 00000100:00100000:0.0:1746065123.852768:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4949 00000100:00100000:0.0:1746065123.852774:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261059712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.852831:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261059456 00000100:00100000:2.0:1746065123.852833:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261059456 00000100:00100000:2.0:1746065123.852859:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3693 00000100:00100000:2.0:1746065123.852863:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29007:x1830881261059456:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:2.0:1746065123.853037:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29007:x1830881261059456:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 173us (449us total) trans 8589943098 rc 0/0 00000100:00100000:2.0:1746065123.853043:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3693 00000100:00100000:2.0:1746065123.861455:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261059712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8671us (8807us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.861464:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4949 00002000:00100000:2.0:1746065123.861474:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6d92d80 x1830881261059712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.861482:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d92d80 with x1830881261059712 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.861487:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d92d80 00000100:00100000:0.0:1746065123.870895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.870989:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261059840 00000100:00100000:1.0:1746065123.870997:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261059840 00000100:00100000:1.0:1746065123.871046:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10831 00000100:00100000:1.0:1746065123.871054:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:29012:x1830881261059840:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065123.871070:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.871086:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1e5 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065123.871105:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6e4, atime: 0x6812d6e4, ctime: 0x6812d6e4, blocks: 0x821 00010000:00010000:1.0:1746065123.871123:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.871125:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.871131:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1e5 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.871144:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1e5 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.871153:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd83600, rc 0) 00000100:00100000:1.0:1746065123.871198:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:29012:x1830881261059840:12345-192.168.202.46@tcp:101:cat.0 Request processed in 145us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.871203:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10831 00000100:00100000:0.0:1746065123.877362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.878531:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261060096 00000100:00100000:2.0:1746065123.878539:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261060096 00002000:00100000:2.0:1746065123.878581:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f046300 x1830881261060096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.878591:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046300 with x1830881261060096 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.878595:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f046300 00000100:00100000:2.0:1746065123.878623:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4950 00000100:00100000:2.0:1746065123.878631:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261060096:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065123.887808:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261060096:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9169us (10447us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.887843:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4950 00002000:00100000:2.0:1746065123.887853:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f046300 x1830881261060096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.887861:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046300 with x1830881261060096 ext(1048576->2097151) 00002000:00010000:2.0:1746065123.887866:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f046300 00000100:00100000:2.0:1746065123.892468:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.892566:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261060224 00000100:00100000:1.0:1746065123.892573:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261060224 00000100:00100000:2.0:1746065123.892592:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.892757:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10832 00000100:00100000:1.0:1746065123.892766:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881261060224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065123.892779:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.892794:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1ec expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065123.892796:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261060352 00000100:00100000:0.0:1746065123.892802:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261060352 00002000:00010000:1.0:1746065123.892812:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6e4, atime: 0x6812d6e4, ctime: 0x6812d6e4, blocks: 0x1643 00010000:00010000:1.0:1746065123.892850:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.892852:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065123.892859:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ec expref: 35 pid: 21998 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065123.892859:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10833 00000100:00100000:0.0:1746065123.892868:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881261060352:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065123.892872:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ec expref: 35 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.892878:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065123.892880:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd82200, rc 0) 00010000:00010000:0.0:1746065123.892891:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1f3 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065123.892908:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6e4, atime: 0x6812d6e3, ctime: 0x6812d6e4, blocks: 0x102b 00000100:00100000:1.0:1746065123.892915:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881261060224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 151us (456us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065123.892919:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065123.892921:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10832 00010000:00010000:0.0:1746065123.892921:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.892927:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1f3 expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.892938:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1f3 expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.892946:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd8b000, rc 0) 00000100:00100000:0.0:1746065123.892973:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261060352:12345-192.168.202.46@tcp:101:cat.0 Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.892979:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10833 00000100:00100000:0.0:1746065123.908504:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.908568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.908639:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261060608 00000100:00100000:1.0:1746065123.908650:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261060608 00000100:00100000:2.0:1746065123.908689:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261060736 00000100:00100000:2.0:1746065123.908693:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261060736 00002000:00100000:2.0:1746065123.908716:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009f045880 x1830881261060736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.908726:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045880 with x1830881261060736 ext(3145728->4194303) 00002000:00010000:2.0:1746065123.908730:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f045880 00000100:00100000:2.0:1746065123.908921:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4951 00000100:00100000:2.0:1746065123.908931:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261060736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065123.909699:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.910077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.910097:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261061120 00000100:00100000:3.0:1746065123.910102:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261061120 00002000:00100000:3.0:1746065123.910127:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a6d91c00 x1830881261061120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.910134:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d91c00 with x1830881261061120 ext(2097152->3145727) 00002000:00010000:3.0:1746065123.910139:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d91c00 00000100:00100000:3.0:1746065123.910151:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261061248 00000100:00100000:3.0:1746065123.910154:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261061248 00002000:00100000:3.0:1746065123.910179:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800a6d93b80 x1830881261061248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.910186:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d93b80 with x1830881261061248 ext(3145728->4194303) 00002000:00010000:3.0:1746065123.910188:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d93b80 00000100:00100000:3.0:1746065123.910201:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4952 00000100:00100000:3.0:1746065123.910207:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261061120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.910955:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4953 00000100:00100000:0.0:1746065123.910962:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261061248:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:1.0:1746065123.911271:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f047b80 x1830881261060608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.911279:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047b80 with x1830881261060608 ext(2097152->3145727) 00002000:00010000:1.0:1746065123.911283:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f047b80 00000100:00100000:1.0:1746065123.911302:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4954 00000100:00100000:1.0:1746065123.911308:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261060608:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065123.918441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.918553:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261061504 00000100:00100000:2.0:1746065123.918561:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261061504 00000100:00100000:2.0:1746065123.918613:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9044 00000100:00100000:2.0:1746065123.918621:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:29016:x1830881261061504:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065123.918641:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.918656:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37600/0x14b4f8542d4f34ab lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b1fa expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.918700:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37600/0x14b4f8542d4f34ab lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1fa expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.918711:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37600/0x14b4f8542d4f34ab lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1fa expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.918725:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.918727:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065123.918730:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd37600, rc 0) 00000100:00100000:2.0:1746065123.918766:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:29016:x1830881261061504:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 146us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.918771:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9044 00000100:00100000:2.0:1746065123.921802:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261060736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12865us (13227us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.921813:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4951 00002000:00100000:2.0:1746065123.921835:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009f045880 x1830881261060736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.921843:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f045880 with x1830881261060736 ext(3145728->4194303) 00002000:00010000:2.0:1746065123.921848:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f045880 00000100:00100000:3.0:1746065123.923579:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261061120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13366us (13875us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065123.923589:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4952 00002000:00100000:3.0:1746065123.923597:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a6d91c00 x1830881261061120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065123.923605:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d91c00 with x1830881261061120 ext(2097152->3145727) 00002000:00010000:3.0:1746065123.923609:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d91c00 00000100:00100000:1.0:1746065123.927838:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261060608:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16501us (19313us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065123.927848:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4954 00002000:00100000:1.0:1746065123.927858:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f047b80 x1830881261060608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065123.927866:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f047b80 with x1830881261060608 ext(2097152->3145727) 00002000:00010000:1.0:1746065123.927870:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f047b80 00000100:00100000:0.0:1746065123.928618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.928782:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261061760 00000100:00100000:2.0:1746065123.928789:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261061760 00000100:00100000:2.0:1746065123.928851:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9045 00000100:00100000:2.0:1746065123.928859:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:29020:x1830881261061760:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.928873:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.928887:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f34b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b201 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.928970:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.928981:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.928990:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929001:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929005:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929009:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929092:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929099:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929107:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065123.929113:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065123.929189:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929194:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929199:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929204:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd36e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.929207:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929212:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929220:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065123.929223:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065123.929226:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929230:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36e00/0x14b4f8542d4f34b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929245:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929249:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929256:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929259:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd37400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065123.929262:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929265:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929270:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205700) 00010000:00010000:2.0:1746065123.929271:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065123.929273:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929277:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.929308:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f34b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b201 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.929318:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b201 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.929335:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.929337:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065123.929339:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd37a00, rc 0) 00000100:00100000:2.0:1746065123.929378:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:29020:x1830881261061760:12345-192.168.202.46@tcp:101:cat.0 Request processed in 519us (761us total) trans 8589943099 rc 0/0 00000100:00100000:2.0:1746065123.929383:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9045 00000100:00100000:2.0:1746065123.931022:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261061248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20057us (20941us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065123.931031:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4953 00002000:00100000:2.0:1746065123.931039:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800a6d93b80 x1830881261061248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:39/0 lens 488/440 e 0 to 0 dl 1746065134 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.931047:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d93b80 with x1830881261061248 ext(3145728->4194303) 00002000:00010000:2.0:1746065123.931051:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d93b80 00000100:00100000:0.0:1746065123.931640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.931873:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261062016 00000100:00100000:3.0:1746065123.931879:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261062016 00000100:00100000:3.0:1746065123.931919:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9046 00000100:00100000:3.0:1746065123.931925:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:29016:x1830881261062016:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065123.931940:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.931942:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065123.931960:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37600/0x14b4f8542d4f34ab lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1fa expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.931977:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.931981:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065123.931990:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135452e00/0x14b4f8542d4f34d5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b208 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.932026:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.932035:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 248 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.932041:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1de expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.932047:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b201 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.932052:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 6/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.932075:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b201 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.932084:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b201 expref: 11 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.932098:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259739776:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.932171:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1de expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.932179:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1de expref: 8 pid: 16767 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.932186:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d93800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259739904:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.932208:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 248 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.932214:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 248 pid: 20754 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.932220:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259740032:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.932235:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.933878:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.933942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.933997:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261062272 00000100:00100000:2.0:1746065123.934002:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261062272 00000100:00100000:2.0:1746065123.934036:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3694 00000100:00100000:2.0:1746065123.934041:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:29020:x1830881261062272:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065123.934275:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:29020:x1830881261062272:12345-192.168.202.46@tcp:35:cat.0 Request processed in 232us (399us total) trans 8589943100 rc 0/0 00000100:00100000:2.0:1746065123.934281:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3694 00000100:00100000:3.0:1746065123.934418:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261062528 00000100:00100000:3.0:1746065123.934421:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261062528 00000100:00100000:3.0:1746065123.934449:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9047 00000100:00100000:3.0:1746065123.934454:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29015:x1830881261062528:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065123.934463:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.934465:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065123.934473:0:24350:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 249 pid: 20754 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.934491:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.934496:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.934502:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.934506:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065123.934515:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135452a00/0x14b4f8542d4f34e3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b20f expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.934541:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.934547:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.934552:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.934562:0:24350:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.934570:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065123.934946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.935051:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6d90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259739776:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065123.935059:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261062656 00000100:00100000:3.0:1746065123.935063:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261062656 00000100:00100000:3.0:1746065123.935089:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9048 00000100:00100000:3.0:1746065123.935094:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29012:x1830881261062656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065123.935102:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065123.935113:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b216 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.935134:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.935140:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 252 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.935148:0:16767:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.935156:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 252 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.935164:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.935167:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065123.935169:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.935174:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135452400, rc 0) 00000100:00100000:3.0:1746065123.935210:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29012:x1830881261062656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 113us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.935216:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9048 00000100:00100000:0.0:1746065123.935486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.935562:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6d93800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259739904:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.935571:0:14644:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from blocking AST (req@ffff88012f3d2300 x1830881259740032) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 251 pid: 20754 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.935581:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad200/0x14b4f8542d4f346c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d7 expref: 251 pid: 20754 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.935683:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261062784 00000100:00100000:3.0:1746065123.935686:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261062784 00010000:00010000:3.0:1746065123.935701:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1de expref: 9 pid: 16767 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.935718:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5398 00000100:00100000:3.0:1746065123.935723:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881261062784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.935731:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.935735:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1de expref: 9 pid: 16767 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.935741:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1de expref: 9 pid: 16767 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.935752:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37800/0x14b4f8542d4f3481 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1de expref: 9 pid: 16767 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.935759:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065123.935763:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.935767:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065123.935771:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.935790:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881261062784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.935795:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5398 00000100:00100000:1.0:1746065123.935938:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259740032:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.935954:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.935957:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065123.935962:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065123.935968:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065123.936882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.936933:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261062912 00000100:00100000:2.0:1746065123.936938:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261062912 00000100:00100000:2.0:1746065123.936972:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9049 00000100:00100000:2.0:1746065123.936977:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:29020:x1830881261062912:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.936989:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.937001:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f34f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b21d expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.937040:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065123.937049:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x40 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065123.937059:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x40 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065123.937092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.937193:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261063040 00000100:00100000:2.0:1746065123.937196:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261063040 00010000:00010000:2.0:1746065123.937210:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b201 expref: 15 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.937226:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5399 00000100:00100000:2.0:1746065123.937231:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881261063040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.937238:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.937242:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b201 expref: 15 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.937250:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b201 expref: 15 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.937262:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37a00/0x14b4f8542d4f34c7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b201 expref: 15 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.937272:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.937275:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x40 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065123.937280:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.937285:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.937293:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065123.937299:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.937303:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.937307:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x40 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065123.937410:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065123.937411:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065123.937416:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065123.937446:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:1959:x1830881261063040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 215us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.937452:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5399 00000040:00080000:1.0:1746065123.938101:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2548, 88 off214048 00000004:00080000:1.0:1746065123.938106:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723229289977ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065123.938161:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2486, 88 off208408 00000004:00080000:1.0:1746065123.938166:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723229350360ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065123.938189:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2487, 88 off208496 00000004:00080000:1.0:1746065123.938192:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723229376453ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065123.938199:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2549, 88 off214136 00000004:00080000:1.0:1746065123.938202:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723229386286ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065123.938209:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2550, 88 off214224 00000004:00080000:1.0:1746065123.938212:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723229396560ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065123.938233:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2488, 88 off208584 00000004:00080000:1.0:1746065123.938236:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723229421053ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065123.938245:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2489, 88 off208672 00000004:00080000:1.0:1746065123.938247:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723229432117ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065123.938254:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2490, 88 off208760 00000004:00080000:1.0:1746065123.938257:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723229441483ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065123.938264:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2551, 88 off214312 00000004:00080000:1.0:1746065123.938267:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723229451557ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065123.938272:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2491, 88 off208848 00000004:00080000:1.0:1746065123.938274:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723229459213ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065123.938287:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2552, 88 off214400 00000004:00080000:1.0:1746065123.938289:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723229473937ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065123.938295:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2492, 88 off208936 00000004:00080000:1.0:1746065123.938297:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723229481732ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065123.938308:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2553, 88 off214488 00000004:00080000:1.0:1746065123.938310:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723229495058ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065123.938316:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2554, 88 off214576 00000004:00080000:1.0:1746065123.938318:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723229502697ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065123.938335:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2555, 88 off214664 00000004:00080000:1.0:1746065123.938338:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723229522802ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065123.938345:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2556, 88 off214752 00000004:00080000:1.0:1746065123.938348:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723229532536ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065123.938361:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2493, 88 off209024 00000004:00080000:1.0:1746065123.938364:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723229548482ns, next at 666938887344ns, rc = 0 00000001:00080000:3.0:1746065123.954670:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943101 is committed 00000004:00080000:3.0:1746065123.954678:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1786 committed 00000004:00080000:3.0:1746065123.954684:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1849 committed 00000004:00080000:3.0:1746065123.954688:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1848 committed 00010000:00010000:1.0:1746065123.954689:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746065123.954690:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1847 committed 00000004:00080000:3.0:1746065123.954691:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1846 committed 00000004:00080000:3.0:1746065123.954693:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1785 committed 00000004:00080000:3.0:1746065123.954694:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1845 committed 00000004:00080000:3.0:1746065123.954696:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1784 committed 00000004:00080000:3.0:1746065123.954697:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1844 committed 00000004:00080000:3.0:1746065123.954699:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1783 committed 00000004:00080000:3.0:1746065123.954700:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1782 committed 00010000:00010000:1.0:1746065123.954700:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00000004:00080000:3.0:1746065123.954702:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1781 committed 00000004:00080000:3.0:1746065123.954703:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1843 committed 00010000:00010000:1.0:1746065123.954703:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:3.0:1746065123.954704:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1842 committed 00000004:00080000:3.0:1746065123.954705:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1780 committed 00010000:00010000:1.0:1746065123.954706:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00000004:00080000:3.0:1746065123.954707:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1779 committed 00000004:00080000:3.0:1746065123.954708:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1841 committed 00010000:00010000:1.0:1746065123.954713:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.954718:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00000001:00080000:3.0:1746065123.954730:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943098 is committed 00000001:00080000:3.0:1746065123.954738:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943095 is committed 00010000:00010000:1.0:1746065123.954745:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.954755:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 11 pid: 14644 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065123.954766:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259740160:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.954895:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259740800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.954955:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259740288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.954962:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.955050:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.955072:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259741312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.955091:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.955103:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259741824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.955115:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.955130:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1746065123.955135:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259740672:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.955148:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.955158:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259741440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.955168:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.955178:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259741952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.955189:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.955210:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259740800 00000100:00100000:2.0:1746065123.955216:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259740800 00000100:00100000:2.0:1746065123.955250:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259741312 00000100:00100000:2.0:1746065123.955253:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259741312 00000100:00100000:2.0:1746065123.955263:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259741824 00000100:00100000:2.0:1746065123.955265:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259741824 00000100:00100000:2.0:1746065123.955272:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259740672 00000100:00100000:2.0:1746065123.955274:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259740672 00000100:00100000:2.0:1746065123.955281:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259741440 00000100:00100000:2.0:1746065123.955282:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259741440 00000100:00100000:2.0:1746065123.955287:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259741952 00000100:00100000:2.0:1746065123.955289:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259741952 00000100:00100000:2.0:1746065123.955297:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10834 00000100:00100000:2.0:1746065123.955303:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3297:x1830881259740800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065123.955310:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10835 00000100:00100000:0.0:1746065123.955315:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+89:3297:x1830881259741312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065123.955439:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065123.955439:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065123.955442:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:0.0:1746065123.955442:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.955444:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:0.0:1746065123.955444:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.955445:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:0.0:1746065123.955445:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.955447:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00002000:00010000:0.0:1746065123.955447:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065123.955491:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955508:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259740416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.955524:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955532:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259740928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.955544:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955551:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259741056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.955561:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955566:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259741568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.955576:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955582:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259742080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.955591:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955598:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746065123.955602:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259740544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.955613:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955620:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259741184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.955632:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955637:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259741696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.955647:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955652:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259742208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.955669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.955689:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259740288 00000100:00100000:3.0:1746065123.955692:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259740288 00000100:00100000:3.0:1746065123.955704:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259740416 00000100:00100000:3.0:1746065123.955705:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259740416 00000100:00100000:3.0:1746065123.955710:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259740928 00000100:00100000:3.0:1746065123.955712:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259740928 00000100:00100000:3.0:1746065123.955717:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259741056 00000100:00100000:3.0:1746065123.955719:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259741056 00000100:00100000:3.0:1746065123.955723:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259741568 00000100:00100000:3.0:1746065123.955725:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259741568 00000100:00100000:3.0:1746065123.955729:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259742080 00000100:00100000:3.0:1746065123.955730:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259742080 00000100:00100000:3.0:1746065123.955735:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259740544 00000100:00100000:3.0:1746065123.955736:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259740544 00000100:00100000:3.0:1746065123.955742:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259741184 00000100:00100000:3.0:1746065123.955743:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259741184 00000100:00100000:3.0:1746065123.955747:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259741696 00000100:00100000:3.0:1746065123.955749:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259741696 00000100:00100000:3.0:1746065123.955753:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259742208 00000100:00100000:3.0:1746065123.955755:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259742208 00000100:00100000:3.0:1746065123.955761:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10836 00000100:00100000:3.0:1746065123.955765:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+93:3297:x1830881259741824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065123.955861:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065123.955864:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065123.955865:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065123.955867:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065123.955869:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065123.955922:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3297:x1830881259740800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 618us (872us total) trans 21474840061 rc 0/0 00000100:00100000:2.0:1746065123.955927:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10834 00000100:00100000:2.0:1746065123.955945:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10837 00000100:00100000:2.0:1746065123.955950:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3297:x1830881259740672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.956062:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+93:3297:x1830881259741824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 296us (945us total) trans 21474840062 rc 0/0 00000100:00100000:3.0:1746065123.956067:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10836 00000100:00100000:3.0:1746065123.956079:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10838 00000100:00100000:3.0:1746065123.956084:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+94:3297:x1830881259741440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.956084:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10839 00000100:00100000:1.0:1746065123.956090:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:3297:x1830881259741952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.956112:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10840 00000100:00100000:1.0:1746065123.956116:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3295:x1830881259740288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065123.956154:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065123.956156:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065123.956158:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065123.956159:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065123.956161:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065123.956178:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:3297:x1830881259741440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1008us total) trans 17179872832 rc 0/0 00002000:00010000:1.0:1746065123.956179:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065123.956182:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00000100:00100000:3.0:1746065123.956183:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10838 00002000:00010000:1.0:1746065123.956184:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.956185:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.956187:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065123.956195:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10841 00000100:00100000:3.0:1746065123.956198:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+94:3295:x1830881259740416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.956206:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3295:x1830881259740288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (714us total) trans 21474840063 rc 0/0 00000100:00100000:1.0:1746065123.956210:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10840 00000100:00100000:1.0:1746065123.956219:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10842 00000100:00100000:1.0:1746065123.956223:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+94:3295:x1830881259740928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065123.956263:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065123.956265:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065123.956267:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065123.956268:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:3.0:1746065123.956270:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00002000:00010000:1.0:1746065123.956274:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:1.0:1746065123.956276:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.956277:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.956279:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.956280:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5699 -> 5699 00000100:00100000:3.0:1746065123.956286:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+96:3295:x1830881259740416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (761us total) trans 17179872833 rc 0/0 00000100:00100000:3.0:1746065123.956291:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10841 00000100:00100000:1.0:1746065123.956292:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+96:3295:x1830881259740928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (747us total) trans 17179872834 rc 0/0 00000100:00100000:1.0:1746065123.956296:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10842 00000100:00100000:3.0:1746065123.956300:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10843 00000100:00100000:1.0:1746065123.956302:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10844 00000100:00100000:3.0:1746065123.956304:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+92:3295:x1830881259741056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.956306:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3295:x1830881259741568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.956342:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10845 00000100:00100000:3.0:1746065123.956346:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+92:3295:x1830881259742080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065123.956385:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065123.956387:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.956389:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.956391:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.956392:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065123.956410:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3295:x1830881259742080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (817us total) trans 21474840065 rc 0/0 00000100:00100000:1.0:1746065123.956410:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+94:3295:x1830881259741568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (832us total) trans 21474840064 rc 0/0 00000100:00100000:3.0:1746065123.956414:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10845 00002000:00010000:2.0:1746065123.956493:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065123.956495:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:2.0:1746065123.956497:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:2.0:1746065123.956499:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:2.0:1746065123.956501:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065123.956521:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3297:x1830881259740672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 571us (1371us total) trans 17179872835 rc 0/0 00000100:00100000:0.0:1746065123.956687:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+95:3297:x1830881259741312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1370us (1593us total) trans 17179872831 rc 0/0 00000100:00100000:1.0:1746065123.956727:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10844 00000100:00100000:2.0:1746065123.956730:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10837 00000100:00100000:1.0:1746065123.956738:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10846 00000100:00100000:1.0:1746065123.956742:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3295:x1830881259740544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.956746:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10847 00000100:00100000:2.0:1746065123.956750:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+92:3295:x1830881259741184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.956773:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10848 00000100:00100000:2.0:1746065123.956777:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+94:3295:x1830881259741696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065123.956808:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065123.956811:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.956812:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065123.956831:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.956833:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746065123.956849:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065123.956851:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:1.0:1746065123.956851:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3295:x1830881259740544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (1236us total) trans 21474840066 rc 0/0 00002000:00010000:2.0:1746065123.956853:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.956854:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.956856:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065123.956856:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10846 00000100:00100000:1.0:1746065123.956865:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10849 00000100:00100000:1.0:1746065123.956869:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3295:x1830881259742208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.956872:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+95:3295:x1830881259741696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (1224us total) trans 17179872836 rc 0/0 00000100:00100000:2.0:1746065123.956876:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10848 00000100:00100000:1.0:1746065123.956935:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3295:x1830881259742208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1265us total) trans 17179872837 rc 0/0 00000100:00100000:1.0:1746065123.956939:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10849 00000100:00100000:1.0:1746065123.957013:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259740160:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065123.957039:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135452e00/0x14b4f8542d4f34d5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 11 pid: 14644 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065123.957052:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 10 pid: 14644 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.957060:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 10 pid: 14644 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.957067:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+95:3297:x1830881259741952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 978us (1876us total) trans 17179872838 rc 0/0 00000100:00100000:3.0:1746065123.957072:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10839 00010000:00010000:1.0:1746065123.957080:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135453000, rc 0) 00000100:00100000:1.0:1746065123.957103:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:29016:x1830881261062016:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 25179us (25465us total) trans 8589943101 rc 0/0 00000100:00100000:1.0:1746065123.957109:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9046 00000100:00100000:3.0:1746065123.957155:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+93:3295:x1830881259741056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 851us (1592us total) trans 21474840067 rc 0/0 00000100:00100000:3.0:1746065123.957160:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10843 00000004:00080000:3.0:1746065123.957183:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fb800/2, rc 0, transno 21474840066 00000100:00100000:3.0:1746065123.957187:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259740544:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065123.957194:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6145f80/2, rc 0, transno 17179872836 00000100:00100000:3.0:1746065123.957201:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259741696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065123.957206:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6144000/2, rc 0, transno 17179872837 00000100:00100000:3.0:1746065123.957208:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259742208:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065123.957215:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913faa00/2, rc 0, transno 21474840063 00000100:00100000:3.0:1746065123.957217:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259740288:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065123.957222:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6145880/2, rc 0, transno 17179872833 00000100:00100000:3.0:1746065123.957224:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259740416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065123.957229:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6146300/2, rc 0, transno 17179872834 00000100:00100000:3.0:1746065123.957232:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259740928:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065123.957237:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fad80/2, rc 0, transno 21474840067 00000100:00100000:3.0:1746065123.957240:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259741056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065123.957263:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10835 00000100:00100000:2.0:1746065123.957293:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065123.957301:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259742336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.957336:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065123.957354:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6145c00/2, rc 0, transno 17179872835 00000100:00100000:0.0:1746065123.957357:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259740672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065123.957363:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6145500/2, rc 0, transno 17179872832 00000100:00100000:0.0:1746065123.957365:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259741440:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065123.957370:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6146d80/2, rc 0, transno 17179872838 00000100:00100000:0.0:1746065123.957373:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259741952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065123.957379:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fbb80/2, rc 0, transno 21474840061 00000100:00100000:0.0:1746065123.957382:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259740800:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065123.957388:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6147480/2, rc 0, transno 17179872831 00000100:00100000:0.0:1746065123.957390:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259741312:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065123.957396:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba1c00/2, rc 0, transno 21474840062 00000100:00100000:0.0:1746065123.957398:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259741824:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065123.957409:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:2.0:1746065123.957411:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065123.957413:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.957415:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065123.957416:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000004:00080000:3.0:1746065123.957447:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba0700/2, rc 0, transno 21474840064 00000100:00100000:3.0:1746065123.957450:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259741568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065123.957456:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380c000/2, rc 0, transno 21474840065 00000100:00100000:3.0:1746065123.957458:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259742080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.957623:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3295:x1830881259741184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 871us (1988us total) trans 21474840068 rc 0/0 00000100:00100000:2.0:1746065123.957628:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10847 00000100:00100000:2.0:1746065123.957637:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259742336 00000100:00100000:2.0:1746065123.957640:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259742336 00000100:00100000:2.0:1746065123.957656:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10850 00000100:00100000:2.0:1746065123.957659:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3298:x1830881259742336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.957739:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3298:x1830881259742336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (414us total) trans 17179872839 rc 0/0 00000100:00100000:2.0:1746065123.957744:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10850 00000004:00080000:2.0:1746065123.957762:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f15df80/2, rc 0, transno 17179872839 00000100:00100000:2.0:1746065123.957765:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259742336:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065123.957911:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f8a80/2, rc 0, transno 21474840068 00000100:00100000:3.0:1746065123.957915:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259741184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065123.959300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.959360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065123.959368:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261063168 00000100:00100000:1.0:1746065123.959374:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261063168 00000100:00100000:1.0:1746065123.959415:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9050 00000100:00100000:1.0:1746065123.959422:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:29016:x1830881261063168:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:2.0:1746065123.959428:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261063296 00000100:00100000:2.0:1746065123.959430:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261063296 00010000:00010000:1.0:1746065123.959441:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.959448:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 11 pid: 14644 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.959454:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b224 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.959465:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5400 00000100:00100000:2.0:1746065123.959469:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881261063296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.959477:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065123.959481:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 12 pid: 14644 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065123.959492:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.959598:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 12 pid: 14644 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.959614:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135453000/0x14b4f8542d4f34dc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b208 expref: 12 pid: 14644 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.959625:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.959629:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065123.959634:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.959640:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.959645:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065123.959650:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065123.959656:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.959661:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065123.959712:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.959719:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065123.959721:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065123.959723:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065123.959726:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065123.959734:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133084600, rc 0) 00010000:00010000:3.0:1746065123.959790:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065123.959796:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065123.959879:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881261063296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 407us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065123.959881:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:29016:x1830881261063168:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 459us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.959885:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5400 00000100:00100000:1.0:1746065123.959885:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9050 00000040:00080000:3.0:1746065123.960497:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2557, 88 off214840 00000004:00080000:3.0:1746065123.960503:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723251687259ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065123.960547:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2494, 88 off209112 00000004:00080000:3.0:1746065123.960551:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723251735332ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065123.960696:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2495, 88 off209200 00000004:00080000:3.0:1746065123.960700:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723251884427ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065123.960707:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2558, 88 off214928 00000004:00080000:3.0:1746065123.960709:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723251894112ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065123.960717:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2559, 88 off215016 00000004:00080000:3.0:1746065123.960719:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723251904032ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065123.960728:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2496, 88 off209288 00000004:00080000:3.0:1746065123.960730:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723251914875ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065123.960737:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2497, 88 off209376 00000004:00080000:3.0:1746065123.960739:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723251924152ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065123.960745:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2498, 88 off209464 00000004:00080000:3.0:1746065123.960747:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723251931359ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065123.960752:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2560, 88 off215104 00000004:00080000:3.0:1746065123.960754:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723251938382ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065123.960760:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2499, 88 off209552 00000004:00080000:3.0:1746065123.960762:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723251947122ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065123.960768:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2561, 88 off215192 00000004:00080000:3.0:1746065123.960770:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723251954842ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065123.960777:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2500, 88 off209640 00000004:00080000:3.0:1746065123.960779:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723251963715ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065123.960785:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2562, 88 off215280 00000004:00080000:3.0:1746065123.960786:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723251971219ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065123.960793:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2563, 88 off215368 00000004:00080000:3.0:1746065123.960795:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723251979732ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065123.960801:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2564, 88 off215456 00000004:00080000:3.0:1746065123.960804:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723251988967ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065123.960811:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2565, 88 off215544 00000004:00080000:3.0:1746065123.960827:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723251997999ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065123.960836:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2501, 88 off209728 00000004:00080000:3.0:1746065123.960838:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723252022777ns, next at 666938887344ns, rc = 0 00000001:00080000:3.0:1746065123.976234:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943102 is committed 00000004:00080000:3.0:1746065123.976242:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1794 committed 00000004:00080000:3.0:1746065123.976254:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1858 committed 00000004:00080000:3.0:1746065123.976258:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1857 committed 00000004:00080000:3.0:1746065123.976260:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1856 committed 00000004:00080000:3.0:1746065123.976261:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1855 committed 00000004:00080000:3.0:1746065123.976263:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1793 committed 00000004:00080000:3.0:1746065123.976264:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1854 committed 00000004:00080000:3.0:1746065123.976266:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1792 committed 00000004:00080000:3.0:1746065123.976267:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1853 committed 00000004:00080000:3.0:1746065123.976268:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1791 committed 00000004:00080000:3.0:1746065123.976269:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1790 committed 00000004:00080000:3.0:1746065123.976271:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1789 committed 00000004:00080000:3.0:1746065123.976272:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1852 committed 00000004:00080000:3.0:1746065123.976273:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1851 committed 00000004:00080000:3.0:1746065123.976274:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1788 committed 00000004:00080000:3.0:1746065123.976276:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1787 committed 00000004:00080000:3.0:1746065123.976277:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1850 committed 00010000:00010000:2.0:1746065123.976295:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.976308:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.976311:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065123.976314:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065123.976321:0:24350:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065123.976336:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065123.976342:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.976348:0:24350:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.976353:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.976359:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.976365:0:24350:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.976370:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.976388:0:24350:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065123.976398:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259743232:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065123.976401:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259742464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.976440:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259742592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065123.976514:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259742848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.976636:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065123.976648:0:24350:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.976654:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259742976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.976655:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259744640:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065123.976669:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.976674:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065123.976684:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065123.976684:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259743616:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746065123.976690:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065123.976699:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065123.976709:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259744128:0@lo:2:osp-syn-1-0.0 00000004:00200000:2.0:1746065123.976719:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000100:00100000:1.0:1746065123.976720:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:2.0:1746065123.976723:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065123.976735:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065123.976742:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259742464 00010000:00010000:2.0:1746065123.976744:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065123.976747:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259742464 00010000:00010000:2.0:1746065123.976764:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd36000/0x14b4f8542d4f34f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b21d expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.976770:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259742976 00000100:00100000:1.0:1746065123.976772:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259742976 00010000:00010000:2.0:1746065123.976775:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b21d expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065123.976779:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259743616 00000100:00100000:1.0:1746065123.976780:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259743616 00010000:00010000:2.0:1746065123.976781:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065123.976783:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065123.976785:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd37400, rc 0) 00000100:00100000:1.0:1746065123.976789:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259744128 00000100:00100000:1.0:1746065123.976790:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259744128 00000100:00100000:1.0:1746065123.976800:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10851 00000100:00100000:1.0:1746065123.976806:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+94:3298:x1830881259742464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.976809:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:29020:x1830881261062912:12345-192.168.202.46@tcp:101:cat.0 Request processed in 39831us (39928us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.976834:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9049 00000100:00100000:3.0:1746065123.976902:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.976918:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259743104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.976931:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.976944:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259743744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.976954:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.976960:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259744256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.976969:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.976975:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746065123.976979:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259742720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.976991:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.976997:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259743360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065123.977009:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.977016:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259742592 00000100:00100000:3.0:1746065123.977019:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259742592 00000100:00100000:0.0:1746065123.977020:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259743488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065123.977030:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259743104 00000100:00100000:3.0:1746065123.977031:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259743104 00000100:00100000:0.0:1746065123.977033:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.977037:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259743744 00000100:00100000:3.0:1746065123.977039:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259743744 00000100:00100000:0.0:1746065123.977039:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259744000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.977044:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259744256 00000100:00100000:3.0:1746065123.977045:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259744256 00000100:00100000:3.0:1746065123.977050:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259742720 00000100:00100000:0.0:1746065123.977051:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.977052:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259742720 00000100:00100000:3.0:1746065123.977057:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259742848 00000100:00100000:0.0:1746065123.977057:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259744512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.977058:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259742848 00000100:00100000:3.0:1746065123.977063:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259743488 00000100:00100000:3.0:1746065123.977065:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259743488 00000100:00100000:0.0:1746065123.977068:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.977072:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259744000 00000100:00100000:3.0:1746065123.977073:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259744000 00000100:00100000:3.0:1746065123.977078:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259744512 00000100:00100000:3.0:1746065123.977080:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259744512 00000100:00100000:0.0:1746065123.977081:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065123.977085:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259743360 00000100:00100000:3.0:1746065123.977086:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259743360 00000100:00100000:0.0:1746065123.977088:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259743872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065123.977092:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10852 00000100:00100000:3.0:1746065123.977096:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+100:3298:x1830881259742976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065123.977100:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065123.977106:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259744384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065123.977116:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065123.977165:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259743872 00000100:00100000:2.0:1746065123.977168:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259743872 00000100:00100000:2.0:1746065123.977179:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259744384 00000100:00100000:2.0:1746065123.977181:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259744384 00000100:00100000:2.0:1746065123.977188:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10853 00000100:00100000:2.0:1746065123.977192:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+102:3298:x1830881259743616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065123.977305:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065123.977308:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065123.977310:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065123.977312:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065123 -> 1746065123 00002000:00010000:2.0:1746065123.977314:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00002000:00010000:1.0:1746065123.977341:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065123.977343:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.977346:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.977348:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.977349:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746065123.977350:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+103:3298:x1830881259743616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (649us total) trans 17179872840 rc 0/0 00000100:00100000:2.0:1746065123.977355:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10853 00000100:00100000:2.0:1746065123.977366:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10854 00000100:00100000:1.0:1746065123.977366:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+101:3298:x1830881259742464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 560us (731us total) trans 21474840069 rc 0/0 00000100:00100000:2.0:1746065123.977370:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+102:3298:x1830881259744128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.977370:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10851 00000100:00100000:1.0:1746065123.977378:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10855 00000100:00100000:1.0:1746065123.977382:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+100:3295:x1830881259742592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065123.977430:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065123.977432:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.977433:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.977435:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.977435:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065123.977436:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746065123.977437:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.977439:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065123.977440:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.977442:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065123.977453:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+103:3298:x1830881259744128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (731us total) trans 17179872841 rc 0/0 00000100:00100000:1.0:1746065123.977457:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+101:3295:x1830881259742592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (555us total) trans 21474840070 rc 0/0 00000100:00100000:2.0:1746065123.977458:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10854 00000100:00100000:1.0:1746065123.977461:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10855 00000100:00100000:2.0:1746065123.977467:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10856 00000100:00100000:2.0:1746065123.977471:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+100:3295:x1830881259743104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065123.977519:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:3.0:1746065123.977521:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065123.977522:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065123.977523:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.977524:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065123.977525:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065123.977526:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00002000:00010000:2.0:1746065123.977526:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.977527:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065123.977529:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065123.977543:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+102:3298:x1830881259742976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 447us (873us total) trans 21474840071 rc 0/0 00000100:00100000:2.0:1746065123.977543:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+102:3295:x1830881259743104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (611us total) trans 21474840072 rc 0/0 00000004:00080000:0.0:1746065123.977590:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009009ed80/2, rc 0, transno 21474840070 00000100:00100000:0.0:1746065123.977594:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259742592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065123.977600:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009009f100/2, rc 0, transno 21474840072 00000100:00100000:0.0:1746065123.977602:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259743104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.977708:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10857 00000100:00100000:1.0:1746065123.977713:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:3295:x1830881259743744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065123.977773:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065123.977775:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.977776:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.977778:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.977779:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065123.977797:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3295:x1830881259743744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (841us total) trans 17179872842 rc 0/0 00000100:00100000:1.0:1746065123.977802:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10857 00000100:00100000:1.0:1746065123.977811:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10858 00000004:00080000:0.0:1746065123.977811:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49f100/2, rc 0, transno 17179872842 00000100:00100000:1.0:1746065123.977828:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:3295:x1830881259744256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065123.977829:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259743744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065123.977854:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065123.977860:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259744768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065123.977877:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065123.977888:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065123.977890:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.977892:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.977893:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.977895:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065123.977912:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3295:x1830881259744256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (941us total) trans 17179872843 rc 0/0 00000100:00100000:1.0:1746065123.977917:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10858 00000004:00080000:0.0:1746065123.977921:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45ca80/2, rc 0, transno 17179872843 00000100:00100000:1.0:1746065123.977924:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259744768 00000100:00100000:0.0:1746065123.977924:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259744256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.977926:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259744768 00000100:00100000:1.0:1746065123.977936:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10859 00000100:00100000:1.0:1746065123.977939:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:3295:x1830881259742720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065123.977994:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065123.977996:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.977998:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065123.978000:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.978001:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746065123.978017:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3295:x1830881259742720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (1026us total) trans 21474840073 rc 0/0 00000100:00100000:1.0:1746065123.978022:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10859 00000004:00080000:0.0:1746065123.978029:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009009f800/2, rc 0, transno 21474840073 00000100:00100000:1.0:1746065123.978030:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10860 00000100:00100000:0.0:1746065123.978032:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259742720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.978034:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:3297:x1830881259742848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.978101:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3297:x1830881259742848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1092us total) trans 21474840074 rc 0/0 00000100:00100000:1.0:1746065123.978108:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10860 00000004:00080000:0.0:1746065123.978111:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009009ca80/2, rc 0, transno 21474840074 00000100:00100000:0.0:1746065123.978114:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259742848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.978116:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10861 00000100:00100000:1.0:1746065123.978120:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:3297:x1830881259743488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.978183:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3297:x1830881259743488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (1149us total) trans 21474840075 rc 0/0 00000100:00100000:1.0:1746065123.978187:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10861 00000004:00080000:0.0:1746065123.978193:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6d90700/2, rc 0, transno 21474840075 00000100:00100000:0.0:1746065123.978196:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259743488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.978199:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10862 00000100:00100000:1.0:1746065123.978203:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3297:x1830881259744000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065123.978252:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065123.978254:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.978256:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.978257:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.978258:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065123.978275:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+104:3297:x1830881259744000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1223us total) trans 17179872844 rc 0/0 00000100:00100000:1.0:1746065123.978279:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10862 00000004:00080000:0.0:1746065123.978285:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45dc00/2, rc 0, transno 17179872844 00000100:00100000:1.0:1746065123.978287:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10863 00000100:00100000:0.0:1746065123.978288:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259744000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.978292:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3297:x1830881259744512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.978368:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+104:3297:x1830881259744512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1297us total) trans 17179872845 rc 0/0 00000100:00100000:1.0:1746065123.978373:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10863 00000004:00080000:0.0:1746065123.978378:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90af800/2, rc 0, transno 17179872845 00000100:00100000:0.0:1746065123.978381:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259744512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.978382:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10864 00000100:00100000:1.0:1746065123.978386:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+102:3295:x1830881259743360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065123.978435:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065123.978438:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.978439:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.978440:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065123.978442:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065123.978458:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3295:x1830881259743360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1376us total) trans 21474840076 rc 0/0 00000100:00100000:1.0:1746065123.978462:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10864 00000004:00080000:0.0:1746065123.978469:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6d93800/2, rc 0, transno 21474840076 00000100:00100000:1.0:1746065123.978471:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10865 00000100:00100000:0.0:1746065123.978472:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259743360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065123.978475:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3295:x1830881259743872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065123.978529:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:1.0:1746065123.978531:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.978533:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.978535:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065123.978536:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5699 -> 5699 00000100:00100000:1.0:1746065123.978552:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+104:3295:x1830881259743872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (1450us total) trans 17179872846 rc 0/0 00000100:00100000:1.0:1746065123.978557:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10865 00000004:00080000:0.0:1746065123.978563:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45ce00/2, rc 0, transno 17179872846 00000100:00100000:1.0:1746065123.978566:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10866 00000100:00100000:0.0:1746065123.978566:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259743872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.978570:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3295:x1830881259744384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.978636:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+104:3295:x1830881259744384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1517us total) trans 17179872847 rc 0/0 00000100:00100000:1.0:1746065123.978640:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10866 00000004:00080000:0.0:1746065123.978645:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90adc00/2, rc 0, transno 17179872847 00000100:00100000:0.0:1746065123.978648:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259744384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.978649:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10867 00000100:00100000:1.0:1746065123.978652:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3297:x1830881259744768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065123.978715:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+104:3297:x1830881259744768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (837us total) trans 17179872848 rc 0/0 00000100:00100000:1.0:1746065123.978720:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10867 00000004:00080000:0.0:1746065123.978725:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4b1500/2, rc 0, transno 17179872848 00000100:00100000:0.0:1746065123.978728:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259744768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065123.978832:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10856 00000100:00100000:3.0:1746065123.978836:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10852 00000004:00080000:2.0:1746065123.978858:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49c380/2, rc 0, transno 17179872840 00000100:00100000:2.0:1746065123.978861:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259743616:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065123.978867:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45fb80/2, rc 0, transno 17179872841 00000100:00100000:2.0:1746065123.978869:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259744128:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065123.978875:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009009f480/2, rc 0, transno 21474840069 00000100:00100000:2.0:1746065123.978878:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259742464:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065123.978883:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009009df80/2, rc 0, transno 21474840071 00000100:00100000:2.0:1746065123.978885:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259742976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065123.981335:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259744640:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065123.981723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.981745:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.981769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.981844:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261063552 00000100:00100000:3.0:1746065123.981849:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261063552 00000100:00100000:3.0:1746065123.981878:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261063424 00000100:00100000:3.0:1746065123.981880:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261063424 00000100:00100000:3.0:1746065123.981887:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261063680 00000100:00100000:3.0:1746065123.981888:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261063680 00000100:00100000:3.0:1746065123.981897:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3695 00000100:00100000:3.0:1746065123.981903:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:29020:x1830881261063552:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:2.0:1746065123.981961:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3696 00000100:00100000:2.0:1746065123.981967:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:29016:x1830881261063424:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:3.0:1746065123.982000:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:29020:x1830881261063552:12345-192.168.202.46@tcp:49:cat.0 Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.982000:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:29016:x1830881261063424:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 33us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.982005:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3696 00000100:00100000:3.0:1746065123.982012:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3695 00000100:00100000:1.0:1746065123.982017:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3697 00000100:00100000:1.0:1746065123.982025:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29012:x1830881261063680:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:1.0:1746065123.982064:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29012:x1830881261063680:12345-192.168.202.46@tcp:49:cat.0 Request processed in 40us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.982252:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259743232:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065123.982261:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3697 00010000:00010000:2.0:1746065123.982282:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135452a00/0x14b4f8542d4f34e3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 250 pid: 24350 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065123.982428:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.982444:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135452800, rc 0) 00000100:00100000:2.0:1746065123.982477:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29015:x1830881261062528:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 48023us (48534us total) trans 8589943102 rc 0/0 00000100:00100000:2.0:1746065123.982483:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9047 00000100:00100000:2.0:1746065123.986192:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.986225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.986242:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.986255:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.986268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.986289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.986309:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.986340:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261063808 00000100:00100000:2.0:1746065123.986346:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261063808 00000100:00100000:2.0:1746065123.986373:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261063936 00000100:00100000:2.0:1746065123.986375:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261063936 00000100:00100000:2.0:1746065123.986384:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261064064 00000100:00100000:2.0:1746065123.986385:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261064064 00000100:00100000:2.0:1746065123.986392:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261064192 00000100:00100000:2.0:1746065123.986393:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261064192 00000100:00100000:2.0:1746065123.986398:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261064448 00000100:00100000:2.0:1746065123.986399:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261064448 00000100:00100000:2.0:1746065123.986404:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261064320 00000100:00100000:2.0:1746065123.986405:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261064320 00000100:00100000:2.0:1746065123.986410:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261064576 00000100:00100000:2.0:1746065123.986411:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261064576 00000100:00100000:2.0:1746065123.986420:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10868 00000100:00100000:2.0:1746065123.986427:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261063808:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.986440:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.986452:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b22b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.986469:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.986471:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.986477:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b22b expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.986489:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b22b expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.986497:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd83a00, rc 0) 00000100:00100000:2.0:1746065123.986528:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261063808:12345-192.168.202.46@tcp:101:cat.0 Request processed in 102us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.986533:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10868 00000100:00100000:2.0:1746065123.986544:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10869 00000100:00100000:2.0:1746065123.986548:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261063936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.986553:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.986560:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b232 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.986569:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.986570:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.986575:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b232 expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.986583:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b232 expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.986589:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd82400, rc 0) 00000100:00100000:2.0:1746065123.986600:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881261063936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 52us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.986604:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10869 00000100:00100000:2.0:1746065123.986612:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10870 00000100:00100000:2.0:1746065123.986617:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:29016:x1830881261064064:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065123.986621:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.986626:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b239 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065123.986837:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10871 00000100:00100000:0.0:1746065123.986844:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881261064192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065123.986850:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065123.986856:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b240 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.986864:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.986866:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.986870:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 30 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.986879:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 30 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.986885:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcf9200, rc 0) 00000100:00100000:0.0:1746065123.986902:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261064192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 59us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.986906:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10871 00000100:00100000:0.0:1746065123.986915:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10872 00000100:00100000:0.0:1746065123.986919:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261064448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065123.986923:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065123.986930:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b24e expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.986938:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.986939:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.986942:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b24e expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.986950:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b24e expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.986955:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcf9000, rc 0) 00000100:00100000:0.0:1746065123.986965:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261064448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 46us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.986970:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10872 00000100:00100000:0.0:1746065123.986977:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10873 00000100:00100000:0.0:1746065123.986982:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261064320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065123.986986:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065123.986991:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b247 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.986997:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.986998:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.987001:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b247 expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.987008:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b247 expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.987017:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcf8e00, rc 0) 00000100:00100000:0.0:1746065123.987028:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261064320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 46us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.987033:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10873 00000100:00100000:0.0:1746065123.987041:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10874 00000100:00100000:0.0:1746065123.987045:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261064576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065123.987050:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065123.987054:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b255 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065123.987061:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.987062:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065123.987065:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b255 expref: 30 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.987071:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b255 expref: 30 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065123.987077:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcf8c00, rc 0) 00000100:00100000:0.0:1746065123.987087:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881261064576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 42us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065123.987092:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10874 00010000:00010000:2.0:1746065123.988221:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1f3 expref: 36 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.988231:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b255 expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.988237:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.988238:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.988241:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3518464->4194303] (req 3518464->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.988265:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b255 expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.988275:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b255 expref: 29 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065123.988287:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259744896:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.988372:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1f3 expref: 36 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.988380:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1f3 expref: 36 pid: 9716 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065123.988388:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259745024:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.988403:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065123.990694:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259744896:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.990794:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259745024:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.990847:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3518464->4194303] (req 3518464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.990860:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd83000, rc 0) 00000100:00100000:2.0:1746065123.990897:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:29016:x1830881261064064:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4278us (4652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.990904:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10870 00000100:00100000:0.0:1746065123.994132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.994179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.994231:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261064704 00000100:00100000:3.0:1746065123.994239:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261064704 00000100:00100000:2.0:1746065123.994253:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261064832 00000100:00100000:2.0:1746065123.994257:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261064832 00010000:00010000:3.0:1746065123.994267:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b255 expref: 29 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065123.994273:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1f3 expref: 37 pid: 9716 timeout: 823 lvb_type: 1 00000100:00100000:3.0:1746065123.994290:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5401 00000100:00100000:3.0:1746065123.994296:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+29:1959:x1830881261064704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.994306:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065123.994307:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5402 00000100:00100000:2.0:1746065123.994313:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881261064832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065123.994319:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.994336:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b255 expref: 29 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065123.994338:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1f3 expref: 37 pid: 9716 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065123.994346:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b255 expref: 29 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065123.994419:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1f3 expref: 37 pid: 9716 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065123.994438:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd8b000/0x14b4f8542d4f34a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1f3 expref: 37 pid: 9716 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065123.994450:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065123.994508:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dcf8c00/0x14b4f8542d4f3537 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b255 expref: 29 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065123.994516:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.994518:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.994523:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.994530:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.994552:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.994561:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259745152:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065123.994614:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881261064832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 299us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065123.994620:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5402 00000100:00100000:3.0:1746065123.994779:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065123.995580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.995812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065123.995917:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261064960 00000100:00100000:2.0:1746065123.995921:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261064960 00000100:00100000:2.0:1746065123.995940:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261065088 00000100:00100000:2.0:1746065123.995942:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261065088 00000100:00100000:2.0:1746065123.995954:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10875 00000100:00100000:2.0:1746065123.995959:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:29015:x1830881261064960:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065123.995970:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.995982:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b25c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.995991:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10876 00000100:00100000:3.0:1746065123.995998:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:29012:x1830881261065088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065123.995999:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d0 expref: 38 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.996006:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065123.996006:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065123.996010:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065123.996012:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065123.996013:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b263 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.996014:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1650688->2097151] (req 1650688->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 38 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.996026:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.996029:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065123.996031:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.996032:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065123.996035:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 39 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065123.996038:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 28 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065123.996047:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259745280:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.996049:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.996061:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.996069:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259745408:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065123.996086:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d0 expref: 39 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065123.996090:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d540 going to sleep for 11 seconds 00010000:00010000:2.0:1746065123.996093:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d0 expref: 39 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065123.996100:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259745536:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065123.996115:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065123.997310:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259745152:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065123.997335:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.997369:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881261064704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3072us (3243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.997376:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5401 00000100:00100000:0.0:1746065123.998878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065123.998909:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065123.998965:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261065472 00000100:00100000:3.0:1746065123.998970:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261065472 00010000:00010000:3.0:1746065123.998992:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d0 expref: 40 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065123.999011:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5403 00000100:00100000:3.0:1746065123.999016:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1959:x1830881261065472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065123.999025:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065123.999041:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d0 expref: 40 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.999049:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d0 expref: 40 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065123.999071:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065123.999103:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1959:x1830881261065472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.999108:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5403 00000100:00100000:3.0:1746065123.999133:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259745408:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065123.999147:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 39 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065123.999156:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbce200, rc 0) 00000100:00100000:3.0:1746065123.999172:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:29012:x1830881261065088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3175us (3360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065123.999177:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10876 00000100:00100000:2.0:1746065123.999298:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261065344 00000100:00100000:2.0:1746065123.999302:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261065344 00002000:00100000:2.0:1746065123.999334:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3518464->3522559) req@ffff88012b4b1880 x1830881261065344/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/0 e 0 to 0 dl 1746065134 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065123.999342:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b1880 with x1830881261065344 ext(3518464->3522559) 00010000:00010000:2.0:1746065123.999347:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065123.999356:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746065123.999361:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b4b1880 00000100:00100000:2.0:1746065123.999384:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1517 00000100:00100000:2.0:1746065123.999389:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261065344:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.000081:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261065344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 686us (1200us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065124.000087:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1517 00002000:00100000:2.0:1746065124.000092:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3518464->3522559) req@ffff88012b4b1880 x1830881261065344/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:39/0 lens 488/4536 e 0 to 0 dl 1746065134 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.000098:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b1880 with x1830881261065344 ext(3518464->3522559) 00010000:00010000:2.0:1746065124.000103:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.000111:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 28 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746065124.000116:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b4b1880 00000100:00100000:2.0:1746065124.000144:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259745280:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.000152:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f105e00/0x14b4f8542d4f3465 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1d0 expref: 38 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.000170:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259745536:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.000183:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1650688->2097151] (req 1650688->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 37 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.000192:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd82a00, rc 0) 00000100:00100000:2.0:1746065124.000225:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:29015:x1830881261064960:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4265us (4645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.000230:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10875 00000100:00100000:0.0:1746065124.001173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.001265:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261065728 00000100:00100000:2.0:1746065124.001271:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261065728 00000100:00100000:0.0:1746065124.001335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.001409:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261065984 00000100:00100000:1.0:1746065124.001413:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261065984 00002000:00100000:1.0:1746065124.001435:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009b9fed80 x1830881261065984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.001442:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fed80 with x1830881261065984 ext(1048576->2097151) 00002000:00010000:1.0:1746065124.001446:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fed80 00002000:00100000:2.0:1746065124.001494:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009b9fdc00 x1830881261065728/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.001502:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdc00 with x1830881261065728 ext(0->1048575) 00002000:00010000:2.0:1746065124.001504:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fdc00 00000100:00100000:1.0:1746065124.001600:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4955 00000100:00100000:1.0:1746065124.001606:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261065984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065124.003783:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4956 00000100:00100000:3.0:1746065124.003796:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261065728:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.007855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.007893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.008024:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261066240 00000100:00100000:2.0:1746065124.008032:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261066240 00000100:00100000:3.0:1746065124.008057:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261066496 00000100:00100000:3.0:1746065124.008062:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261066496 00002000:00100000:2.0:1746065124.008065:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6144700 x1830881261066240/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.008075:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144700 with x1830881261066240 ext(1048576->2097151) 00002000:00100000:3.0:1746065124.008081:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a6144e00 x1830881261066496/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065124.008084:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 30 pid: 21235 timeout: 823 lvb_type: 1 00002000:00100000:3.0:1746065124.008088:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144e00 with x1830881261066496 ext(1048576->2097151) 00002000:00010000:3.0:1746065124.008091:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6144e00 00010000:00010000:2.0:1746065124.008095:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 30 pid: 21235 timeout: 823 lvb_type: 1 00002000:00010000:2.0:1746065124.008101:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6144700 00000100:00100000:3.0:1746065124.008108:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1518 00000100:00100000:3.0:1746065124.008113:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881261066240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.008115:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4957 00000100:00100000:2.0:1746065124.008120:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261066496:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.012053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.012446:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261065984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10838us (11108us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065124.012456:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4955 00002000:00100000:1.0:1746065124.012466:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009b9fed80 x1830881261065984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.012475:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fed80 with x1830881261065984 ext(1048576->2097151) 00002000:00010000:1.0:1746065124.012480:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fed80 00000100:00100000:1.0:1746065124.012500:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261066752 00000100:00100000:1.0:1746065124.012506:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261066752 00002000:00100000:1.0:1746065124.012530:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (4190208->4194303) req@ffff8800a6145180 x1830881261066752/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.012537:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6145180 with x1830881261066752 ext(4190208->4194303) 00010000:00010000:1.0:1746065124.012545:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.012556:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:1.0:1746065124.012562:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6145180 00000100:00100000:1.0:1746065124.012576:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1519 00000100:00100000:1.0:1746065124.012582:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261066752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065124.012704:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261066752:12345-192.168.202.46@tcp:3:cat.0 Request processed in 121us (660us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065124.012710:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1519 00002000:00100000:1.0:1746065124.012715:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (4190208->4194303) req@ffff8800a6145180 x1830881261066752/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.012721:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6145180 with x1830881261066752 ext(4190208->4194303) 00010000:00010000:1.0:1746065124.012725:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.012732:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:1.0:1746065124.012738:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6145180 00000100:00100000:3.0:1746065124.013184:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261065728:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9392us (12118us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.013191:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4956 00002000:00100000:3.0:1746065124.013195:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009b9fdc00 x1830881261065728/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.013202:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdc00 with x1830881261065728 ext(0->1048575) 00002000:00010000:3.0:1746065124.013204:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fdc00 00000100:00100000:2.0:1746065124.017723:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261066496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9592us (9819us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.017735:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4957 00002000:00100000:2.0:1746065124.017745:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a6144e00 x1830881261066496/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.017753:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144e00 with x1830881261066496 ext(1048576->2097151) 00002000:00010000:2.0:1746065124.017758:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6144e00 00000100:00100000:2.0:1746065124.021362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.021668:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261066240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13553us (13851us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.021679:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1518 00002000:00100000:3.0:1746065124.021689:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6144700 x1830881261066240/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.021697:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144700 with x1830881261066240 ext(1048576->2097151) 00010000:00010000:3.0:1746065124.021706:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 28 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065124.021717:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 28 pid: 21235 timeout: 823 lvb_type: 1 00002000:00010000:3.0:1746065124.021723:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6144700 00000100:00100000:0.0:1746065124.022231:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261066880 00000100:00100000:0.0:1746065124.022238:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261066880 00000100:00100000:0.0:1746065124.022277:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10877 00000100:00100000:1.0:1746065124.022280:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.022283:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:29020:x1830881261066880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.022295:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065124.022296:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261067264 00000100:00100000:1.0:1746065124.022299:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261067264 00010000:00010000:0.0:1746065124.022307:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b26a expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.022335:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.022340:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1650688->2097151] (req 1650688->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.022346:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.022349:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.022375:0:8427:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1650688->2097151] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.022385:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.022394:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3db000, rc 0) 00000100:00100000:0.0:1746065124.022427:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:29020:x1830881261066880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 144us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.022433:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10877 00000100:00100000:1.0:1746065124.022446:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3698 00000100:00100000:1.0:1746065124.022451:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:29016:x1830881261067264:12345-192.168.202.46@tcp:35:multiop.0 00000100:00080000:2.0:1746065124.022511:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065124.022974:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:29016:x1830881261067264:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 522us (693us total) trans 8589943103 rc 0/0 00000100:00100000:1.0:1746065124.022979:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3698 00000100:00100000:0.0:1746065124.023503:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.023589:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261067392 00000100:00100000:3.0:1746065124.023593:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261067392 00002000:00100000:3.0:1746065124.023614:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3518464->4194303) req@ffff8800a6147b80 x1830881261067392/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.023621:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6147b80 with x1830881261067392 ext(3518464->4194303) 00010000:00010000:3.0:1746065124.023628:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 29 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.023638:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 29 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746065124.023644:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6147b80 00000100:00100000:3.0:1746065124.023668:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1520 00000100:00100000:3.0:1746065124.023674:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1959:x1830881261067392:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065124.027811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.028349:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261067520 00000100:00100000:1.0:1746065124.028356:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261067520 00010000:00010000:1.0:1746065124.028385:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 31 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.028422:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5404 00000100:00100000:1.0:1746065124.028429:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881261067520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.028439:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.028456:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 31 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.028466:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 31 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.028484:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dcf9200/0x14b4f8542d4f3522 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b240 expref: 31 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.028507:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.028509:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.028515:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.028523:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.028549:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.028558:0:7078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 36 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.028568:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259745792:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065124.028632:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ade40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.030577:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259745792:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.030595:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.031295:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881261067520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2864us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.031305:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5404 00000100:00100000:0.0:1746065124.031452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.031742:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261067776 00000100:00100000:3.0:1746065124.031748:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261067776 00002000:00100000:3.0:1746065124.031781:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1650688->1654783) req@ffff88009f046d80 x1830881261067776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.031790:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046d80 with x1830881261067776 ext(1650688->1654783) 00010000:00010000:3.0:1746065124.031797:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.031806:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746065124.031826:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f046d80 00000100:00100000:3.0:1746065124.031851:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1521 00000100:00100000:3.0:1746065124.031858:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881261067776:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065124.031969:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881261067776:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 111us (517us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065124.031974:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1521 00002000:00100000:3.0:1746065124.031979:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1650688->1654783) req@ffff88009f046d80 x1830881261067776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.031984:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046d80 with x1830881261067776 ext(1650688->1654783) 00010000:00010000:3.0:1746065124.031988:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.031995:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746065124.032000:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f046d80 00000100:00080000:0.0:1746065124.032080:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065124.033392:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881261067392:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9715us (9886us total) trans 21474840077 rc 0/0 00000100:00100000:2.0:1746065124.033399:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1520 00002000:00100000:2.0:1746065124.033407:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3518464->4194303) req@ffff8800a6147b80 x1830881261067392/t21474840077(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.033414:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6147b80 with x1830881261067392 ext(3518464->4194303) 00010000:00010000:2.0:1746065124.033420:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.033429:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746065124.033434:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6147b80 00000100:00100000:0.0:1746065124.035702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.035753:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261067904 00000100:00100000:1.0:1746065124.035760:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261067904 00010000:00010000:1.0:1746065124.035787:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.035839:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5405 00000100:00100000:1.0:1746065124.035851:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881261067904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.035870:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.035889:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.035898:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.035914:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83000/0x14b4f8542d4f351b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b239 expref: 30 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.036084:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.036087:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.036094:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.036101:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.036131:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.036142:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259745920:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065124.036211:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.041541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.041581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.041604:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261068288 00000100:00100000:0.0:1746065124.041611:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261068288 00000100:00100000:0.0:1746065124.041669:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10878 00000100:00100000:0.0:1746065124.041677:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:29015:x1830881261068288:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065124.041693:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.041708:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b271 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.041731:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1e5 expref: 36 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.041738:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b247 expref: 25 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.041749:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.041750:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.041754:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1343487] (req 1048576->1343487) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.041777:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b247 expref: 25 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.041785:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b247 expref: 25 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746065124.041796:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259746048:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065124.041890:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1e5 expref: 36 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.041897:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1e5 expref: 36 pid: 21998 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.041905:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259746176:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065124.041922:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b240 going to sleep for 11 seconds 00000100:00080000:0.0:1746065124.041937:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065124.041957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.042009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.042108:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261068160 00000100:00100000:1.0:1746065124.042113:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261068160 00002000:00100000:1.0:1746065124.042135:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1650688->2097151) req@ffff88012f3d2300 x1830881261068160/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.042149:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d2300 with x1830881261068160 ext(1650688->2097151) 00010000:00010000:1.0:1746065124.042155:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.042163:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:1.0:1746065124.042169:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3d2300 00000100:00100000:1.0:1746065124.042181:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261068544 00000100:00100000:1.0:1746065124.042183:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261068544 00002000:00100000:1.0:1746065124.042194:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009c3faa00 x1830881261068544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.042200:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830881261068544 ext(2097152->3145727) 00002000:00010000:1.0:1746065124.042203:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:1.0:1746065124.042214:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261068800 00000100:00100000:1.0:1746065124.042216:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261068800 00002000:00100000:1.0:1746065124.042226:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009c3fad80 x1830881261068800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.042232:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830881261068800 ext(3145728->4194303) 00002000:00010000:1.0:1746065124.042235:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:1.0:1746065124.042245:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1522 00000100:00100000:1.0:1746065124.042256:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261068160:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065124.042275:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4958 00000100:00100000:0.0:1746065124.042281:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881261068544:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065124.042598:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4959 00000100:00100000:1.0:1746065124.042603:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1958:x1830881261068800:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065124.043570:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259745920:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.043583:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.043606:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881261067904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7756us (7911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.043614:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5405 00000100:00100000:0.0:1746065124.044220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.044954:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261069056 00000100:00100000:3.0:1746065124.044959:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261069056 00002000:00100000:3.0:1746065124.044988:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094246680 x1830881261069056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.044996:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094246680 with x1830881261069056 ext(3145728->4194303) 00002000:00010000:3.0:1746065124.044999:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094246680 00000100:00100000:3.0:1746065124.045025:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4960 00000100:00100000:3.0:1746065124.045032:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881261069056:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065124.050667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.050776:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259746048:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.050785:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259746176:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.050807:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1343487] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 38 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.050845:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3db200, rc 0) 00000100:00100000:1.0:1746065124.050879:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:29015:x1830881261068288:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9202us (9296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.050886:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10878 00000100:00100000:1.0:1746065124.050916:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261069184 00000100:00100000:1.0:1746065124.050920:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261069184 00010000:00010000:1.0:1746065124.050940:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1e5 expref: 38 pid: 21998 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.050972:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5406 00000100:00100000:1.0:1746065124.050978:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881261069184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.050988:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.051004:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1e5 expref: 38 pid: 21998 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.051017:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1e5 expref: 38 pid: 21998 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.051036:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd83600/0x14b4f8542d4f3496 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1e5 expref: 38 pid: 21998 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.051049:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.051064:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261069184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.051068:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5406 00000100:00100000:0.0:1746065124.051211:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1958:x1830881261068544:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8929us (9252us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065124.051219:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4958 00002000:00100000:0.0:1746065124.051227:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009c3faa00 x1830881261068544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.051234:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830881261068544 ext(2097152->3145727) 00002000:00010000:0.0:1746065124.051238:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:0.0:1746065124.052004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.052640:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261069312 00000100:00100000:3.0:1746065124.052646:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261069312 00010000:00010000:3.0:1746065124.052672:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b247 expref: 26 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:3.0:1746065124.052709:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5407 00000100:00100000:3.0:1746065124.052716:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261069312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065124.052728:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065124.052745:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b247 expref: 26 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065124.052755:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b247 expref: 26 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065124.052769:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcf8e00/0x14b4f8542d4f3530 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b247 expref: 26 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746065124.052787:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.052789:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.052794:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.052802:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.052850:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 36 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.052861:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259746304:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065124.052937:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.056614:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881261068800:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 14001us (14595us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065124.056624:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4959 00002000:00100000:0.0:1746065124.056634:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009c3fad80 x1830881261068800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.056642:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830881261068800 ext(3145728->4194303) 00002000:00010000:0.0:1746065124.056647:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:3.0:1746065124.057347:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259746304:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065124.057364:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065124.057388:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261069312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4672us (5386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.057396:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5407 00000100:00100000:2.0:1746065124.057608:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261069056:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12575us (13388us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.057615:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4960 00002000:00100000:2.0:1746065124.057621:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094246680 x1830881261069056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.057628:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094246680 with x1830881261069056 ext(3145728->4194303) 00002000:00010000:2.0:1746065124.057632:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094246680 00000100:00100000:1.0:1746065124.058150:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261068160:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 15898us (16615us total) trans 21474840078 rc 0/0 00000100:00100000:1.0:1746065124.058157:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1522 00002000:00100000:1.0:1746065124.058163:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1650688->2097151) req@ffff88012f3d2300 x1830881261068160/t21474840078(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.058170:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d2300 with x1830881261068160 ext(1650688->2097151) 00010000:00010000:1.0:1746065124.058176:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 39 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.058189:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 39 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:1.0:1746065124.058195:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3d2300 00000100:00100000:2.0:1746065124.060055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.060096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.060138:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261069696 00000100:00100000:3.0:1746065124.060145:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261069696 00010000:00010000:3.0:1746065124.060169:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 39 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.060195:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5408 00000100:00100000:3.0:1746065124.060201:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261069696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065124.060212:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065124.060226:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 39 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.060235:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 39 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.060256:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82a00/0x14b4f8542d4f353e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b25c expref: 39 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.060280:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.060282:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.060287:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.060294:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.060319:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.060339:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259746432:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065124.060398:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.060852:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261069568 00000100:00100000:1.0:1746065124.060856:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261069568 00002000:00100000:1.0:1746065124.060881:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1339392->1343487) req@ffff88012f540700 x1830881261069568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.060890:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f540700 with x1830881261069568 ext(1339392->1343487) 00002000:00010000:1.0:1746065124.060894:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f540700 00000100:00100000:1.0:1746065124.060919:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4961 00000100:00100000:1.0:1746065124.060924:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261069568:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065124.061048:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261069568:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 119us (994us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065124.061055:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4961 00002000:00100000:1.0:1746065124.061059:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1339392->1343487) req@ffff88012f540700 x1830881261069568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.061064:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f540700 with x1830881261069568 ext(1339392->1343487) 00002000:00010000:1.0:1746065124.061066:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f540700 00000100:00100000:3.0:1746065124.062754:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259746432:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065124.062768:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065124.062812:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261069696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2609us (2713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.062856:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5408 00000100:00100000:0.0:1746065124.063220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.063273:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261069952 00000100:00100000:1.0:1746065124.063278:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261069952 00000100:00100000:1.0:1746065124.063314:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3699 00000100:00100000:1.0:1746065124.063320:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29015:x1830881261069952:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065124.063536:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29015:x1830881261069952:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 215us (316us total) trans 8589943104 rc 0/0 00000100:00100000:1.0:1746065124.063541:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3699 00000100:00100000:0.0:1746065124.064176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.064216:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261070080 00000100:00100000:1.0:1746065124.064219:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261070080 00000100:00100000:1.0:1746065124.064287:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10879 00000100:00100000:1.0:1746065124.064293:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881261070080:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.064302:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.064314:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b278 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.064344:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.064346:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.064352:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b278 expref: 39 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.064363:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b278 expref: 39 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.064372:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135453400, rc 0) 00000100:00100000:1.0:1746065124.064665:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881261070080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 367us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.064670:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10879 00000100:00100000:0.0:1746065124.065422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.065480:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261070336 00000100:00100000:2.0:1746065124.065484:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261070336 00002000:00100000:2.0:1746065124.065507:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880131b0b100 x1830881261070336/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.065515:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0b100 with x1830881261070336 ext(1048576->2097151) 00002000:00010000:2.0:1746065124.065519:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b0b100 00000100:00100000:2.0:1746065124.065772:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4962 00000100:00100000:2.0:1746065124.065779:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261070336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.068851:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.069406:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261070592 00000100:00100000:1.0:1746065124.069414:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261070592 00002000:00100000:1.0:1746065124.069446:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880131b0ad80 x1830881261070592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.069455:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0ad80 with x1830881261070592 ext(4194304->5029887) 00002000:00010000:1.0:1746065124.069460:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b0ad80 00000100:00100000:1.0:1746065124.069487:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4963 00000100:00100000:1.0:1746065124.069494:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261070592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065124.075517:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261070336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9730us (10088us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.075527:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4962 00002000:00100000:3.0:1746065124.075536:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880131b0b100 x1830881261070336/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.075545:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0b100 with x1830881261070336 ext(1048576->2097151) 00002000:00010000:3.0:1746065124.075550:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131b0b100 00000100:00100000:1.0:1746065124.076071:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261070592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6576us (7756us total) trans 0 rc 835584/835584 00000100:00100000:1.0:1746065124.076082:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4963 00002000:00100000:1.0:1746065124.076087:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880131b0ad80 x1830881261070592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.076095:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131b0ad80 with x1830881261070592 ext(4194304->5029887) 00002000:00010000:1.0:1746065124.076098:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131b0ad80 00000100:00100000:0.0:1746065124.081372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.081570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.081650:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261070976 00000100:00100000:2.0:1746065124.081657:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261070976 00000100:00100000:1.0:1746065124.081759:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261070848 00000100:00100000:1.0:1746065124.081764:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261070848 00000100:00100000:3.0:1746065124.081929:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10880 00000100:00100000:3.0:1746065124.081937:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:29020:x1830881261070976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065124.081953:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065124.081967:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b27f expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.081990:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.082001:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065124.082002:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065124.082005:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.082028:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.082038:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 34 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.082048:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259746560:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065124.082104:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.082474:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3700 00000100:00100000:1.0:1746065124.082481:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29012:x1830881261070848:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065124.082639:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29012:x1830881261070848:12345-192.168.202.46@tcp:35:cat.0 Request processed in 158us (1274us total) trans 8589943105 rc 0/0 00000100:00100000:1.0:1746065124.082646:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3700 00000100:00100000:0.0:1746065124.084170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.084283:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259746560:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065124.084304:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.084317:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbcea00, rc 0) 00000100:00100000:3.0:1746065124.084355:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+26:29020:x1830881261070976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2419us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.084361:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10880 00000100:00100000:1.0:1746065124.084425:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261071104 00000100:00100000:1.0:1746065124.084430:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261071104 00002000:00100000:1.0:1746065124.084457:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1343487) req@ffff88012bd3e300 x1830881261071104/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.084470:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e300 with x1830881261071104 ext(1048576->1343487) 00010000:00010000:1.0:1746065124.084479:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 35 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.084533:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 35 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:1.0:1746065124.084539:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bd3e300 00000100:00100000:1.0:1746065124.084551:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1523 00000100:00100000:1.0:1746065124.084557:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261071104:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065124.088785:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261071104:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4219us (4611us total) trans 17179872849 rc 0/0 00000100:00100000:2.0:1746065124.088794:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1523 00002000:00100000:2.0:1746065124.088804:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1343487) req@ffff88012bd3e300 x1830881261071104/t17179872849(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.088812:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e300 with x1830881261071104 ext(1048576->1343487) 00010000:00010000:2.0:1746065124.088840:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.088853:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746065124.088859:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bd3e300 00000100:00100000:0.0:1746065124.090281:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.090346:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261071232 00000100:00100000:3.0:1746065124.090353:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261071232 00010000:00010000:3.0:1746065124.090373:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.090403:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5409 00000100:00100000:3.0:1746065124.090407:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881261071232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065124.090416:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065124.090427:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065124 -> 1746065125 00002000:00010000:3.0:1746065124.090429:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065124 -> 1746065125 00010000:00010000:3.0:1746065124.090432:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.090440:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.090453:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3db200/0x14b4f8542d4f3553 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b271 expref: 37 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.090477:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.090479:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.090485:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.090493:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.090679:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.090694:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259746688:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065124.090763:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065124.092047:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259746688:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065124.092062:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065124.092098:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881261071232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1689us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.092106:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5409 00000100:00100000:0.0:1746065124.094671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.094870:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261071488 00000100:00100000:2.0:1746065124.094877:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261071488 00002000:00100000:2.0:1746065124.094909:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a90adf80 x1830881261071488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.094917:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90adf80 with x1830881261071488 ext(1048576->2097151) 00002000:00010000:2.0:1746065124.094921:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90adf80 00000100:00100000:2.0:1746065124.094948:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4964 00000100:00100000:2.0:1746065124.094955:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261071488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.103175:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261071488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8213us (8501us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.103185:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4964 00002000:00100000:2.0:1746065124.103195:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a90adf80 x1830881261071488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.103204:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90adf80 with x1830881261071488 ext(1048576->2097151) 00002000:00010000:2.0:1746065124.103209:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90adf80 00000100:00100000:0.0:1746065124.110905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.111118:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261071744 00000100:00100000:2.0:1746065124.111125:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261071744 00002000:00100000:2.0:1746065124.111157:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a90ad880 x1830881261071744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.111167:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad880 with x1830881261071744 ext(2097152->3145727) 00002000:00010000:2.0:1746065124.111176:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ad880 00000100:00100000:2.0:1746065124.111202:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4965 00000100:00100000:2.0:1746065124.111208:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261071744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.124372:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261071744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13156us (13466us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.124382:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4965 00002000:00100000:2.0:1746065124.124391:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a90ad880 x1830881261071744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.124399:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad880 with x1830881261071744 ext(2097152->3145727) 00002000:00010000:2.0:1746065124.124404:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ad880 00000100:00100000:0.0:1746065124.129023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.129116:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261071872 00000100:00100000:2.0:1746065124.129125:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261071872 00000100:00100000:2.0:1746065124.129163:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10881 00000100:00100000:2.0:1746065124.129171:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:29020:x1830881261071872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065124.129186:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.129202:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b286 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.129221:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.129223:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.129230:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b286 expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.129242:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b286 expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.129251:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009318ec00, rc 0) 00000100:00100000:2.0:1746065124.129290:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:29020:x1830881261071872:12345-192.168.202.46@tcp:101:cat.0 Request processed in 119us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.129297:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10881 00000100:00100000:0.0:1746065124.139881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.140008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.140079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.140098:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261072256 00000100:00100000:0.0:1746065124.140103:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261072256 00002000:00100000:0.0:1746065124.140138:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d136a00 x1830881261072256/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.140147:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136a00 with x1830881261072256 ext(3145728->4194303) 00002000:00010000:0.0:1746065124.140151:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d136a00 00000100:00100000:0.0:1746065124.140195:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261072128 00000100:00100000:0.0:1746065124.140197:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261072128 00002000:00100000:0.0:1746065124.140209:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012d134380 x1830881261072128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.140216:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134380 with x1830881261072128 ext(2097152->3145727) 00002000:00010000:0.0:1746065124.140218:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d134380 00000100:00100000:0.0:1746065124.140225:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261072640 00000100:00100000:0.0:1746065124.140227:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261072640 00002000:00100000:0.0:1746065124.140237:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880133088000 x1830881261072640/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.140243:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133088000 with x1830881261072640 ext(3145728->4194303) 00002000:00010000:0.0:1746065124.140245:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133088000 00000100:00100000:0.0:1746065124.140255:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4966 00000100:00100000:0.0:1746065124.140262:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881261072256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065124.140352:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4967 00000100:00100000:3.0:1746065124.140360:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881261072128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.140365:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4968 00000100:00100000:2.0:1746065124.140373:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261072640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065124.151029:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+32:1960:x1830881261072128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10661us (11011us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065124.151040:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4967 00002000:00100000:1.0:1746065124.151050:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012d134380 x1830881261072128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.151058:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134380 with x1830881261072128 ext(2097152->3145727) 00002000:00010000:1.0:1746065124.151063:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d134380 00000100:00100000:2.0:1746065124.153246:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261072640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12867us (13160us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.153255:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4968 00002000:00100000:2.0:1746065124.153263:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880133088000 x1830881261072640/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.153271:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133088000 with x1830881261072640 ext(3145728->4194303) 00002000:00010000:2.0:1746065124.153276:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133088000 00000100:00100000:3.0:1746065124.162035:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881261072256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21767us (22154us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.162045:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4966 00002000:00100000:3.0:1746065124.162127:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d136a00 x1830881261072256/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.162137:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136a00 with x1830881261072256 ext(3145728->4194303) 00002000:00010000:3.0:1746065124.162141:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d136a00 00000100:00100000:0.0:1746065124.168356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.170352:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261072896 00000100:00100000:3.0:1746065124.170362:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261072896 00002000:00100000:3.0:1746065124.171540:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880133088380 x1830881261072896/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.171550:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133088380 with x1830881261072896 ext(4194304->5029887) 00002000:00010000:3.0:1746065124.171555:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133088380 00000100:00100000:3.0:1746065124.171574:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4969 00000100:00100000:3.0:1746065124.171581:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881261072896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065124.182214:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881261072896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10623us (13854us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065124.182227:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4969 00002000:00100000:3.0:1746065124.182238:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880133088380 x1830881261072896/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.182247:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133088380 with x1830881261072896 ext(4194304->5029887) 00002000:00010000:3.0:1746065124.182252:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133088380 00000100:00100000:3.0:1746065124.185213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.185237:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261073152 00000100:00100000:3.0:1746065124.185245:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261073152 00000100:00100000:3.0:1746065124.185280:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9051 00000100:00100000:3.0:1746065124.185287:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29025:x1830881261073152:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065124.185309:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065124.185335:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f356f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b28d expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.185418:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185430:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185439:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185450:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185455:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185460:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185550:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185558:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185563:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065124.185571:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065124.185633:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185639:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185644:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185648:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8e6c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065124.185651:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185656:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185664:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065124.185667:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065124.185670:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185674:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185686:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185690:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185694:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185698:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8e7000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065124.185700:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185704:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185708:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012cf55200) 00010000:00010000:3.0:1746065124.185710:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065124.185711:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185715:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f357d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.185742:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6800/0x14b4f8542d4f356f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b28d expref: 254 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.185755:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b28d expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.185760:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065124.185762:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065124.185764:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6200, rc 0) 00000100:00100000:3.0:1746065124.185801:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:29025:x1830881261073152:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 515us (595us total) trans 8589943106 rc 0/0 00000100:00100000:3.0:1746065124.185807:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9051 00000001:00080000:0.0:1746065124.218486:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840059 is committed 00000001:00080000:0.0:1746065124.218519:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839983 is committed 00000001:00080000:0.0:1746065124.218525:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839982 is committed 00000001:00080000:0.0:1746065124.218533:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839961 is committed 00000001:00080000:0.0:1746065124.218550:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840078 is committed 00000001:00080000:0.0:1746065124.218559:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840076 is committed 00000001:00080000:0.0:1746065124.218583:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840049 is committed 00000001:00080000:0.0:1746065124.218631:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839994 is committed 00000001:00080000:0.0:1746065124.218653:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840077 is committed 00000001:00080000:0.0:1746065124.219055:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840032 is committed 00000100:00100000:0.0:1746065124.268119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.268597:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261073408 00000100:00100000:3.0:1746065124.268605:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261073408 00000100:00100000:3.0:1746065124.268656:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9052 00000100:00100000:3.0:1746065124.268664:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:29028:x1830881261073408:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065124.268687:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065124.268702:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f3592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b294 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.268789:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.268801:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.268810:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.268855:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.268865:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.268870:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.268957:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.268965:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.268971:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065124.268979:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065124.269049:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269056:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269061:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269065:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8e7400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065124.269068:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269074:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269082:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065124.269085:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065124.269088:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269093:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7400/0x14b4f8542d4f3599 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269114:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269119:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269124:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269128:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8e7800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065124.269130:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269134:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269140:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012cf55800) 00010000:00010000:3.0:1746065124.269142:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065124.269144:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269148:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7800/0x14b4f8542d4f35a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065124.269179:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f3592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b294 expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.269193:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b294 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.269199:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065124.269201:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065124.269203:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6400, rc 0) 00000100:00100000:3.0:1746065124.269243:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:29028:x1830881261073408:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 579us (1132us total) trans 8589943107 rc 0/0 00000100:00100000:3.0:1746065124.269249:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9052 00000100:00100000:0.0:1746065124.274233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.274479:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261073536 00000100:00100000:2.0:1746065124.274486:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261073536 00000100:00100000:2.0:1746065124.274534:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10882 00000100:00100000:2.0:1746065124.274541:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:29025:x1830881261073536:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065124.274556:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.274569:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b29b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.274591:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.274598:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b286 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.274602:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.274604:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.274607:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.274630:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b286 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.274640:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b286 expref: 7 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.274650:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259746816:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.274744:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.274755:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.274762:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259746944:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.274777:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.278287:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259746816:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.278297:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259746944:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.278330:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.278344:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0095800, rc 0) 00000100:00100000:2.0:1746065124.278377:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:29025:x1830881261073536:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3836us (4152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.278384:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10882 00000100:00100000:0.0:1746065124.280719:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.280764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.280841:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261073664 00000100:00100000:3.0:1746065124.280847:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261073664 00010000:00010000:3.0:1746065124.280874:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b286 expref: 8 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.280893:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261073792 00000100:00100000:3.0:1746065124.280894:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261073792 00010000:00010000:3.0:1746065124.280901:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.280912:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5410 00000100:00100000:3.0:1746065124.280918:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1958:x1830881261073664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065124.280929:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065124.280944:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b286 expref: 8 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.280953:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b286 expref: 8 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.280971:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009318ec00/0x14b4f8542d4f3568 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b286 expref: 8 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.280990:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065124.280997:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5411 00000100:00100000:0.0:1746065124.281003:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881261073792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065124.281009:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065124.281018:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.281027:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.281033:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+7:1958:x1830881261073664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.281038:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5410 00010000:00010000:0.0:1746065124.281038:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbce200/0x14b4f8542d4f3545 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b263 expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.281053:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.281055:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.281061:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.281067:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.281094:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.281103:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259747072:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065124.281160:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.281860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.281902:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261073920 00000100:00100000:2.0:1746065124.281906:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261073920 00000100:00100000:2.0:1746065124.281938:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10883 00000100:00100000:2.0:1746065124.281943:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+26:29028:x1830881261073920:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065124.281953:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.281965:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2a2 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.281981:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.281991:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.281992:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.281995:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1654784->1945599] (req 1654784->1945599) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.282010:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.282020:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 27 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.282028:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747200:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.282078:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.283057:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259747072:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.283071:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.283106:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881261073792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2102us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.283283:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5411 00000100:00100000:2.0:1746065124.283713:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747200:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.283728:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1654784->1945599] (req 1654784->1945599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.283738:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0094200, rc 0) 00000100:00100000:2.0:1746065124.283767:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+27:29028:x1830881261073920:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1824us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.283773:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10883 00000100:00100000:1.0:1746065124.286680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.286743:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261074176 00000100:00100000:3.0:1746065124.286754:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261074176 00002000:00100000:3.0:1746065124.286788:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3858432->3862527) req@ffff880094d97100 x1830881261074176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.286800:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97100 with x1830881261074176 ext(3858432->3862527) 00002000:00010000:3.0:1746065124.286805:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97100 00000100:00100000:3.0:1746065124.286844:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4970 00000100:00100000:3.0:1746065124.286852:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881261074176:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065124.287028:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881261074176:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 176us (354us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065124.287034:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4970 00002000:00100000:3.0:1746065124.287039:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3858432->3862527) req@ffff880094d97100 x1830881261074176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.287046:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97100 with x1830881261074176 ext(3858432->3862527) 00002000:00010000:3.0:1746065124.287048:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97100 00000100:00100000:0.0:1746065124.289625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.290683:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261074304 00000100:00100000:0.0:1746065124.290690:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261074304 00010000:00010000:0.0:1746065124.290719:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 27 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.290740:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5412 00000100:00100000:0.0:1746065124.290747:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261074304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065124.290757:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065124.290771:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 27 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.290784:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 27 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.290801:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3561 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b27f expref: 27 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.290828:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.290830:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.290836:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.290843:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.290869:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.290880:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133089f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259747328:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065124.290936:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.295800:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.295866:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.295888:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261074432 00000100:00100000:0.0:1746065124.295895:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261074432 00000100:00100000:0.0:1746065124.295929:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10884 00000100:00100000:0.0:1746065124.295936:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:29025:x1830881261074432:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065124.295956:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.295971:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2a9 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.295996:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ec expref: 37 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.296003:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b24e expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.296008:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.296010:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.296012:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4542463] (req 4194304->4542463) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 37 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.296035:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b24e expref: 26 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.296044:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b24e expref: 26 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746065124.297092:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747456:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065124.298020:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ec expref: 37 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.298032:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ec expref: 37 pid: 21998 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746065124.298046:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747584:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065124.298066:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.298995:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133089f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881259747328:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065124.299011:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065124.299036:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+26:1958:x1830881261074304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8289us (9417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.299044:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5412 00000100:00100000:0.0:1746065124.299090:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261074688 00000100:00100000:0.0:1746065124.299095:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261074688 00002000:00100000:0.0:1746065124.299122:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1654784->1658879) req@ffff88013308a680 x1830881261074688/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.299131:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013308a680 with x1830881261074688 ext(1654784->1658879) 00002000:00010000:0.0:1746065124.299134:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013308a680 00000100:00100000:0.0:1746065124.299149:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4971 00000100:00100000:0.0:1746065124.299154:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261074688:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065124.299269:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261074688:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 115us (3403us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065124.299275:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4971 00002000:00100000:0.0:1746065124.299279:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1654784->1658879) req@ffff88013308a680 x1830881261074688/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.299285:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013308a680 with x1830881261074688 ext(1654784->1658879) 00002000:00010000:0.0:1746065124.299287:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013308a680 00000100:00100000:2.0:1746065124.302723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.302775:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747456:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.302785:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747584:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.302810:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4542463] (req 4194304->4542463) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 37 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.302840:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505c800, rc 0) 00000100:00100000:2.0:1746065124.302875:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:29025:x1830881261074432:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6939us (7082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.302882:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10884 00000100:00100000:2.0:1746065124.303924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.303942:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261075072 00000100:00100000:2.0:1746065124.303948:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261075072 00010000:00010000:2.0:1746065124.303967:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ec expref: 37 pid: 21998 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065124.303985:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5413 00000100:00100000:2.0:1746065124.303991:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261075072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.304000:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.304016:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ec expref: 37 pid: 21998 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.304026:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ec expref: 37 pid: 21998 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.304044:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd82200/0x14b4f8542d4f349d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1ec expref: 37 pid: 21998 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.304057:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.304074:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881261075072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.304079:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5413 00000100:00100000:2.0:1746065124.304145:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261074944 00000100:00100000:2.0:1746065124.304148:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261074944 00002000:00100000:2.0:1746065124.304168:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1941504->1945599) req@ffff88012f541180 x1830881261074944/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.304176:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f541180 with x1830881261074944 ext(1941504->1945599) 00002000:00010000:2.0:1746065124.304180:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f541180 00000100:00100000:2.0:1746065124.304190:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4972 00000100:00100000:2.0:1746065124.304195:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881261074944:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065124.304294:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881261074944:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 98us (1578us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065124.304299:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4972 00002000:00100000:2.0:1746065124.304304:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1941504->1945599) req@ffff88012f541180 x1830881261074944/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.304311:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f541180 with x1830881261074944 ext(1941504->1945599) 00002000:00010000:2.0:1746065124.304314:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f541180 00000100:00100000:0.0:1746065124.305309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.305461:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261075200 00000100:00100000:2.0:1746065124.305465:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261075200 00010000:00010000:2.0:1746065124.305481:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b24e expref: 26 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065124.305497:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5414 00000100:00100000:2.0:1746065124.305502:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261075200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.305511:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.305521:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b24e expref: 26 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.305529:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b24e expref: 26 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.305542:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcf9000/0x14b4f8542d4f3529 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b24e expref: 26 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.305550:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.305552:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.305557:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 35 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.305564:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 35 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.305585:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 35 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065124.305594:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259747712:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065124.305643:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.306318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.306532:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261075456 00000100:00100000:3.0:1746065124.306538:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261075456 00000100:00100000:3.0:1746065124.308078:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3701 00000100:00100000:3.0:1746065124.308084:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:29028:x1830881261075456:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065124.308255:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:29028:x1830881261075456:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 169us (1936us total) trans 8589943108 rc 0/0 00000100:00100000:3.0:1746065124.308261:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3701 00000100:00100000:0.0:1746065124.311936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.312110:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261075712 00000100:00100000:2.0:1746065124.312119:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261075712 00000100:00100000:2.0:1746065124.312164:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9053 00000100:00100000:2.0:1746065124.312171:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:29032:x1830881261075712:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065124.312194:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.312210:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095c00/0x14b4f8542d4f35ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2b0 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.312283:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.312295:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.312304:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065124.312312:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065124.312408:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0095c00/0x14b4f8542d4f35ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b0 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.312422:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b0 expref: 255 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.312428:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065124.312431:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065124.312433:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0094000, rc 0) 00000100:00100000:2.0:1746065124.312472:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29032:x1830881261075712:12345-192.168.202.46@tcp:101:cat.0 Request processed in 301us (543us total) trans 8589943109 rc 0/0 00000100:00100000:2.0:1746065124.312478:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9053 00000100:00100000:2.0:1746065124.317083:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259747712:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065124.317102:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.317138:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261075200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 11634us (11829us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.317148:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5414 00000100:00100000:3.0:1746065124.317874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.317893:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261075968 00000100:00100000:3.0:1746065124.317898:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261075968 00002000:00100000:3.0:1746065124.317926:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (4538368->4542463) req@ffff88013667c000 x1830881261075968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.317934:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667c000 with x1830881261075968 ext(4538368->4542463) 00002000:00010000:3.0:1746065124.317938:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013667c000 00000100:00100000:3.0:1746065124.317952:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4973 00000100:00100000:3.0:1746065124.317959:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261075968:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065124.318078:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261075968:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 118us (204us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065124.318083:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4973 00002000:00100000:3.0:1746065124.318088:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (4538368->4542463) req@ffff88013667c000 x1830881261075968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.318095:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667c000 with x1830881261075968 ext(4538368->4542463) 00002000:00010000:3.0:1746065124.318098:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013667c000 00000100:00100000:0.0:1746065124.320899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.320955:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261076096 00000100:00100000:1.0:1746065124.320961:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261076096 00000100:00100000:1.0:1746065124.321098:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10885 00000100:00100000:1.0:1746065124.321106:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261076096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.321118:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.321132:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad400/0x14b4f8542d4f35df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2b7 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.321173:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747840:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065124.321537:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.323868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:0.0:1746065124.325686:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065124 -> 1746065125 00000100:00100000:0.0:1746065124.325709:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747840:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065124.325737:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad400/0x14b4f8542d4f35df lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b7 expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.325748:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c3ad400/0x14b4f8542d4f35df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b7 expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.325758:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ad400, rc 0) 00000100:00100000:0.0:1746065124.325798:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261076096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4692us (4901us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065124.325806:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10885 00000100:00100000:3.0:1746065124.326617:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261076352 00000100:00100000:3.0:1746065124.326624:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261076352 00000100:00100000:3.0:1746065124.326653:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3702 00000100:00100000:3.0:1746065124.326660:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29025:x1830881261076352:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065124.326838:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:29025:x1830881261076352:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 177us (2975us total) trans 8589943110 rc 0/0 00000100:00100000:3.0:1746065124.326844:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3702 00000100:00100000:0.0:1746065124.329341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.329369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.329404:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261076480 00000100:00100000:0.0:1746065124.329410:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261076480 00000100:00100000:0.0:1746065124.329435:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261076608 00000100:00100000:0.0:1746065124.329436:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261076608 00000100:00100000:0.0:1746065124.329448:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10886 00000100:00100000:0.0:1746065124.329455:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261076480:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.329468:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065124.329470:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10887 00010000:00010000:0.0:1746065124.329480:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a505d000/0x14b4f8542d4f35e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2be expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.329521:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747968:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065124.329538:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261076608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.329549:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065124.329624:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d180 going to sleep for 11 seconds 00010000:00010000:1.0:1746065124.329646:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f35ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2c5 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.329738:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259748096:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065124.329873:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7df00 going to sleep for 11 seconds 00002000:00010000:1.0:1746065124.338281:0:8427:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065124 -> 1746065125 00002000:00010000:1.0:1746065124.338287:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065123 -> 1746065125 00002000:00010000:1.0:1746065124.338289:0:8427:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065124 -> 1746065125 00000100:00100000:1.0:1746065124.338307:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259748096:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065124.338346:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f35ed lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2c5 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.338357:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f35ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2c5 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.338367:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ace00, rc 0) 00000100:00100000:1.0:1746065124.338407:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261076608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8929us (9037us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065124.338414:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10887 00000100:00100000:1.0:1746065124.338469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065124.338537:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065124 -> 1746065125 00002000:00010000:1.0:1746065124.338539:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065124 -> 1746065125 00002000:00010000:1.0:1746065124.338540:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065124 -> 1746065125 00000100:00100000:1.0:1746065124.338551:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259747968:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065124.338567:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a505d000/0x14b4f8542d4f35e6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2be expref: 26 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.338574:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a505d000/0x14b4f8542d4f35e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2be expref: 26 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.338582:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505d000, rc 0) 00000100:00100000:1.0:1746065124.338603:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261076480:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9149us (9267us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065124.338608:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10886 00000100:00100000:0.0:1746065124.339460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.339492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.339511:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261076864 00000100:00100000:0.0:1746065124.339516:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261076864 00002000:00100000:0.0:1746065124.339543:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094d97b80 x1830881261076864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.339552:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97b80 with x1830881261076864 ext(0->1048575) 00002000:00010000:0.0:1746065124.339556:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d97b80 00000100:00100000:0.0:1746065124.339567:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261077120 00000100:00100000:0.0:1746065124.339569:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261077120 00002000:00100000:0.0:1746065124.339578:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880133089500 x1830881261077120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.339584:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133089500 with x1830881261077120 ext(1048576->2097151) 00002000:00010000:0.0:1746065124.339587:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133089500 00000100:00100000:0.0:1746065124.339594:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261077376 00000100:00100000:0.0:1746065124.339596:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261077376 00002000:00100000:0.0:1746065124.339604:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f238000 x1830881261077376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.339609:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f238000 with x1830881261077376 ext(1048576->2097151) 00002000:00010000:0.0:1746065124.339612:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f238000 00000100:00100000:0.0:1746065124.339622:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4974 00000100:00100000:0.0:1746065124.339628:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881261076864:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.339748:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4975 00000100:00100000:0.0:1746065124.339754:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881261077120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065124.340415:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4976 00000100:00100000:3.0:1746065124.340423:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881261077376:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.353201:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881261076864:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13565us (14724us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065124.353212:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4974 00002000:00100000:0.0:1746065124.353222:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880094d97b80 x1830881261076864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.353230:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97b80 with x1830881261076864 ext(0->1048575) 00002000:00010000:0.0:1746065124.353235:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d97b80 00000100:00100000:0.0:1746065124.356135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.356636:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881261077120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16880us (17175us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065124.356645:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4975 00002000:00100000:0.0:1746065124.356655:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880133089500 x1830881261077120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.356663:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133089500 with x1830881261077120 ext(1048576->2097151) 00002000:00010000:0.0:1746065124.356668:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133089500 00000100:00100000:0.0:1746065124.356693:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261077632 00000100:00100000:0.0:1746065124.356698:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261077632 00002000:00100000:0.0:1746065124.356721:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f238380 x1830881261077632/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 504/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.356726:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f238380 with x1830881261077632 ext(1048576->2097151) 00002000:00010000:0.0:1746065124.356729:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f238380 00000100:00100000:0.0:1746065124.356743:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4977 00000100:00100000:0.0:1746065124.356748:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261077632:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.363957:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881261077376:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23527us (24456us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.363967:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4976 00002000:00100000:2.0:1746065124.363977:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f238000 x1830881261077376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.363985:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f238000 with x1830881261077376 ext(1048576->2097151) 00002000:00010000:2.0:1746065124.363990:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f238000 00000100:00100000:0.0:1746065124.375204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.375244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.375267:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261077760 00000100:00100000:0.0:1746065124.375274:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261077760 00000100:00100000:0.0:1746065124.375340:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9054 00000100:00100000:0.0:1746065124.375347:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:29038:x1830881261077760:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065124.375366:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.375380:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7c00/0x14b4f8542d4f35f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2cc expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.375427:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375438:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375447:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375458:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375463:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375467:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375600:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375609:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375614:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065124.375642:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:0.0:1746065124.375645:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065124.375658:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375666:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375673:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375677:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375682:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375687:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8e6a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065124.375690:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375695:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375704:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065124.375707:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065124.375710:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375715:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f35fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375724:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375728:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375732:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375736:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8e7200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065124.375737:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375742:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375746:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f000) 00010000:00010000:0.0:1746065124.375748:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065124.375750:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375753:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3602 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065124.375775:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7c00/0x14b4f8542d4f35f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2cc expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.375784:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2cc expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.375793:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065124.375794:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065124.375796:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6600, rc 0) 00000100:00100000:0.0:1746065124.375852:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29038:x1830881261077760:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 505us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.375857:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9054 00000100:00100000:0.0:1746065124.375882:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261077888 00000100:00100000:0.0:1746065124.375885:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261077888 00000100:00100000:0.0:1746065124.375903:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10888 00000100:00100000:0.0:1746065124.375908:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:29032:x1830881261077888:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.375915:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.375923:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2d3 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.375939:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.375945:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.375946:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.375949:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 37 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.375970:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.375980:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 26 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.375991:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f238e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259748224:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065124.376047:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.376241:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261077632:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19491us (20112us total) trans 0 rc 757760/757760 00000100:00100000:0.0:1746065124.376248:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4977 00002000:00100000:0.0:1746065124.376255:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f238380 x1830881261077632/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 504/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.376263:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f238380 with x1830881261077632 ext(1048576->2097151) 00010000:00010000:0.0:1746065124.376268:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 25 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.376286:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 25 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.376292:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f238380 00000100:00100000:0.0:1746065124.379347:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f238e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259748224:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065124.379373:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 37 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.379387:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6800, rc 0) 00000100:00100000:0.0:1746065124.379416:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:29032:x1830881261077888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3507us (4172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.379423:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10888 00000100:00100000:3.0:1746065124.383113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.383642:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078016 00000100:00100000:0.0:1746065124.383650:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078016 00002000:00100000:0.0:1746065124.383685:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1654784->1945599) req@ffff88013667ca80 x1830881261078016/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.383693:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667ca80 with x1830881261078016 ext(1654784->1945599) 00010000:00010000:0.0:1746065124.383701:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 25 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.383713:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 25 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.383718:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013667ca80 00000100:00100000:0.0:1746065124.383740:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1524 00000100:00100000:0.0:1746065124.383747:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261078016:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065124.385348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.385374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.385393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.385404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.385422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.385441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.385456:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078144 00000100:00100000:0.0:1746065124.385461:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078144 00000100:00100000:0.0:1746065124.385484:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078272 00000100:00100000:0.0:1746065124.385485:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078272 00000100:00100000:2.0:1746065124.385495:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078400 00000100:00100000:2.0:1746065124.385499:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078400 00000100:00100000:0.0:1746065124.385500:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078528 00000100:00100000:0.0:1746065124.385501:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078528 00000100:00100000:0.0:1746065124.385508:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078656 00000100:00100000:0.0:1746065124.385509:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078656 00000100:00100000:0.0:1746065124.385516:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078784 00000100:00100000:0.0:1746065124.385517:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078784 00000100:00100000:2.0:1746065124.385522:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10889 00000100:00100000:2.0:1746065124.385528:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261078144:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065124.385540:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.385554:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2da expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.385572:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065124.385572:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10890 00010000:00010000:2.0:1746065124.385574:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065124.385577:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261078272:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065124.385581:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2da expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.385584:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.385593:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2da expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.385593:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2e1 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.385602:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0095c00, rc 0) 00000100:00100000:2.0:1746065124.385629:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261078144:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 102us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.385635:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10889 00000100:00100000:2.0:1746065124.385651:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10891 00000100:00100000:2.0:1746065124.385655:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881261078528:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:1.0:1746065124.385659:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10892 00010000:00010000:2.0:1746065124.385660:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.385664:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f3625 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2ef expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.385665:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261078400:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065124.385671:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065124.385674:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10893 00010000:00010000:1.0:1746065124.385678:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2e8 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.385683:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881261078656:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065124.385690:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065124.385691:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259748352:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065124.385693:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.385694:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.385697:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3633 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2f6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.385699:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e8 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.385708:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e8 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.385714:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ace00, rc 0) 00000100:00100000:3.0:1746065124.385721:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259748480:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065124.385726:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.385733:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261078400:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 69us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.385738:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10892 00000100:00100000:2.0:1746065124.385742:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10894 00000100:00100000:3.0:1746065124.385744:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.385746:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261078784:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065124.385751:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.385756:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0094800/0x14b4f8542d4f363a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b2fd expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065124.385773:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259748608:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065124.385789:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c22e40 going to sleep for 11 seconds 00010000:00010000:0.0:1746065124.387290:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.387292:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.387300:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e1 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.387311:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e1 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.387334:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6000, rc 0) 00000100:00100000:0.0:1746065124.387375:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261078272:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1797us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.387381:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10890 00000100:00080000:0.0:1746065124.387408:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1746065124.387939:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5699 -> 5801 00000100:00100000:2.0:1746065124.387946:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259748480:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065124.387968:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3633 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2f6 expref: 15 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.387978:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3633 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2f6 expref: 15 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.387990:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570a600, rc 0) 00000100:00100000:2.0:1746065124.388024:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881261078656:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2343us (2600us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065124.388030:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10893 00000100:00100000:0.0:1746065124.388470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.388505:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259748608:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065124.388521:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0094800/0x14b4f8542d4f363a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2fd expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.388530:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0094800/0x14b4f8542d4f363a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2fd expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.388542:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0094800, rc 0) 00000100:00100000:0.0:1746065124.388573:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261078784:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2825us (3130us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065124.388579:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10894 00000100:00100000:0.0:1746065124.388592:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261079040 00000100:00100000:0.0:1746065124.388596:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261079040 00000100:00100000:0.0:1746065124.388616:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10895 00000100:00100000:0.0:1746065124.388621:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261079040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.388630:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.388640:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3641 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b30b expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.388669:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f23a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259748736:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065124.388710:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.389346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.389362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.389374:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078912 00000100:00100000:0.0:1746065124.389377:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078912 00000100:00100000:0.0:1746065124.389390:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261079168 00000100:00100000:0.0:1746065124.389391:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261079168 00000100:00100000:0.0:1746065124.389403:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10896 00000100:00100000:0.0:1746065124.389407:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261078912:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.389414:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.389420:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f3648 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b304 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.389445:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f23b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259748864:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065124.389483:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.389508:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259748352:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065124.389521:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f3625 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2ef expref: 13 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.389530:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0095200/0x14b4f8542d4f3625 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2ef expref: 13 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.389537:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0095200, rc 0) 00000100:00100000:0.0:1746065124.389553:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261078528:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3897us (4147us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065124.389558:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10891 00000100:00100000:0.0:1746065124.389570:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10897 00000100:00100000:0.0:1746065124.389574:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261079168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.389581:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.389587:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f364f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b312 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.389606:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f23b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259748992:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065124.389623:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.390271:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881261078016:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6524us (7161us total) trans 17179872850 rc 0/0 00000100:00100000:1.0:1746065124.390279:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1524 00002000:00100000:1.0:1746065124.390287:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1654784->1945599) req@ffff88013667ca80 x1830881261078016/t17179872850(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.390294:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667ca80 with x1830881261078016 ext(1654784->1945599) 00010000:00010000:1.0:1746065124.390300:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 31 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.390311:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 31 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:1.0:1746065124.390317:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013667ca80 00000100:00100000:1.0:1746065124.391044:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f23b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259748992:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065124.391055:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f23b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259748864:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065124.391061:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f364f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b312 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.391069:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f3648 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b304 expref: 30 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.391070:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0094c00/0x14b4f8542d4f364f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b312 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.391077:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6a00/0x14b4f8542d4f3648 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b304 expref: 30 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.391078:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0094c00, rc 0) 00010000:00010000:0.0:1746065124.391084:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6a00, rc 0) 00000100:00100000:1.0:1746065124.391099:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261079168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1524us (1735us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065124.391101:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261078912:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1693us (1756us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065124.391105:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10897 00000100:00100000:0.0:1746065124.391205:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10896 00000100:00100000:0.0:1746065124.391696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.391725:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f23a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259748736:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065124.391739:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3641 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b30b expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.391747:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6c00/0x14b4f8542d4f3641 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b30b expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.391754:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e6c00, rc 0) 00000100:00100000:0.0:1746065124.391774:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261079040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3153us (3306us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065124.391779:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10895 00000100:00100000:2.0:1746065124.391922:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261079424 00000100:00100000:2.0:1746065124.391926:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261079424 00000100:00100000:2.0:1746065124.391952:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9055 00000100:00100000:2.0:1746065124.391958:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29038:x1830881261079424:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065124.391968:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.391979:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4f3656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b319 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.392045:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.392057:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b21d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.392064:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b28d expref: 255 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.392069:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b294 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.392075:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2cc expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.392084:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 7/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.392104:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2cc expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.392112:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2cc expref: 8 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.392122:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749120:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.392239:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b294 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.392247:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b294 expref: 12 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.392254:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749248:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.392279:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b28d expref: 255 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.392286:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b28d expref: 255 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.392293:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f542300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749376:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.392315:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b21d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.392334:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b21d expref: 12 pid: 14643 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.392341:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f542680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749504:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.392358:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c22e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.393576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.393967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.393983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.394004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.394020:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261079552 00000100:00100000:0.0:1746065124.394025:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261079552 00000100:00100000:0.0:1746065124.394055:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10898 00000100:00100000:0.0:1746065124.394061:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+27:29035:x1830881261079552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.394071:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.394083:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b320 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.394102:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.394109:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.394110:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065124.394113:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 28 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.394132:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.394140:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261079936 00010000:00010000:0.0:1746065124.394140:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 36 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.394143:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261079936 00000100:00100000:0.0:1746065124.394148:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f23b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259749632:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065124.394157:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b21d expref: 13 pid: 14643 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.394171:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261079808 00000100:00100000:3.0:1746065124.394173:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261079808 00010000:00010000:3.0:1746065124.394180:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b28d expref: 256 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.394187:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065124.394189:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261079680 00000100:00100000:3.0:1746065124.394191:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261079680 00010000:00010000:3.0:1746065124.394197:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b294 expref: 14 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.394207:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5415 00000100:00100000:3.0:1746065124.394212:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261079936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065124.394219:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065124.394223:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b21d expref: 14 pid: 14643 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.394231:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b21d expref: 14 pid: 14643 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.394246:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065124.394250:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.394256:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00000100:00100000:2.0:1746065124.394257:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5416 00010000:00010000:3.0:1746065124.394260:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.394263:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1960:x1830881261079808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.394269:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.394272:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b28d expref: 256 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.394279:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b28d expref: 256 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.394290:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261079936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (323us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065124.394290:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065124.394292:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00000100:00100000:3.0:1746065124.394296:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5415 00010000:00010000:2.0:1746065124.394297:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.394300:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065124.394307:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5417 00000100:00100000:3.0:1746065124.394311:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881261079680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065124.394312:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1960:x1830881261079808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.394316:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5416 00010000:00010000:3.0:1746065124.394317:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065124.394332:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b294 expref: 13 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.394339:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b294 expref: 13 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.394347:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065124.394349:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.394354:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.394358:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.394369:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749120:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065124.394370:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881261079680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.394374:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5417 00010000:00010000:2.0:1746065124.394378:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6400/0x14b4f8542d4f35a7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b294 expref: 13 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.394387:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749248:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.394394:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6200/0x14b4f8542d4f3584 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b28d expref: 255 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.394401:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f542300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749376:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.394407:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd37400/0x14b4f8542d4f34ff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b21d expref: 11 pid: 14643 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.394414:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f542680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749504:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.394430:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065124.395658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.395682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.395697:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261080064 00000100:00100000:1.0:1746065124.395701:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261080064 00010000:00010000:1.0:1746065124.395718:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2cc expref: 9 pid: 24350 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.395733:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261080192 00000100:00100000:1.0:1746065124.395735:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261080192 00010000:00010000:1.0:1746065124.395744:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 29 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.395757:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5418 00000100:00100000:1.0:1746065124.395761:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261080064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.395769:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.395773:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2cc expref: 9 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.395780:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2cc expref: 9 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.395793:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e6600/0x14b4f8542d4f3609 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2cc expref: 9 pid: 24350 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.395803:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065124.395806:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065124.395811:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065124.395839:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065124.395862:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065124.395880:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065124.395883:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261080064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 121us (227us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065124.395887:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065124.395888:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5418 00000100:00100000:1.0:1746065124.395900:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5419 00000004:00200000:2.0:1746065124.395902:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000100:00100000:1.0:1746065124.395904:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881261080192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.395910:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.395925:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 29 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.395932:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 29 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.395944:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0094200/0x14b4f8542d4f35bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1945599) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a2 expref: 29 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.395952:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.395953:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.395957:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.395963:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.395985:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.395993:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d91880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259749760:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065124.396014:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4f3656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b319 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.396022:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7dd80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065124.396028:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b319 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.396033:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065124.396036:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065124.396040:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9a000, rc 0) 00000100:00100000:2.0:1746065124.396312:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29038:x1830881261079424:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4353us (4615us total) trans 8589943111 rc 0/0 00000100:00100000:2.0:1746065124.396327:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9055 00000100:00100000:0.0:1746065124.396906:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f23b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259749632:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065124.396923:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 28 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.396938:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba800, rc 0) 00000100:00100000:0.0:1746065124.396969:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+28:29035:x1830881261079552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2907us (3393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.396975:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10898 00000100:00100000:0.0:1746065124.397737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.398028:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261080320 00000100:00100000:0.0:1746065124.398034:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261080320 00002000:00100000:0.0:1746065124.398059:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4542463) req@ffff88009f23b480 x1830881261080320/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.398067:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f23b480 with x1830881261080320 ext(4194304->4542463) 00010000:00010000:0.0:1746065124.398073:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 37 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.398085:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 37 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.398091:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f23b480 00000100:00100000:0.0:1746065124.398117:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1525 00000100:00100000:0.0:1746065124.398123:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261080320:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065124.398220:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6d91880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259749760:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065124.398231:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.398254:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261080192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2350us (2571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.398261:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5419 00000100:00100000:1.0:1746065124.400328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.400437:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261080448 00000100:00100000:2.0:1746065124.400443:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261080448 00000100:00100000:2.0:1746065124.400472:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9056 00000100:00100000:2.0:1746065124.400478:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29038:x1830881261080448:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065124.400494:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.400507:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3672 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b327 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.400567:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.400579:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b319 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.400585:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.400607:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b319 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.400619:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b319 expref: 9 pid: 14643 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.400628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.400630:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f542680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749888:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.400678:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130472d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065124.400761:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261080704 00000100:00100000:3.0:1746065124.400765:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261080704 00002000:00100000:3.0:1746065124.400783:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880130446d80 x1830881261080704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.400792:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446d80 with x1830881261080704 ext(1048576->2097151) 00002000:00010000:3.0:1746065124.400796:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130446d80 00000100:00100000:3.0:1746065124.400808:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4978 00000100:00100000:3.0:1746065124.401173:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261080704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.403047:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f542680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259749888:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.403068:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065124.404457:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881261080320:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6329us (6715us total) trans 17179872851 rc 0/0 00000100:00100000:1.0:1746065124.404466:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1525 00002000:00100000:1.0:1746065124.404475:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4542463) req@ffff88009f23b480 x1830881261080320/t17179872851(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.404484:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f23b480 with x1830881261080320 ext(4194304->4542463) 00010000:00010000:1.0:1746065124.404492:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 41 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.404503:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 41 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:1.0:1746065124.404509:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f23b480 00000100:00100000:0.0:1746065124.405762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.406369:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261080832 00000100:00100000:3.0:1746065124.406377:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261080832 00010000:00010000:3.0:1746065124.406403:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b319 expref: 10 pid: 14643 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.406442:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5420 00000100:00100000:3.0:1746065124.406449:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261080832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065124.406460:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065124.406465:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b319 expref: 10 pid: 14643 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.406475:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b319 expref: 10 pid: 14643 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.406493:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a000/0x14b4f8542d4f365d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b319 expref: 10 pid: 14643 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.406504:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065124.406508:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.406516:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.406521:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.406538:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065124.406566:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261080832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 118us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.406571:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5420 00010000:00010000:3.0:1746065124.406589:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.406599:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065124.406632:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065124.406636:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065124.406659:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.406687:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3672 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b327 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.406700:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b327 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.406705:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065124.406708:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065124.406710:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e7200, rc 0) 00000100:00100000:3.0:1746065124.406731:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29038:x1830881261080448:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6254us (6416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.406737:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9056 00000100:00100000:1.0:1746065124.409581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.410307:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261080960 00000100:00100000:1.0:1746065124.410315:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261080960 00010000:00010000:1.0:1746065124.410348:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 41 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.410378:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5421 00000100:00100000:1.0:1746065124.410385:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881261080960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.410395:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.410413:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 41 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.410425:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 41 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.410443:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a505c800/0x14b4f8542d4f35c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2a9 expref: 41 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.410453:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.410455:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.410461:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 26 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.410468:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 26 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.410493:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 26 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.410503:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259750016:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065124.411159:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261080704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10343us (10528us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.411168:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4978 00002000:00100000:3.0:1746065124.411175:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880130446d80 x1830881261080704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.411189:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446d80 with x1830881261080704 ext(1048576->2097151) 00002000:00010000:3.0:1746065124.411194:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130446d80 00000100:00100000:1.0:1746065124.411247:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7d900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.411427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.411446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.411448:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261081216 00000100:00100000:0.0:1746065124.411452:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261081216 00000100:00100000:0.0:1746065124.411472:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261081088 00000100:00100000:0.0:1746065124.411474:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261081088 00000100:00100000:0.0:1746065124.411486:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10899 00000100:00100000:0.0:1746065124.411492:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261081216:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065124.411504:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.411513:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b335 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.411525:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065124.411526:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.411528:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.411532:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b335 expref: 14 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.411543:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b335 expref: 14 pid: 21235 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065124.411544:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261081344 00000100:00100000:1.0:1746065124.411547:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261081344 00010000:00010000:0.0:1746065124.411550:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570a000, rc 0) 00000100:00100000:1.0:1746065124.411567:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10900 00000100:00100000:1.0:1746065124.411571:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261081088:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:0.0:1746065124.411571:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261081216:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 80us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.411577:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10899 00010000:00010000:1.0:1746065124.411578:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.411585:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b32e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.411590:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10901 00000100:00100000:0.0:1746065124.411594:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261081344:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065124.411595:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.411597:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.411601:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.411602:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b32e expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.411610:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b32e expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.411617:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd8aa00, rc 0) 00010000:00010000:0.0:1746065124.411618:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a570aa00/0x14b4f8542d4f368e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b33c expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.411632:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261081088:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 61us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.411637:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10900 00000100:00100000:0.0:1746065124.411650:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259750144:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065124.411671:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.415086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.415143:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259750016:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.415174:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.415201:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261080960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4816us (5625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.415212:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5421 00000100:00100000:3.0:1746065124.415309:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261081600 00000100:00100000:3.0:1746065124.415314:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261081600 00000100:00100000:0.0:1746065124.415332:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259750144:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065124.415350:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a570aa00/0x14b4f8542d4f368e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b33c expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.415360:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a570aa00/0x14b4f8542d4f368e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b33c expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.415368:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570aa00, rc 0) 00000100:00100000:0.0:1746065124.415386:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261081344:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3792us (3920us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065124.415391:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10901 00002000:00100000:3.0:1746065124.415442:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012f542680 x1830881261081600/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.415451:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f542680 with x1830881261081600 ext(2097152->3145727) 00002000:00010000:3.0:1746065124.415455:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f542680 00000100:00100000:3.0:1746065124.415471:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4979 00000100:00100000:3.0:1746065124.415478:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261081600:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.417395:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.419846:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261081728 00000100:00100000:0.0:1746065124.419855:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261081728 00000100:00100000:0.0:1746065124.419891:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10902 00000100:00100000:0.0:1746065124.419898:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:29032:x1830881261081728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.419914:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.419927:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b343 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.419948:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.419951:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.419956:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 39 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.419974:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 39 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.419984:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a570a600, rc 0) 00000100:00100000:0.0:1746065124.420034:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:29032:x1830881261081728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 136us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.420040:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10902 00000100:00100000:3.0:1746065124.420206:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.420258:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261081984 00000100:00100000:3.0:1746065124.420262:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261081984 00000100:00100000:3.0:1746065124.420284:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9057 00000100:00100000:3.0:1746065124.420289:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29038:x1830881261081984:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065124.420298:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065124.420308:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57200/0x14b4f8542d4f369c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b34a expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.420386:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.420396:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.420404:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065124.421047:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065124.421138:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57200/0x14b4f8542d4f369c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b34a expref: 11 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.421162:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b34a expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.421168:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065124.421170:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065124.421172:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134d57600, rc 0) 00000100:00100000:3.0:1746065124.421205:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29038:x1830881261081984:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 916us (1034us total) trans 8589943112 rc 0/0 00000100:00100000:3.0:1746065124.421209:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9057 00000100:00100000:3.0:1746065124.423200:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261081600:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7717us (8112us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.423207:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4979 00002000:00100000:3.0:1746065124.423215:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012f542680 x1830881261081600/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.423221:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f542680 with x1830881261081600 ext(2097152->3145727) 00002000:00010000:3.0:1746065124.423225:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f542680 00000100:00100000:1.0:1746065124.427293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.427455:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261082112 00000100:00100000:0.0:1746065124.427463:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261082112 00000100:00100000:0.0:1746065124.427495:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10903 00000100:00100000:0.0:1746065124.427502:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1961:x1830881261082112:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065124.427540:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.427557:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1b4 expref: 38 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.427565:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2da expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.427572:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b22b expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.427578:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.427580:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.427583:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.427609:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b22b expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.427620:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b22b expref: 26 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746065124.427632:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259750272:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065124.427707:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2da expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.427715:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2da expref: 14 pid: 9716 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746065124.427726:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259750400:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065124.427748:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1b4 expref: 38 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.427755:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1b4 expref: 38 pid: 8428 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.427762:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259750528:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065124.427776:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d180 going to sleep for 11 seconds 00000001:00080000:2.0:1746065124.428421:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872831 is committed 00000001:00080000:2.0:1746065124.428446:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872751 is committed 00000001:00080000:2.0:1746065124.428510:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872848 is committed 00000001:00080000:2.0:1746065124.428535:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872820 is committed 00000001:00080000:2.0:1746065124.428722:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872764 is committed 00000001:00080000:2.0:1746065124.428754:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872849 is committed 00000001:00080000:2.0:1746065124.428768:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872821 is committed 00000001:00080000:2.0:1746065124.429104:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872799 is committed 00000100:00100000:0.0:1746065124.429392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.429406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.429417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.429427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.429439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.429457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.429458:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261082240 00000100:00100000:2.0:1746065124.429463:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261082240 00000100:00100000:2.0:1746065124.429500:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261082496 00000100:00100000:2.0:1746065124.429502:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261082496 00000100:00100000:0.0:1746065124.429846:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261082752 00000100:00100000:0.0:1746065124.429849:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261082752 00000100:00100000:0.0:1746065124.429870:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261082368 00000100:00100000:0.0:1746065124.429871:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261082368 00000100:00100000:2.0:1746065124.429873:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261082624 00000100:00100000:2.0:1746065124.429877:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261082624 00000100:00100000:0.0:1746065124.429878:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261082880 00000100:00100000:0.0:1746065124.429880:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261082880 00000100:00100000:2.0:1746065124.429889:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10904 00000100:00100000:2.0:1746065124.429943:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261082240:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065124.429974:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.429986:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1bb expref: 14 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.429993:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e1 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.429999:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b232 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.430003:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065124.430029:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10905 00000100:00100000:1.0:1746065124.430043:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10906 00000100:00100000:3.0:1746065124.430048:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10907 00000100:00100000:1.0:1746065124.430049:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261082752:12345-192.168.202.46@tcp:1:lfs.0 00000100:00100000:3.0:1746065124.430054:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261082368:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065124.430065:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430066:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.430073:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 7 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430076:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430082:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065124.430083:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e8 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.430083:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065124.430085:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.430089:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b278 expref: 14 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065124.430093:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.430094:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.430096:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430103:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.430109:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b278 expref: 14 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.430111:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 14 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.430116:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b278 expref: 14 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.430120:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259750656:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065124.430123:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259750784:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065124.430149:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261082496:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065124.430163:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e8 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.430164:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.430169:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e8 expref: 10 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746065124.430173:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 24 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.430175:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259750912:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065124.430179:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b32e expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.430183:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.430184:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.430186:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 5/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.430197:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b32e expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.430204:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b32e expref: 10 pid: 25185 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.430206:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.430209:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.430211:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259751040:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.430221:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b232 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.430228:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b232 expref: 7 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065124.430237:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259751168:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.430272:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7df00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.430310:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10908 00000100:00100000:1.0:1746065124.430316:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261082624:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065124.430340:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430348:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430354:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430359:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b335 expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.430363:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.430364:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.430366:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430378:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b335 expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.430384:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b335 expref: 10 pid: 21235 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.430390:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259751296:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.430411:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430421:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 24 pid: 21235 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.430427:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259751424:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.430439:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430445:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 8 pid: 21235 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.430451:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259751552:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065124.430455:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 7 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.430461:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 7 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.430462:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065124.430468:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259751680:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.430473:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10909 00000100:00100000:1.0:1746065124.430478:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+7:29035:x1830881261082880:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065124.430480:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60840 going to sleep for 11 seconds 00010000:00010000:1.0:1746065124.430484:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.430490:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b351 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430500:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065124.430502:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430507:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065124.430510:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430519:0:8427:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430530:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.430539:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cc1e00, rc 0) 00000100:00100000:1.0:1746065124.430966:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:29035:x1830881261082880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 486us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.430971:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10909 00010000:00010000:2.0:1746065124.431038:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e1 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.431049:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e1 expref: 10 pid: 4545 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746065124.431053:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 24 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065124.431056:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259751808:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065124.431062:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 24 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.431069:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259751936:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.431075:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1bb expref: 14 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.431081:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1bb expref: 14 pid: 21235 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.431086:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259752064:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065124.431087:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.431096:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.431115:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259750272:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065124.431154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.431198:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261083008 00000100:00100000:1.0:1746065124.431202:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261083008 00010000:00010000:1.0:1746065124.431218:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b22b expref: 9 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.431245:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5422 00000100:00100000:1.0:1746065124.431250:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+9:1958:x1830881261083008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.431257:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.431277:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b22b expref: 9 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.431284:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b22b expref: 9 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.431299:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd83a00/0x14b4f8542d4f350d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b22b expref: 9 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.431307:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.431335:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+8:1958:x1830881261083008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.431339:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5422 00000100:00100000:2.0:1746065124.431766:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259750400:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.431773:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259750528:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.431787:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.433496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.433540:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.433592:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261083264 00000100:00100000:1.0:1746065124.433594:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261083520 00000100:00100000:3.0:1746065124.433597:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261083264 00000100:00100000:1.0:1746065124.433598:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261083520 00002000:00100000:1.0:1746065124.433623:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8801355f6680 x1830881261083520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.433624:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8801355f6300 x1830881261083264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.433631:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f6300 with x1830881261083264 ext(2097152->3145727) 00002000:00100000:1.0:1746065124.433631:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f6680 with x1830881261083520 ext(3145728->4194303) 00010000:00010000:3.0:1746065124.433638:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 26 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.433638:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 26 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.433648:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 26 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.433648:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 26 pid: 21235 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746065124.433654:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801355f6300 00002000:00010000:1.0:1746065124.433654:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801355f6680 00000100:00100000:1.0:1746065124.433679:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1526 00000100:00100000:1.0:1746065124.433685:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881261083520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065124.433745:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1527 00000100:00100000:3.0:1746065124.433752:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881261083264:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.435207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.435909:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261083776 00000100:00100000:1.0:1746065124.435915:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261083776 00010000:00010000:1.0:1746065124.435936:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2da expref: 11 pid: 9716 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.435957:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5423 00000100:00100000:1.0:1746065124.435963:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261083776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.435973:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.435988:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2da expref: 11 pid: 9716 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.435996:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2da expref: 11 pid: 9716 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746065124.436005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065124.436013:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0095c00/0x14b4f8542d4f3617 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2da expref: 11 pid: 9716 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.436026:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.436048:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261083776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.436054:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5423 00000100:00100000:2.0:1746065124.436555:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261083904 00000100:00100000:2.0:1746065124.436560:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261083904 00002000:00100000:2.0:1746065124.436583:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8801355f6a00 x1830881261083904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.436591:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f6a00 with x1830881261083904 ext(2097152->3145727) 00010000:00010000:2.0:1746065124.436598:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 15 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.436609:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 15 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746065124.436614:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801355f6a00 00000100:00100000:2.0:1746065124.436628:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1528 00000100:00100000:2.0:1746065124.436633:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881261083904:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065124.437430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.437451:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261084160 00000100:00100000:0.0:1746065124.437455:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261084160 00002000:00100000:0.0:1746065124.437472:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3858431) req@ffff88009f9cd880 x1830881261084160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.437479:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd880 with x1830881261084160 ext(3145728->3858431) 00010000:00010000:0.0:1746065124.437484:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.437492:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.437497:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cd880 00000100:00100000:0.0:1746065124.437507:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1529 00000100:00100000:0.0:1746065124.437512:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881261084160:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065124.437534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.437563:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259751168:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.437571:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259751808:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.437576:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259751296:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.437577:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259752064:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.437584:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259751424:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.437590:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259751552:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.437593:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.437604:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.437618:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261084288 00000100:00100000:1.0:1746065124.437620:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261084288 00010000:00010000:1.0:1746065124.437633:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1b4 expref: 29 pid: 8428 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.437651:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5424 00000100:00100000:1.0:1746065124.437656:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261084288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.437662:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.437672:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1b4 expref: 29 pid: 8428 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.437680:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1b4 expref: 29 pid: 8428 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.437695:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c8b1000/0x14b4f8542d4f3426 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1b4 expref: 29 pid: 8428 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.437695:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259751040:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065124.437701:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259751936:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.437705:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.437706:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.437711:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.437719:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.437734:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065124.437734:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.437752:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881261084288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.437758:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5424 00000100:00100000:1.0:1746065124.437777:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259750656:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.437787:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.437970:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259750784:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065124.437977:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259750912:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065124.437983:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259751680:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065124.437996:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.438955:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.438965:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.438991:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.438997:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.439004:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.439009:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a570b400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065124.439012:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.439018:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.439033:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.439037:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570b400/0x14b4f8542d4f36b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.440765:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261082112:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 11606us (11826us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.440777:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10903 00000100:00100000:0.0:1746065124.446546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.446562:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.446584:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261084416 00000100:00100000:1.0:1746065124.446585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.446590:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261084416 00000100:00100000:1.0:1746065124.446615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:0.0:1746065124.446623:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3858432->4194303) req@ffff88009f9ce300 x1830881261084416/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065124.446628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:0.0:1746065124.446631:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce300 with x1830881261084416 ext(3858432->4194303) 00000100:00100000:2.0:1746065124.446638:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261084672 00010000:00010000:0.0:1746065124.446639:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 19 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.446640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.446642:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261084672 00010000:00010000:0.0:1746065124.446650:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 19 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.446652:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:0.0:1746065124.446656:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9ce300 00010000:00010000:2.0:1746065124.446660:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e8 expref: 11 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.446668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.446673:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1530 00000100:00100000:2.0:1746065124.446674:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5425 00000100:00100000:2.0:1746065124.446679:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261084672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065124.446679:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881261084416:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065124.446680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065124.446689:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065124.446689:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065124.446705:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e8 expref: 11 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.446706:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065124.446719:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e8 expref: 11 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.446724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065124.446735:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c3ace00/0x14b4f8542d4f362c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e8 expref: 11 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.446736:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261084928 00000100:00100000:1.0:1746065124.446739:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261084928 00010000:00010000:2.0:1746065124.446749:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065124.446754:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b32e expref: 9 pid: 25185 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.446766:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261085184 00000100:00100000:1.0:1746065124.446767:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261085184 00000100:00100000:2.0:1746065124.446773:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261084672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 94us (187us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065124.446776:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 8 pid: 21235 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.446778:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5425 00000100:00100000:1.0:1746065124.446784:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261084544 00000100:00100000:1.0:1746065124.446786:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261084544 00000100:00100000:2.0:1746065124.446788:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261084800 00000100:00100000:2.0:1746065124.446790:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261084800 00010000:00010000:1.0:1746065124.446792:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b335 expref: 10 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.446796:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b278 expref: 20 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065124.446804:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261085312 00000100:00100000:1.0:1746065124.446804:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261085056 00000100:00100000:2.0:1746065124.446806:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261085312 00000100:00100000:1.0:1746065124.446806:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261085056 00010000:00010000:2.0:1746065124.446811:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 8 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.446832:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e1 expref: 10 pid: 4545 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746065124.446835:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261085824 00000100:00100000:2.0:1746065124.446837:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261085824 00000100:00100000:1.0:1746065124.446842:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261085440 00010000:00010000:2.0:1746065124.446843:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b232 expref: 9 pid: 8427 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746065124.446844:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261085440 00000100:00100000:2.0:1746065124.446850:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261085952 00000100:00100000:2.0:1746065124.446851:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261085952 00010000:00010000:1.0:1746065124.446852:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 28 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.446857:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1bb expref: 21 pid: 21235 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.446863:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5426 00000100:00100000:1.0:1746065124.446867:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261084928:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.446874:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.446886:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b32e expref: 10 pid: 25185 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.446893:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b32e expref: 10 pid: 25185 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.446904:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd8aa00/0x14b4f8542d4f3687 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b32e expref: 10 pid: 25185 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746065124.446912:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.446927:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261084928:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.446969:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261085696 00000100:00100000:3.0:1746065124.446971:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261085696 00000100:00100000:3.0:1746065124.446990:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9058 00000100:00100000:3.0:1746065124.446994:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+11:29040:x1830881261085696:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065124.447006:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065124.447016:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57c00/0x14b4f8542d4f36e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b358 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.447880:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.447891:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.447904:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.447914:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.447919:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.447929:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.448016:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.448024:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b34a expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.448030:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065124.448053:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b34a expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.448061:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b34a expref: 9 pid: 14643 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746065124.448070:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259752192:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065124.448105:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065124.448451:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881261083264:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14699us (14958us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.448457:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1527 00002000:00100000:3.0:1746065124.448463:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8801355f6300 x1830881261083264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.448470:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f6300 with x1830881261083264 ext(2097152->3145727) 00010000:00010000:3.0:1746065124.448476:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 27 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.448483:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 27 pid: 21235 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746065124.448492:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801355f6300 00000100:00100000:2.0:1746065124.448599:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5427 00000100:00100000:2.0:1746065124.448606:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881261085184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.448614:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.448622:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 8 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.448629:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 8 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.448640:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x14b4f8542d4f3664 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b320 expref: 8 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.448647:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.448658:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261085184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.448663:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5427 00000100:00100000:2.0:1746065124.448672:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5428 00000100:00100000:2.0:1746065124.448676:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261084544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.448682:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.448687:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b335 expref: 9 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448693:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b335 expref: 9 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448703:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a000/0x14b4f8542d4f3680 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b335 expref: 9 pid: 21235 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448709:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.448721:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261084544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 44us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.448726:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5428 00000100:00100000:2.0:1746065124.448735:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5429 00000100:00100000:2.0:1746065124.448740:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881261084800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.448747:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.448755:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b278 expref: 22 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448763:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b278 expref: 22 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448772:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135453400/0x14b4f8542d4f355a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b278 expref: 22 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448780:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.448792:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881261084800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.448797:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5429 00000100:00100000:2.0:1746065124.448805:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5430 00000100:00100000:2.0:1746065124.448810:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:1961:x1830881261085312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.448829:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.448834:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 9 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.448842:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 9 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.448848:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5426 00010000:00010000:2.0:1746065124.448850:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3db000/0x14b4f8542d4f354c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b26a expref: 9 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.448857:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.448858:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.448861:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.448868:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.448878:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.448892:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881261085312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (2212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.448896:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5430 00000100:00100000:2.0:1746065124.448903:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5431 00000100:00100000:2.0:1746065124.448907:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261085056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.448912:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065124.448917:0:7079:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:2.0:1746065124.448921:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e1 expref: 10 pid: 4545 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448928:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e1 expref: 10 pid: 4545 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448936:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8e6000/0x14b4f8542d4f361e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2e1 expref: 10 pid: 4545 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448942:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.448950:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261085056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 43us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.448954:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5431 00000100:00100000:2.0:1746065124.448975:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5432 00000100:00100000:2.0:1746065124.448979:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+7:1958:x1830881261085824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.448984:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.448988:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b232 expref: 7 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.448995:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b232 expref: 7 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.449002:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82400/0x14b4f8542d4f3514 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b232 expref: 7 pid: 8427 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746065124.449007:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.449015:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+6:1958:x1830881261085824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 35us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.449022:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5432 00000100:00100000:2.0:1746065124.449028:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5433 00000100:00100000:2.0:1746065124.449032:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261085440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.449036:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.449042:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 26 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.449048:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 26 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.449056:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8e6800/0x14b4f8542d4f3610 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2d3 expref: 26 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.449062:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.449063:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.449065:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449070:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449081:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.449090:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261085440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (2384us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.449094:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5433 00000100:00100000:2.0:1746065124.449102:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5434 00000100:00100000:2.0:1746065124.449106:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881261085952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.449110:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.449115:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1bb expref: 20 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.449121:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1bb expref: 20 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.449129:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc0800/0x14b4f8542d4f342d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b1bb expref: 20 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.449134:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.449135:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.449137:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449142:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449151:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.449159:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881261085952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.449162:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5434 00010000:00010000:2.0:1746065124.449215:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449221:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449238:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449244:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449250:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449254:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe12200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065124.449257:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449263:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449270:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.449274:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe12200/0x14b4f8542d4f36b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065124.449299:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261082240:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 19405us (19909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.449304:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881261083520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15618us (15763us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.449305:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10904 00000100:00100000:0.0:1746065124.449310:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1526 00002000:00100000:0.0:1746065124.449316:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8801355f6680 x1830881261083520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.449332:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f6680 with x1830881261083520 ext(3145728->4194303) 00010000:00010000:0.0:1746065124.449337:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 23 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.449345:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 23 pid: 21235 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746065124.449350:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801355f6680 00010000:00010000:0.0:1746065124.449367:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.449373:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.449385:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.449390:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.449395:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.449402:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a570a200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065124.449404:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.449409:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.449417:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.449422:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a200/0x14b4f8542d4f36cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.449455:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261082496:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 19420us (20048us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.449461:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10905 00010000:00010000:3.0:1746065124.450684:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.450694:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.450718:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.450724:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.450730:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.450735:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134d56e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065124.450737:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.450743:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.450754:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.450764:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134d56e00/0x14b4f8542d4f36c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.450849:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261082368:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 20788us (21413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.450855:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10907 00000100:00100000:3.0:1746065124.451171:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881261084160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13658us (13741us total) trans 0 rc 712704/712704 00000100:00100000:3.0:1746065124.451178:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1529 00002000:00100000:3.0:1746065124.451185:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3858431) req@ffff88009f9cd880 x1830881261084160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 712704/712704 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.451192:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd880 with x1830881261084160 ext(3145728->3858431) 00010000:00010000:3.0:1746065124.451198:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 17 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746065124.451207:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 17 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746065124.451212:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cd880 00000100:00100000:2.0:1746065124.455748:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881261084416:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9061us (9179us total) trans 21474840079 rc 0/0 00000100:00100000:2.0:1746065124.455758:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1530 00002000:00100000:2.0:1746065124.455768:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3858432->4194303) req@ffff88009f9ce300 x1830881261084416/t21474840079(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.455776:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce300 with x1830881261084416 ext(3858432->4194303) 00010000:00010000:2.0:1746065124.455785:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 17 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.455796:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 17 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746065124.455802:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9ce300 00000100:00100000:2.0:1746065124.456113:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259752192:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.456130:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065124.456208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.456412:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261086080 00000100:00100000:1.0:1746065124.456419:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261086080 00010000:00010000:1.0:1746065124.456443:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b34a expref: 10 pid: 14643 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.456476:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5435 00000100:00100000:1.0:1746065124.456482:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261086080:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.456494:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.456499:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b34a expref: 10 pid: 14643 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.456510:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b34a expref: 10 pid: 14643 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.456527:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57600/0x14b4f8542d4f36a3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b34a expref: 10 pid: 14643 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746065124.456539:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065124.456543:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065124.456551:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065124.456557:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065124.456582:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065124.456600:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456606:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065124.456618:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000100:00100000:1.0:1746065124.456619:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261086080:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 137us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.456627:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5435 00010000:00010000:2.0:1746065124.456681:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456687:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456692:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456697:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134d56c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065124.456700:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456704:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456711:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065124.456713:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065124.456715:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456718:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56c00/0x14b4f8542d4f36f7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456728:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456733:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456737:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456740:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134d57400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065124.456742:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456746:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456751:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065124.456752:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065124.456754:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456758:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57400/0x14b4f8542d4f36e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456764:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456769:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456774:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456777:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134d56000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065124.456779:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456783:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456788:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c8fa900) 00010000:00010000:2.0:1746065124.456790:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065124.456792:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456796:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d56000/0x14b4f8542d4f36f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065124.456857:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57c00/0x14b4f8542d4f36e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b358 expref: 13 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.456864:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d57c00/0x14b4f8542d4f36e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b358 expref: 13 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.456872:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134d57c00, rc 0) 00000100:00100000:2.0:1746065124.457381:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:29040:x1830881261085696:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10384us (10840us total) trans 8589943113 rc 301/301 00000100:00100000:2.0:1746065124.457387:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9058 00000100:00100000:1.0:1746065124.461125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.461209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.461256:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261086336 00000100:00100000:0.0:1746065124.461263:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261086336 00010000:00010000:0.0:1746065124.461287:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 23 pid: 21235 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.461315:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5436 00000100:00100000:0.0:1746065124.461332:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881261086336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065124.461342:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065124.461361:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 23 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.461371:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 23 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.461389:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a570a600/0x14b4f8542d4f3695 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b343 expref: 23 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.461401:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.461403:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.461406:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.461413:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.461438:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065124.461449:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.461458:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.461473:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881261086336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 141us (263us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065124.461479:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.461479:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5436 00010000:00010000:1.0:1746065124.461486:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.461492:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.461499:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4cc0a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065124.461502:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065124.461503:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881261083904:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24867us (25495us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746065124.461508:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065124.461511:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1528 00010000:00010000:1.0:1746065124.461516:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065124.461523:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8801355f6a00 x1830881261083904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065124.461525:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cc0a00/0x14b4f8542d4f36d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065124.461531:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f6a00 with x1830881261083904 ext(2097152->3145727) 00010000:00010000:2.0:1746065124.461537:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 15 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.461547:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 15 pid: 9716 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746065124.461553:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801355f6a00 00000100:00100000:1.0:1746065124.461559:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1961:x1830881261082624:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 31243us (32117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.461565:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10908 00000100:00100000:1.0:1746065124.461576:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261086208 00000100:00100000:1.0:1746065124.461579:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261086208 00000100:00100000:1.0:1746065124.461593:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10910 00000100:00100000:1.0:1746065124.461597:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:29032:x1830881261086208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.461609:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.461618:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b35f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.461631:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065124.461635:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.461644:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.461651:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8fe00, rc 0) 00000100:00100000:1.0:1746065124.461665:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:29032:x1830881261086208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 67us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.461669:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10910 00000100:00100000:0.0:1746065124.469036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.469098:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261086464 00000100:00100000:2.0:1746065124.469106:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261086464 00010000:00010000:2.0:1746065124.469137:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.469167:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5437 00000100:00100000:2.0:1746065124.469174:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881261086464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.469188:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.469205:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.469216:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.469234:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0095800/0x14b4f8542d4f35b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b29b expref: 16 pid: 9716 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.469259:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.469261:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.469265:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.469273:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.469299:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.469349:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881261086464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 174us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.469355:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5437 00010000:00010000:1.0:1746065124.469799:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469808:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469854:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469861:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469867:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469874:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4cc1a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065124.469877:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469884:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469893:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.469894:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.469899:0:21235:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 5 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469905:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 5 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469911:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.469912:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.469915:0:21235:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469920:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.469943:0:21235:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.469953:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259752320:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.470028:0:21235:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 5 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.470036:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259752448:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065124.470057:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.473710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.473785:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261086592 00000100:00100000:1.0:1746065124.473792:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261086592 00000100:00100000:0.0:1746065124.473850:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10911 00000100:00100000:0.0:1746065124.473858:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+7:29040:x1830881261086592:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065124.473872:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.473887:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b366 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065124.473912:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e3, atime: 0x6812d6e3, ctime: 0x6812d6e3, blocks: 0x7f1 00010000:00010000:0.0:1746065124.473929:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.473931:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.473937:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.473948:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.473957:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00e7600, rc 0) 00000100:00100000:0.0:1746065124.473999:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+8:29040:x1830881261086592:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.474004:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10911 00000100:00100000:1.0:1746065124.476901:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259752320:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065124.476912:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259752448:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.476936:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.476946:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1a00/0x14b4f8542d4f36bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.477008:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261082752:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 46958us (47587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.477016:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10906 00000100:00100000:0.0:1746065124.477610:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.477652:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261086848 00000100:00100000:2.0:1746065124.477658:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261086848 00002000:00100000:2.0:1746065124.477688:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8801355f7100 x1830881261086848/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.477697:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f7100 with x1830881261086848 ext(2097152->3145727) 00002000:00010000:2.0:1746065124.477701:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355f7100 00000100:00100000:2.0:1746065124.477724:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4980 00000100:00100000:2.0:1746065124.477730:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+6:1961:x1830881261086848:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065124.478130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.479307:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261087104 00000100:00100000:1.0:1746065124.479313:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261087104 00002000:00100000:1.0:1746065124.479345:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (90112->94207) req@ffff8801355f7480 x1830881261087104/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.479352:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f7480 with x1830881261087104 ext(90112->94207) 00002000:00010000:1.0:1746065124.479357:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355f7480 00000100:00100000:1.0:1746065124.479370:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4981 00000100:00100000:1.0:1746065124.479374:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261087104:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065124.479489:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.479516:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261087104:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 140us (1385us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065124.479522:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4981 00000100:00100000:3.0:1746065124.479527:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261087360 00002000:00100000:1.0:1746065124.479527:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (90112->94207) req@ffff8801355f7480 x1830881261087104/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065124.479531:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261087360 00002000:00100000:1.0:1746065124.479539:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f7480 with x1830881261087104 ext(90112->94207) 00002000:00010000:1.0:1746065124.479542:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355f7480 00002000:00100000:3.0:1746065124.479548:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8801355f7800 x1830881261087360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.479554:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f7800 with x1830881261087360 ext(2097152->3145727) 00002000:00010000:3.0:1746065124.479558:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355f7800 00000100:00100000:3.0:1746065124.479569:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4982 00000100:00100000:3.0:1746065124.479574:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881261087360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.480128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.480198:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261087616 00000100:00100000:2.0:1746065124.480202:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261087616 00000100:00100000:2.0:1746065124.480226:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9059 00000100:00100000:2.0:1746065124.480232:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29038:x1830881261087616:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:2.0:1746065124.480264:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.480285:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8e7200/0x14b4f8542d4f3679 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b327 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.480302:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065124.480306:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.480349:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29038:x1830881261087616:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 117us (222us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746065124.480356:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9059 00000100:00100000:2.0:1746065124.486795:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+6:1961:x1830881261086848:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 9056us (9177us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.486806:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4980 00002000:00100000:2.0:1746065124.486838:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8801355f7100 x1830881261086848/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.486848:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f7100 with x1830881261086848 ext(2097152->3145727) 00002000:00010000:2.0:1746065124.486852:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355f7100 00000100:00100000:0.0:1746065124.488936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.488997:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261087872 00000100:00100000:3.0:1746065124.489004:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261087872 00000100:00100000:3.0:1746065124.489034:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3703 00000100:00100000:3.0:1746065124.489040:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29038:x1830881261087872:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1746065124.489184:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29038:x1830881261087872:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 143us (252us total) trans 8589943114 rc 0/0 00000100:00100000:3.0:1746065124.489190:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3703 00000100:00100000:2.0:1746065124.489415:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881261087360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9838us (9925us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.489426:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4982 00002000:00100000:2.0:1746065124.489433:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8801355f7800 x1830881261087360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.489441:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f7800 with x1830881261087360 ext(2097152->3145727) 00002000:00010000:2.0:1746065124.489445:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355f7800 00000100:00100000:0.0:1746065124.490803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.490875:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261088128 00000100:00100000:2.0:1746065124.490881:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261088128 00002000:00100000:2.0:1746065124.490911:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37d:0x0] (405504->409599) req@ffff8801355f4a80 x1830881261088128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.490923:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f4a80 with x1830881261088128 ext(405504->409599) 00002000:00010000:2.0:1746065124.490926:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355f4a80 00000100:00100000:2.0:1746065124.490950:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4983 00000100:00100000:2.0:1746065124.490956:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:1958:x1830881261088128:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065124.491103:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:1958:x1830881261088128:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 146us (302us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065124.491109:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4983 00002000:00100000:2.0:1746065124.491114:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37d:0x0] (405504->409599) req@ffff8801355f4a80 x1830881261088128/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.491120:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f4a80 with x1830881261088128 ext(405504->409599) 00002000:00010000:2.0:1746065124.491123:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355f4a80 00000100:00100000:0.0:1746065124.492544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.492597:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261088384 00000100:00100000:2.0:1746065124.492602:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261088384 00000100:00100000:2.0:1746065124.492626:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3704 00000100:00100000:2.0:1746065124.492632:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29038:x1830881261088384:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1746065124.492866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.493571:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29038:x1830881261088384:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 936us (1028us total) trans 8589943115 rc 0/0 00000100:00100000:2.0:1746065124.493578:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3704 00000100:00100000:1.0:1746065124.493769:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261088512 00000100:00100000:1.0:1746065124.493773:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261088512 00000100:00100000:1.0:1746065124.493793:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10912 00000100:00100000:1.0:1746065124.493798:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:29032:x1830881261088512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.493807:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.493841:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b36d expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065124.493858:0:21235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6e5, atime: 0x6812d6e4, ctime: 0x6812d6e5, blocks: 0x16a9 00010000:00010000:1.0:1746065124.493870:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.493872:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.493877:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b36d expref: 23 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.493888:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b36d expref: 23 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.493897:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd82e00, rc 0) 00000100:00100000:1.0:1746065124.493917:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:29032:x1830881261088512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 118us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.493922:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10912 00000100:00100000:0.0:1746065124.496603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.496623:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261088640 00000100:00100000:0.0:1746065124.496629:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261088640 00000100:00100000:0.0:1746065124.496710:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10913 00000100:00100000:0.0:1746065124.496717:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+8:29035:x1830881261088640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.496732:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.496745:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b374 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.496760:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065124.496763:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.496764:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.496770:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b374 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.496781:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b374 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.496798:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00e6e00, rc 0) 00000100:00100000:0.0:1746065124.496843:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+9:29035:x1830881261088640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.496849:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10913 00000100:00100000:2.0:1746065124.496950:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261088896 00000100:00100000:2.0:1746065124.496955:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261088896 00000100:00100000:2.0:1746065124.496977:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3705 00000100:00100000:2.0:1746065124.496982:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:29040:x1830881261088896:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065124.497248:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:29040:x1830881261088896:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 265us (487us total) trans 8589943116 rc 0/0 00000100:00100000:2.0:1746065124.497253:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3705 00000100:00100000:0.0:1746065124.502486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.502527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.502591:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261089280 00000100:00100000:2.0:1746065124.502598:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261089280 00002000:00100000:2.0:1746065124.502632:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8801355f5c00 x1830881261089280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.502642:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f5c00 with x1830881261089280 ext(3145728->4194303) 00002000:00010000:2.0:1746065124.502646:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355f5c00 00000100:00100000:1.0:1746065124.504071:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261089408 00000100:00100000:1.0:1746065124.504077:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261089408 00002000:00100000:1.0:1746065124.504100:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8801355f4700 x1830881261089408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.504107:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f4700 with x1830881261089408 ext(3145728->4194303) 00002000:00010000:1.0:1746065124.504111:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355f4700 00000100:00100000:1.0:1746065124.504130:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4984 00000100:00100000:1.0:1746065124.504137:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881261089280:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065124.504186:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4985 00000100:00100000:3.0:1746065124.504194:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881261089408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.507718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.507742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.507761:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261089792 00000100:00100000:0.0:1746065124.507767:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261089792 00002000:00100000:0.0:1746065124.507797:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8801355f4380 x1830881261089792/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.507806:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f4380 with x1830881261089792 ext(3145728->4194303) 00002000:00010000:0.0:1746065124.507811:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355f4380 00000100:00100000:0.0:1746065124.507840:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261089920 00000100:00100000:0.0:1746065124.507843:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261089920 00002000:00100000:0.0:1746065124.507853:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8801355f4000 x1830881261089920/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.507860:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f4000 with x1830881261089920 ext(3145728->4194303) 00002000:00010000:0.0:1746065124.507862:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355f4000 00000100:00100000:0.0:1746065124.507886:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4986 00000100:00100000:0.0:1746065124.507892:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+6:1960:x1830881261089792:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065124.508620:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4987 00000100:00100000:2.0:1746065124.508628:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261089920:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065124.515793:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881261089408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11592us (13257us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.515803:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4985 00002000:00100000:3.0:1746065124.515830:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8801355f4700 x1830881261089408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.515839:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f4700 with x1830881261089408 ext(3145728->4194303) 00002000:00010000:3.0:1746065124.515844:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355f4700 00000100:00100000:1.0:1746065124.527211:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+6:1960:x1830881261089792:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 18911us (19090us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065124.527225:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4986 00002000:00100000:1.0:1746065124.527234:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8801355f4380 x1830881261089792/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.527243:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f4380 with x1830881261089792 ext(3145728->4194303) 00002000:00010000:1.0:1746065124.527247:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355f4380 00000100:00100000:2.0:1746065124.527312:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261089920:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 18683us (19567us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.527329:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4987 00002000:00100000:2.0:1746065124.527334:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8801355f4000 x1830881261089920/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.527341:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f4000 with x1830881261089920 ext(3145728->4194303) 00002000:00010000:2.0:1746065124.527344:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355f4000 00000100:00100000:2.0:1746065124.531044:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881261089280:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26899us (28555us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.531054:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4984 00002000:00100000:2.0:1746065124.531064:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8801355f5c00 x1830881261089280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.531073:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355f5c00 with x1830881261089280 ext(3145728->4194303) 00002000:00010000:2.0:1746065124.531078:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355f5c00 00000100:00100000:0.0:1746065124.532508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.532546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.532581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.532613:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090176 00000100:00100000:2.0:1746065124.532622:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090176 00000100:00100000:2.0:1746065124.532670:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090048 00000100:00100000:2.0:1746065124.532673:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090048 00000100:00100000:2.0:1746065124.532686:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090304 00000100:00100000:2.0:1746065124.532688:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090304 00000100:00100000:2.0:1746065124.532712:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10914 00000100:00100000:2.0:1746065124.532720:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+7:1960:x1830881261090176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065124.532736:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.532754:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b382 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065124.532775:0:21235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6e4, atime: 0x6812d6e3, ctime: 0x6812d6e4, blocks: 0x81d 00000100:00100000:3.0:1746065124.532789:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10915 00010000:00010000:2.0:1746065124.532789:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.532791:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065124.532796:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261090048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065124.532799:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b382 expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065124.532804:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.532811:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b382 expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065124.532831:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b37b expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.532837:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10916 00010000:00010000:2.0:1746065124.532839:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f717800, rc 0) 00002000:00010000:3.0:1746065124.532844:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6e4, atime: 0x6812d6e4, ctime: 0x6812d6e4, blocks: 0x821 00000100:00100000:1.0:1746065124.532844:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261090304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.532851:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065124.532853:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.532854:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.532858:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b37b expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.532861:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b389 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.532867:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b37b expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065124.532871:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261090176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 152us (369us total) trans 0 rc 0/0 00002000:00010000:1.0:1746065124.532873:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6e5, atime: 0x6812d6e4, ctime: 0x6812d6e5, blocks: 0x821 00010000:00010000:3.0:1746065124.532874:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8e7000, rc 0) 00000100:00100000:2.0:1746065124.532876:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10914 00010000:00010000:1.0:1746065124.532881:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.532882:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065124.532894:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261090048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 99us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.532899:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10915 00010000:00010000:1.0:1746065124.532979:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b389 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.532991:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b389 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.532997:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd83000, rc 0) 00000100:00100000:1.0:1746065124.533015:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261090304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 173us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.533020:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10916 00000100:00100000:0.0:1746065124.534665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.534695:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.534848:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.534862:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090560 00000100:00100000:0.0:1746065124.534868:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090560 00000100:00100000:0.0:1746065124.534904:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090816 00000100:00100000:0.0:1746065124.534907:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090816 00000100:00100000:0.0:1746065124.535046:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090432 00000100:00100000:0.0:1746065124.535049:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090432 00000100:00100000:1.0:1746065124.535084:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10917 00000100:00100000:2.0:1746065124.535092:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10918 00000100:00100000:1.0:1746065124.535093:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881261090560:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065124.535099:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881261090816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.535104:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.535106:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.535115:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3a5 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.535115:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b397 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.535128:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.535128:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.535129:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.535130:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.535134:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b397 expref: 16 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.535146:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b397 expref: 16 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065124.535150:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10919 00010000:00010000:1.0:1746065124.535153:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd83400, rc 0) 00000100:00100000:0.0:1746065124.535155:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881261090432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.535160:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.535167:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f3744 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b390 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.535183:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881261090560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 92us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.535188:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10917 00000100:00100000:0.0:1746065124.535195:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259752576:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065124.535229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.535250:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00010000:00010000:2.0:1746065124.535282:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3a5 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.535296:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3a5 expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.535302:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f717e00, rc 0) 00000100:00100000:1.0:1746065124.535302:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090688 00000100:00100000:1.0:1746065124.535305:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090688 00000100:00100000:1.0:1746065124.535331:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10920 00000100:00100000:2.0:1746065124.535333:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881261090816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 235us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.535336:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881261090688:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065124.535339:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10918 00010000:00010000:1.0:1746065124.535342:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.535347:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b39e expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.535357:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.535359:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.535362:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b39e expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.535369:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b39e expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.535375:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd82800, rc 0) 00000100:00100000:1.0:1746065124.535391:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881261090688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.535395:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10920 00000100:00100000:0.0:1746065124.539348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065124.539638:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime: 1746065123 -> 1746065125 00002000:00010000:1.0:1746065124.539646:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime: 1746065123 -> 1746065125 00002000:00010000:1.0:1746065124.539648:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime: 1746065123 -> 1746065125 00000100:00100000:1.0:1746065124.539665:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259752576:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065124.539691:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f3744 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b390 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.539703:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7800/0x14b4f8542d4f3744 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b390 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.539715:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00e7800, rc 0) 00000100:00100000:1.0:1746065124.539763:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881261090432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4606us (4914us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065124.539770:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10919 00000100:00100000:2.0:1746065124.540040:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261091072 00000100:00100000:2.0:1746065124.540047:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261091072 00002000:00100000:2.0:1746065124.540079:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f469880 x1830881261091072/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.540088:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469880 with x1830881261091072 ext(4194304->5029887) 00002000:00010000:2.0:1746065124.540092:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469880 00000100:00100000:2.0:1746065124.540109:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4988 00000100:00100000:2.0:1746065124.540115:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261091072:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.544256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.544329:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261091328 00000100:00100000:1.0:1746065124.544337:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261091328 00002000:00100000:1.0:1746065124.544372:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f469c00 x1830881261091328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.544381:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469c00 with x1830881261091328 ext(4194304->5029887) 00002000:00010000:1.0:1746065124.544385:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469c00 00000100:00100000:1.0:1746065124.544408:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4989 00000100:00100000:1.0:1746065124.544415:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881261091328:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.551076:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261091072:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10951us (11727us total) trans 0 rc 835584/835584 00000100:00100000:2.0:1746065124.551087:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4988 00002000:00100000:2.0:1746065124.551097:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f469880 x1830881261091072/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.551106:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469880 with x1830881261091072 ext(4194304->5029887) 00002000:00010000:2.0:1746065124.551111:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469880 00000100:00100000:0.0:1746065124.553031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.553090:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261091584 00000100:00100000:1.0:1746065124.553097:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261091584 00000100:00100000:1.0:1746065124.556594:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9060 00000100:00100000:1.0:1746065124.556610:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29044:x1830881261091584:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065124.556633:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.556649:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7a00/0x14b4f8542d4f3752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3ac expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.556739:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556749:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556758:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556770:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556775:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556779:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556890:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556897:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556903:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065124.556910:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065124.556973:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556978:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556983:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556987:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fd6400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065124.556990:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.556995:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557003:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065124.557006:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065124.557009:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557014:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6400/0x14b4f8542d4f3759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557046:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557050:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557054:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557057:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fd7400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065124.557059:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557063:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557068:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093f18e00) 00010000:00010000:1.0:1746065124.557070:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065124.557072:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557075:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7400/0x14b4f8542d4f3760 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.557109:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7a00/0x14b4f8542d4f3752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ac expref: 258 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.557118:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ac expref: 257 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.557124:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065124.557126:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065124.557128:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd6c00, rc 0) 00000100:00100000:1.0:1746065124.557178:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:29044:x1830881261091584:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 574us (4153us total) trans 8589943117 rc 0/0 00000100:00100000:1.0:1746065124.557183:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9060 00000100:00100000:3.0:1746065124.557454:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881261091328:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13038us (13203us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065124.557463:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4989 00002000:00100000:3.0:1746065124.557471:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f469c00 x1830881261091328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.557480:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469c00 with x1830881261091328 ext(4194304->5029887) 00002000:00010000:3.0:1746065124.557484:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469c00 00000100:00100000:0.0:1746065124.563712:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.564352:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261091712 00000100:00100000:1.0:1746065124.564360:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261091712 00000100:00100000:1.0:1746065124.564400:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10921 00000100:00100000:1.0:1746065124.564406:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881261091712:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.564420:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.564434:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fd7a00/0x14b4f8542d4f3775 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3b3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.564476:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259752704:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065124.565233:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.570807:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259752704:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065124.570864:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fd7a00/0x14b4f8542d4f3775 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3b3 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.570878:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fd7a00/0x14b4f8542d4f3775 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3b3 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.570904:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd7a00, rc 0) 00000100:00100000:1.0:1746065124.570946:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881261091712:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6539us (7240us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065124.570954:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10921 00000100:00100000:0.0:1746065124.572847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.572909:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261091840 00000100:00100000:1.0:1746065124.572916:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261091840 00000100:00100000:1.0:1746065124.572953:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10922 00000100:00100000:1.0:1746065124.572960:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881261091840:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.572973:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.572986:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4f377c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3ba expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.573023:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259752832:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065124.573083:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.576299:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259752832:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065124.576335:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4f377c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ba expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.576347:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4f377c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ba expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.576377:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd7400, rc 0) 00000100:00100000:1.0:1746065124.576420:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881261091840:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3460us (3606us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065124.576427:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10922 00000100:00100000:0.0:1746065124.588179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.588262:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261091968 00000100:00100000:1.0:1746065124.588269:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261091968 00000100:00100000:1.0:1746065124.588309:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10923 00000100:00100000:1.0:1746065124.588316:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:29044:x1830881261091968:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065124.588339:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.588352:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3c1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.588376:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.588383:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.588389:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.588390:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.588393:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.588414:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.588423:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 18 pid: 8428 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.588433:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259752960:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.588756:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.588764:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 7 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.588772:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259753088:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.589211:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.592152:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259752960:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.592898:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259753088:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.592923:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.592937:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927dba00, rc 0) 00000100:00100000:1.0:1746065124.592981:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:29044:x1830881261091968:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4665us (4810us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.592988:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10923 00000100:00100000:0.0:1746065124.595339:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.595481:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261092096 00000100:00100000:2.0:1746065124.595488:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261092096 00010000:00010000:2.0:1746065124.595514:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 18 pid: 8428 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.595546:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5438 00000100:00100000:2.0:1746065124.595551:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881261092096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.595561:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.595578:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 18 pid: 8428 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.595586:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 18 pid: 8428 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.595604:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fe00/0x14b4f8542d4f3705 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b35f expref: 18 pid: 8428 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.595628:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.595663:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881261092096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.595668:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5438 00000100:00100000:0.0:1746065124.599389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.599516:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261092224 00000100:00100000:2.0:1746065124.599523:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261092224 00010000:00010000:2.0:1746065124.599553:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 8 pid: 8427 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.599573:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5439 00000100:00100000:2.0:1746065124.599579:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:1959:x1830881261092224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.599590:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.599606:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 8 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.599616:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 8 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.599634:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cc1e00/0x14b4f8542d4f36db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b351 expref: 8 pid: 8427 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.599647:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.599649:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.599654:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.599661:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.599688:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065124.599699:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259753216:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065124.599769:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.602526:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259753216:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065124.602543:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.602586:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+7:1959:x1830881261092224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3005us (5770us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.602595:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5439 00000100:00100000:0.0:1746065124.604953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.605033:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261092480 00000100:00100000:3.0:1746065124.605041:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261092480 00002000:00100000:3.0:1746065124.605075:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (4075520->4079615) req@ffff88009f46b480 x1830881261092480/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.605089:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b480 with x1830881261092480 ext(4075520->4079615) 00002000:00010000:3.0:1746065124.605093:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46b480 00000100:00100000:3.0:1746065124.605119:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4990 00000100:00100000:3.0:1746065124.605124:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881261092480:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065124.605258:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881261092480:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 132us (310us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065124.605264:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4990 00002000:00100000:3.0:1746065124.605269:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (4075520->4079615) req@ffff88009f46b480 x1830881261092480/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.605274:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b480 with x1830881261092480 ext(4075520->4079615) 00002000:00010000:3.0:1746065124.605277:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46b480 00000100:00100000:0.0:1746065124.608989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.609077:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261092608 00000100:00100000:1.0:1746065124.609084:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261092608 00000100:00100000:1.0:1746065124.609129:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10924 00000100:00100000:1.0:1746065124.609137:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:29044:x1830881261092608:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065124.609151:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.609166:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3c8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.609190:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b36d expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.609198:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b374 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.609203:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.609204:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.609208:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4505599] (req 4194304->4505599) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.609229:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b374 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.609239:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b374 expref: 9 pid: 4545 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.609248:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259753344:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.610303:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b36d expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.610312:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b36d expref: 25 pid: 21235 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746065124.610329:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259753472:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.610373:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.611675:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259753344:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.613376:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259753472:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.613406:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4505599] (req 4194304->4505599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.613421:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da000, rc 0) 00000100:00100000:1.0:1746065124.613456:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:29044:x1830881261092608:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4319us (4474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.613464:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10924 00000100:00100000:0.0:1746065124.616797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.616923:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261092736 00000100:00100000:2.0:1746065124.616930:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261092736 00010000:00010000:2.0:1746065124.616960:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b374 expref: 10 pid: 4545 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746065124.616986:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5440 00000100:00100000:2.0:1746065124.616992:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261092736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.617003:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.617020:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b374 expref: 10 pid: 4545 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.617035:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b374 expref: 10 pid: 4545 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.617054:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e6e00/0x14b4f8542d4f371a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b374 expref: 10 pid: 4545 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746065124.617077:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.617109:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261092736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 116us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.617115:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5440 00000100:00100000:1.0:1746065124.618018:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.618479:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261092864 00000100:00100000:0.0:1746065124.618483:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261092864 00010000:00010000:0.0:1746065124.618501:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b36d expref: 25 pid: 21235 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746065124.618530:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5441 00000100:00100000:0.0:1746065124.618537:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881261092864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065124.618544:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065124.618556:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b36d expref: 25 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.618565:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b36d expref: 25 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.618579:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd82e00/0x14b4f8542d4f3713 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b36d expref: 25 pid: 21235 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746065124.618602:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.618604:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.618610:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.618618:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.618644:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.618655:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259753600:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065124.618726:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.620886:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259753600:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065124.620902:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.621305:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881261092864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2767us (3286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.621314:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5441 00000100:00100000:0.0:1746065124.622424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.622510:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261093120 00000100:00100000:3.0:1746065124.622517:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261093120 00002000:00100000:3.0:1746065124.622552:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4501504->4505599) req@ffff88009f469500 x1830881261093120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.622560:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469500 with x1830881261093120 ext(4501504->4505599) 00002000:00010000:3.0:1746065124.622565:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469500 00000100:00100000:3.0:1746065124.622593:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4991 00000100:00100000:3.0:1746065124.622599:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881261093120:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065124.622743:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881261093120:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 144us (321us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065124.622749:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4991 00002000:00100000:3.0:1746065124.622754:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4501504->4505599) req@ffff88009f469500 x1830881261093120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.622760:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469500 with x1830881261093120 ext(4501504->4505599) 00002000:00010000:3.0:1746065124.622763:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469500 00000100:00100000:0.0:1746065124.624371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.624634:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261093376 00000100:00100000:2.0:1746065124.624641:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261093376 00000100:00100000:2.0:1746065124.624689:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3706 00000100:00100000:2.0:1746065124.624696:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:29044:x1830881261093376:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065124.625124:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:29044:x1830881261093376:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 427us (757us total) trans 8589943118 rc 0/0 00000100:00100000:2.0:1746065124.625129:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3706 00000100:00100000:0.0:1746065124.706700:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.706869:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261093504 00000100:00100000:1.0:1746065124.706878:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261093504 00000100:00100000:1.0:1746065124.706930:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10925 00000100:00100000:1.0:1746065124.706937:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881261093504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.706952:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.706965:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927da600/0x14b4f8542d4f3791 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3cf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.707008:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259753728:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065124.707966:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.712809:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259753728:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065124.712866:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927da600/0x14b4f8542d4f3791 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3cf expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.712878:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927da600/0x14b4f8542d4f3791 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3cf expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.712902:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da600, rc 0) 00000100:00100000:1.0:1746065124.712944:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881261093504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6006us (6255us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065124.712950:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10925 00000100:00100000:0.0:1746065124.721580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.722994:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261093632 00000100:00100000:1.0:1746065124.723006:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261093632 00000100:00100000:1.0:1746065124.723063:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10926 00000100:00100000:1.0:1746065124.723071:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:29050:x1830881261093632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.723091:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.723109:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3d6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.723138:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.723145:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065124.723147:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065124.723150:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.723180:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.723190:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 8 pid: 4545 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.723202:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259753856:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.723296:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.732154:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259753856:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.732190:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.732208:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927db200, rc 0) 00000100:00100000:1.0:1746065124.732406:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:29050:x1830881261093632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9333us (10836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.732415:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10926 00000100:00100000:0.0:1746065124.741564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.741869:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261093760 00000100:00100000:3.0:1746065124.741879:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261093760 00002000:00100000:3.0:1746065124.741928:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (90112->409599) req@ffff88012f358a80 x1830881261093760/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.741943:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f358a80 with x1830881261093760 ext(90112->409599) 00010000:00010000:3.0:1746065124.741954:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 9 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065124.742167:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 9 pid: 4545 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746065124.742176:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f358a80 00000100:00100000:3.0:1746065124.742841:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1531 00000100:00100000:3.0:1746065124.742850:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261093760:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065124.755219:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261093760:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10042us (11340us total) trans 17179872852 rc 0/0 00000100:00100000:3.0:1746065124.755240:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1531 00002000:00100000:3.0:1746065124.755257:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (90112->409599) req@ffff88012f358a80 x1830881261093760/t17179872852(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.755267:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f358a80 with x1830881261093760 ext(90112->409599) 00010000:00010000:3.0:1746065124.755279:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 11 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065124.755295:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 11 pid: 4545 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746065124.755301:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f358a80 00000100:00100000:0.0:1746065124.756012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.757498:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261094016 00000100:00100000:1.0:1746065124.757510:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261094016 00000100:00100000:1.0:1746065124.757569:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9061 00000100:00100000:1.0:1746065124.757578:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:29053:x1830881261094016:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065124.757603:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.757622:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f379f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3dd expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.757737:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.757750:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.757763:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.757777:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.757783:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.757787:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.758465:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.758475:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.758482:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065124.758491:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065124.758578:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.758584:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.758590:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.758596:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927da600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065124.758600:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.758605:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.758616:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065124.758618:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065124.758622:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.758627:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4f37a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065124.760278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065124.761206:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.761218:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.761228:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.761234:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927da400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065124.761238:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.761244:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.761259:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5039800) 00010000:00010000:1.0:1746065124.761262:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065124.761265:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.761270:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f37ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.761363:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f379f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3dd expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.761376:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3dd expref: 15 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.761382:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065124.761384:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065124.761386:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756400, rc 0) 00000100:00100000:1.0:1746065124.761450:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:29053:x1830881261094016:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3872us (5439us total) trans 8589943119 rc 0/0 00000100:00100000:1.0:1746065124.761459:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9061 00000100:00100000:3.0:1746065124.761808:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261094144 00000100:00100000:3.0:1746065124.761833:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261094144 00010000:00010000:3.0:1746065124.761866:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 11 pid: 4545 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065124.761897:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5442 00000100:00100000:3.0:1746065124.761903:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261094144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065124.761916:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065124.761936:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 11 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065124.761945:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 11 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065124.761963:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00e7600/0x14b4f8542d4f370c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->409599) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b366 expref: 11 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065124.761983:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.761985:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.761992:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.762004:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.762033:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065124.762045:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259753984:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065124.762109:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065124.767875:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259753984:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065124.767904:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065124.767972:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881261094144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6067us (7698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.767983:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5442 00000100:00100000:0.0:1746065124.778262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.778375:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261094400 00000100:00100000:3.0:1746065124.778387:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261094400 00002000:00100000:3.0:1746065124.778442:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012f359500 x1830881261094400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.778453:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f359500 with x1830881261094400 ext(0->1048575) 00002000:00010000:3.0:1746065124.778459:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f359500 00000100:00100000:3.0:1746065124.778495:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4992 00000100:00100000:3.0:1746065124.778503:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261094400:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065124.780586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.780617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.780650:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.780694:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261094656 00000100:00100000:1.0:1746065124.780702:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261094656 00002000:00100000:1.0:1746065124.780735:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009ba1e300 x1830881261094656/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.780745:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e300 with x1830881261094656 ext(1048576->2097151) 00002000:00010000:1.0:1746065124.780750:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1e300 00000100:00100000:1.0:1746065124.780771:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261094912 00000100:00100000:1.0:1746065124.780774:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261094912 00002000:00100000:1.0:1746065124.780785:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009ba1c380 x1830881261094912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.780791:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c380 with x1830881261094912 ext(1048576->2097151) 00002000:00010000:1.0:1746065124.780794:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1c380 00000100:00100000:1.0:1746065124.780808:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261095168 00000100:00100000:1.0:1746065124.780810:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261095168 00002000:00100000:1.0:1746065124.780839:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009ba1fb80 x1830881261095168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.780846:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1fb80 with x1830881261095168 ext(1048576->2097151) 00002000:00010000:1.0:1746065124.780849:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1fb80 00000100:00100000:1.0:1746065124.780859:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4993 00000100:00100000:1.0:1746065124.780865:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881261094656:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.784423:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4994 00000100:00100000:2.0:1746065124.784442:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881261094912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.786885:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4995 00000100:00100000:2.0:1746065124.786899:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261095168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.795053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.795082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.795113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.795146:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261095296 00000100:00100000:0.0:1746065124.795155:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261095296 00000100:00100000:0.0:1746065124.795203:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261095424 00000100:00100000:0.0:1746065124.795205:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261095424 00000100:00100000:0.0:1746065124.795214:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261095552 00000100:00100000:0.0:1746065124.795215:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261095552 00000100:00100000:0.0:1746065124.795236:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10927 00000100:00100000:0.0:1746065124.795244:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261095296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.795264:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.795282:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3e4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065124.795306:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.795308:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065124.795325:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3e4 expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.795341:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3e4 expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.795351:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935af800, rc 0) 00000100:00100000:0.0:1746065124.795389:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261095296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 145us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065124.795395:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10927 00000100:00100000:0.0:1746065124.795468:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10928 00000100:00100000:0.0:1746065124.795474:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261095424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.795479:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.795485:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935ae600/0x14b4f8542d4f37c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3eb expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.795590:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f35a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259754112:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065124.795680:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.795696:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10929 00000100:00100000:0.0:1746065124.795717:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261095552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065124.795752:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065124.795771:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935aec00/0x14b4f8542d4f37d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3f2 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065124.795896:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f35a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259754240:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065124.795949:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.819047:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f35a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259754240:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065124.819081:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935aec00/0x14b4f8542d4f37d0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f2 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.819096:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935aec00/0x14b4f8542d4f37d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f2 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.819111:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935aec00, rc 0) 00000100:00100000:0.0:1746065124.819166:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261095552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 23463us (24051us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065124.819174:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10929 00002000:00010000:1.0:1746065124.819948:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065124 -> 1746065125 00000100:00100000:1.0:1746065124.819964:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f35a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259754112:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065124.819982:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935ae600/0x14b4f8542d4f37c9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3eb expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.819992:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935ae600/0x14b4f8542d4f37c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3eb expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065124.821779:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935ae600, rc 0) 00000100:00100000:1.0:1746065124.822099:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261095424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 26617us (27007us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065124.822108:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10928 00000100:00100000:2.0:1746065124.827174:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881261094912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 42725us (46540us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.827188:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4994 00002000:00100000:2.0:1746065124.827203:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009ba1c380 x1830881261094912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.827213:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c380 with x1830881261094912 ext(1048576->2097151) 00002000:00010000:2.0:1746065124.827220:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1c380 00010000:00010000:3.0:1746065124.828862:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065124.832282:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261095168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 45376us (51618us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.832295:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4995 00002000:00100000:2.0:1746065124.832308:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009ba1fb80 x1830881261095168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.832331:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1fb80 with x1830881261095168 ext(1048576->2097151) 00002000:00010000:2.0:1746065124.832338:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1fb80 00000100:00100000:3.0:1746065124.833681:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261094400:12345-192.168.202.46@tcp:3:cat.0 Request processed in 55173us (55427us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.833694:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4992 00002000:00100000:3.0:1746065124.833702:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012f359500 x1830881261094400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.833711:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f359500 with x1830881261094400 ext(0->1048575) 00002000:00010000:3.0:1746065124.833716:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f359500 00000100:00100000:1.0:1746065124.839508:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881261094656:12345-192.168.202.46@tcp:3:cat.0 Request processed in 58626us (58913us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065124.839522:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4993 00002000:00100000:1.0:1746065124.839536:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009ba1e300 x1830881261094656/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.839546:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e300 with x1830881261094656 ext(1048576->2097151) 00002000:00010000:1.0:1746065124.839552:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1e300 00000100:00100000:0.0:1746065124.848540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.848652:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261096064 00000100:00100000:1.0:1746065124.848662:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261096064 00002000:00100000:1.0:1746065124.848716:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012f35a680 x1830881261096064/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.848726:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35a680 with x1830881261096064 ext(0->1048575) 00002000:00010000:1.0:1746065124.848732:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f35a680 00000100:00100000:1.0:1746065124.848772:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4996 00000100:00100000:1.0:1746065124.848781:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261096064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.850943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.852399:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.852430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.852460:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.852493:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261096320 00000100:00100000:0.0:1746065124.852502:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261096320 00002000:00100000:0.0:1746065124.852544:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012f35ad80 x1830881261096320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.852554:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35ad80 with x1830881261096320 ext(1048576->2097151) 00002000:00010000:0.0:1746065124.852559:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f35ad80 00000100:00100000:0.0:1746065124.852576:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261096576 00000100:00100000:0.0:1746065124.852578:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261096576 00002000:00100000:0.0:1746065124.852588:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012f35b100 x1830881261096576/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.852593:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35b100 with x1830881261096576 ext(1048576->2097151) 00002000:00010000:0.0:1746065124.852596:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f35b100 00000100:00100000:0.0:1746065124.852604:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261096832 00000100:00100000:0.0:1746065124.852606:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261096832 00002000:00100000:0.0:1746065124.852616:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012f35b480 x1830881261096832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.852623:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35b480 with x1830881261096832 ext(1048576->2097151) 00002000:00010000:0.0:1746065124.852625:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f35b480 00000100:00100000:0.0:1746065124.852636:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4997 00000100:00100000:0.0:1746065124.852643:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261096320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065124.853070:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261095936 00000100:00100000:1.0:1746065124.853075:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261095936 00000100:00100000:1.0:1746065124.853105:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9062 00000100:00100000:1.0:1746065124.853110:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:29058:x1830881261095936:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065124.853126:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.853143:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f37d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b3f9 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.853230:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.853243:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ac expref: 259 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.853249:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3dd expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.853255:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.853284:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3dd expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.853295:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3dd expref: 14 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.853306:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259754368:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.853405:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ac expref: 259 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.853413:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ac expref: 259 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.853419:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259754496:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.853437:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.853506:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4998 00000100:00100000:1.0:1746065124.853511:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261096576:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.853804:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4999 00000100:00100000:2.0:1746065124.853853:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881261096832:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065124.865002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.865048:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.865086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.865808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.865874:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261097088 00000100:00100000:0.0:1746065124.865885:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261097088 00002000:00100000:0.0:1746065124.865931:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012f35b800 x1830881261097088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.865941:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35b800 with x1830881261097088 ext(2097152->3145727) 00002000:00010000:0.0:1746065124.865946:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f35b800 00000100:00100000:0.0:1746065124.865978:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261097344 00000100:00100000:0.0:1746065124.865981:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261097344 00002000:00100000:0.0:1746065124.865995:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012f35bb80 x1830881261097344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.866002:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35bb80 with x1830881261097344 ext(2097152->3145727) 00002000:00010000:0.0:1746065124.866005:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f35bb80 00000100:00100000:0.0:1746065124.866015:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261097472 00000100:00100000:0.0:1746065124.866017:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261097472 00002000:00100000:0.0:1746065124.866028:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012f35a300 x1830881261097472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065124.866034:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35a300 with x1830881261097472 ext(3145728->4194303) 00002000:00010000:0.0:1746065124.866036:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f35a300 00000100:00100000:2.0:1746065124.866044:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261097856 00000100:00100000:0.0:1746065124.866049:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5000 00000100:00100000:0.0:1746065124.866056:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261097088:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.866058:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261097856 00002000:00100000:2.0:1746065124.866105:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4075519) req@ffff88009f46c000 x1830881261097856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.866115:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46c000 with x1830881261097856 ext(3145728->4075519) 00002000:00010000:2.0:1746065124.866122:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46c000 00000100:00100000:2.0:1746065124.866150:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5001 00000100:00100000:2.0:1746065124.866158:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881261097344:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065124.866365:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5002 00000100:00100000:3.0:1746065124.866375:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261097472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.867017:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5003 00000100:00100000:2.0:1746065124.867024:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881261097856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065124.869143:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881261096064:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20337us (20588us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065124.869165:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4996 00002000:00100000:1.0:1746065124.869189:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012f35a680 x1830881261096064/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.869201:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35a680 with x1830881261096064 ext(0->1048575) 00002000:00010000:1.0:1746065124.869208:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f35a680 00000100:00100000:1.0:1746065124.869313:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259754368:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.869486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.869534:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259754496:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.869567:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065124.869598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.870598:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261097984 00000100:00100000:2.0:1746065124.870609:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261097984 00010000:00010000:2.0:1746065124.870647:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3dd expref: 15 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065124.870673:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261098112 00000100:00100000:2.0:1746065124.870676:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261098112 00010000:00010000:2.0:1746065124.870686:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ac expref: 260 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065124.870700:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5443 00000100:00100000:2.0:1746065124.870707:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261097984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.870721:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.870727:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3dd expref: 15 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.870737:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3dd expref: 15 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.870757:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756400/0x14b4f8542d4f37b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3dd expref: 15 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.870776:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065124.870781:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065124.870788:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065124.870793:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065124.870838:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261097984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 131us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.870844:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5443 00000100:00100000:2.0:1746065124.870857:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5444 00000100:00100000:2.0:1746065124.870861:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1961:x1830881261098112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.870867:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.870871:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ac expref: 260 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.870878:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ac expref: 260 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.870888:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd6c00/0x14b4f8542d4f3767 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3ac expref: 260 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.870895:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065124.870898:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065124.870907:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065124.870913:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065124.870928:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261096320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18282us (18529us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746065124.870931:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.870939:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4997 00002000:00100000:1.0:1746065124.870947:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012f35ad80 x1830881261096320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.870955:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35ad80 with x1830881261096320 ext(1048576->2097151) 00002000:00010000:1.0:1746065124.870960:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f35ad80 00010000:00010000:1.0:1746065124.871024:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065124.871031:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065124.871045:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1961:x1830881261098112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 181us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.871050:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5444 00000004:00200000:1.0:1746065124.871053:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065124.872331:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4f37d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f9 expref: 260 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.872369:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f9 expref: 259 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.872377:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065124.872379:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065124.872382:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da800, rc 0) 00000100:00100000:1.0:1746065124.872409:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:29058:x1830881261095936:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 19298us (21473us total) trans 8589943120 rc 0/0 00000100:00100000:1.0:1746065124.872416:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9062 00000100:00100000:1.0:1746065124.874411:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+7:1960:x1830881261096576:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20892us (21972us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065124.874423:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4998 00002000:00100000:1.0:1746065124.874436:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012f35b100 x1830881261096576/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065124.874446:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35b100 with x1830881261096576 ext(1048576->2097151) 00002000:00010000:1.0:1746065124.874452:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f35b100 00000100:00100000:2.0:1746065124.881034:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261096832:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27202us (28556us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.881050:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4999 00002000:00100000:2.0:1746065124.881066:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012f35b480 x1830881261096832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.881078:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35b480 with x1830881261096832 ext(1048576->2097151) 00002000:00010000:2.0:1746065124.881085:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f35b480 00000100:00100000:3.0:1746065124.886872:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261097472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20484us (21770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.886887:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5002 00002000:00100000:3.0:1746065124.886901:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012f35a300 x1830881261097472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.886910:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35a300 with x1830881261097472 ext(3145728->4194303) 00002000:00010000:3.0:1746065124.886917:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f35a300 00000100:00100000:2.0:1746065124.889494:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881261097856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22459us (23676us total) trans 0 rc 929792/929792 00000100:00100000:2.0:1746065124.889507:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5003 00002000:00100000:2.0:1746065124.889519:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4075519) req@ffff88009f46c000 x1830881261097856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 929792/929792 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.889528:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46c000 with x1830881261097856 ext(3145728->4075519) 00002000:00010000:2.0:1746065124.889533:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46c000 00000100:00100000:0.0:1746065124.901223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.901375:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261098240 00000100:00100000:1.0:1746065124.901382:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261098240 00000100:00100000:1.0:1746065124.901418:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10930 00000100:00100000:1.0:1746065124.901424:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261098240:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.901439:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.901451:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944b7000/0x14b4f8542d4f37ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b400 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.901490:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259754624:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065124.901556:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.902223:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881261097344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36065us (37174us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.902232:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5001 00002000:00100000:2.0:1746065124.902240:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012f35bb80 x1830881261097344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.902248:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35bb80 with x1830881261097344 ext(2097152->3145727) 00002000:00010000:2.0:1746065124.902251:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f35bb80 00000100:00100000:0.0:1746065124.903337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.903520:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261098368 00000100:00100000:1.0:1746065124.903525:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261098368 00000100:00100000:1.0:1746065124.903560:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10931 00000100:00100000:1.0:1746065124.903565:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261098368:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.903576:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.903587:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944b6200/0x14b4f8542d4f37f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b407 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.903617:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259754752:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065124.903658:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7df00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.906172:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881261097088:12345-192.168.202.46@tcp:3:cat.0 Request processed in 40110us (41177us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.906182:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5000 00002000:00100000:2.0:1746065124.906191:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012f35b800 x1830881261097088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.906201:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35b800 with x1830881261097088 ext(2097152->3145727) 00002000:00010000:2.0:1746065124.906206:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f35b800 00000100:00100000:2.0:1746065124.910865:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259754752:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065124.910891:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944b6200/0x14b4f8542d4f37f3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b407 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.910902:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944b6200/0x14b4f8542d4f37f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b407 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.910913:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944b6200, rc 0) 00000100:00100000:2.0:1746065124.910943:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261098368:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7378us (7608us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065124.910949:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10931 00000100:00100000:0.0:1746065124.911142:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259754624:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065124.911157:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944b7000/0x14b4f8542d4f37ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b400 expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.911170:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944b7000/0x14b4f8542d4f37ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b400 expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.911189:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944b7000, rc 0) 00000100:00100000:0.0:1746065124.911791:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261098240:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10365us (10573us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065124.911796:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10930 00000100:00100000:0.0:1746065124.912911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.913005:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261098496 00000100:00100000:2.0:1746065124.913011:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261098496 00000100:00100000:2.0:1746065124.913037:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10932 00000100:00100000:2.0:1746065124.913043:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:29058:x1830881261098496:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065124.913057:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.913068:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b40e expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.913090:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.913098:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3e4 expref: 10 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.913103:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.913104:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065124.913107:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [139264->471039] (req 139264->471039) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.913128:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3e4 expref: 10 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065124.913139:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3e4 expref: 10 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065124.913150:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259754880:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.913745:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.913755:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 26 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065124.913760:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259755008:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.913778:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.913985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.914035:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261098624 00000100:00100000:2.0:1746065124.914038:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261098624 00000100:00100000:2.0:1746065124.914061:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10933 00000100:00100000:2.0:1746065124.914066:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:29056:x1830881261098624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065124.914073:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.914080:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b415 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.914093:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.914099:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065124.914100:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065124.914103:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.914115:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.914121:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 26 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065124.914134:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259755136:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065124.914169:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.916548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.916611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.916625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.916692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.916750:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261098752 00000100:00100000:2.0:1746065124.916756:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261098752 00010000:00010000:2.0:1746065124.916781:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 27 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065124.916799:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261099008 00000100:00100000:2.0:1746065124.916800:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261099008 00010000:00010000:2.0:1746065124.916809:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3e4 expref: 13 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065124.916856:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5445 00000100:00100000:2.0:1746065124.916862:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261098752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.916871:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.916887:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 27 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.916887:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5446 00000100:00100000:1.0:1746065124.916895:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+13:1959:x1830881261099008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065124.916896:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 27 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.916905:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065124.916915:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065124.916918:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3e4 expref: 13 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065124.916927:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3e4 expref: 13 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065124.916939:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.916940:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065124.916942:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261098752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.916947:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5445 00010000:00010000:1.0:1746065124.916947:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.916954:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.916976:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.916985:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259755264:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065124.916998:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935af800/0x14b4f8542d4f37c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3e4 expref: 13 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065124.917010:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259754880:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.917018:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927db200/0x14b4f8542d4f3798 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3d6 expref: 26 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065124.917024:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259755008:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.917026:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7da80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065124.917038:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.917046:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8400, rc 0) 00000100:00100000:2.0:1746065124.917059:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:29058:x1830881261098496:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4017us (4151us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.917065:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10932 00000100:00100000:2.0:1746065124.917074:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261098880 00000100:00100000:2.0:1746065124.917076:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261098880 00000100:00100000:2.0:1746065124.917098:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10934 00000100:00100000:2.0:1746065124.917103:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261098880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065124.917112:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065124.917119:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f35de00/0x14b4f8542d4f3808 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b41c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065124.917138:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259755392:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065124.917154:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.917166:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261099136 00000100:00100000:2.0:1746065124.917169:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261099136 00002000:00100000:2.0:1746065124.917186:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4505599) req@ffff88009f46dc00 x1830881261099136/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.917194:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46dc00 with x1830881261099136 ext(4194304->4505599) 00010000:00010000:2.0:1746065124.917200:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 27 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.917209:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 27 pid: 8429 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746065124.917215:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f46dc00 00000100:00100000:2.0:1746065124.917230:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1532 00000100:00100000:2.0:1746065124.917234:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881261099136:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065124.917493:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259755136:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065124.917502:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065124.917510:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8800, rc 0) 00000100:00100000:2.0:1746065124.917520:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:29056:x1830881261098624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3454us (3536us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065124.917525:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10933 00000100:00100000:1.0:1746065124.922270:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259755264:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.922291:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.923065:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881261099008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6168us (6451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.923074:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5446 00000100:00100000:2.0:1746065124.923171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.923205:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261099392 00000100:00100000:3.0:1746065124.923211:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261099392 00002000:00100000:3.0:1746065124.923239:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37d:0x0] (139264->143359) req@ffff88012f541f80 x1830881261099392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.923249:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f541f80 with x1830881261099392 ext(139264->143359) 00002000:00010000:3.0:1746065124.923253:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f541f80 00000100:00100000:3.0:1746065124.923285:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5004 00000100:00100000:3.0:1746065124.923291:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261099392:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065124.923367:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259755392:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065124.923401:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f35de00/0x14b4f8542d4f3808 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b41c expref: 29 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.923415:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f35de00/0x14b4f8542d4f3808 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b41c expref: 29 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065124.923432:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35de00, rc 0) 00000100:00100000:3.0:1746065124.923436:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261099392:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 144us (265us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065124.923442:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5004 00002000:00100000:3.0:1746065124.923447:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37d:0x0] (139264->143359) req@ffff88012f541f80 x1830881261099392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.923453:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f541f80 with x1830881261099392 ext(139264->143359) 00002000:00010000:3.0:1746065124.923457:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f541f80 00000100:00100000:0.0:1746065124.923479:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261098880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6374us (6851us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065124.923486:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10934 00000100:00100000:2.0:1746065124.925346:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881261099136:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 8105us (8647us total) trans 17179872853 rc 0/0 00000100:00100000:2.0:1746065124.925356:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1532 00002000:00100000:2.0:1746065124.925366:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4505599) req@ffff88009f46dc00 x1830881261099136/t17179872853(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.925374:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46dc00 with x1830881261099136 ext(4194304->4505599) 00010000:00010000:2.0:1746065124.925383:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 27 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.925398:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 27 pid: 8429 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746065124.925405:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f46dc00 00000100:00100000:0.0:1746065124.926125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.926213:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261099520 00000100:00100000:1.0:1746065124.926221:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261099520 00000100:00100000:1.0:1746065124.926260:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10935 00000100:00100000:1.0:1746065124.926268:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:29050:x1830881261099520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065124.926283:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.926338:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b423 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.926365:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065124.926367:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065124.926371:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4505600->5029887] (req 4505600->5029887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.926383:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4505600->5029887] (req 4505600->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.926393:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da400, rc 0) 00000100:00100000:1.0:1746065124.926805:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:29050:x1830881261099520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 536us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.926811:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10935 00000100:00100000:0.0:1746065124.930771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.930938:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261099776 00000100:00100000:2.0:1746065124.930946:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261099776 00002000:00100000:2.0:1746065124.931040:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (466944->471039) req@ffff88009f46e300 x1830881261099776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.931049:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46e300 with x1830881261099776 ext(466944->471039) 00002000:00010000:2.0:1746065124.931058:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46e300 00000100:00100000:2.0:1746065124.931076:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5005 00000100:00100000:2.0:1746065124.931083:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261099776:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.931279:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261099776:12345-192.168.202.46@tcp:3:cat.0 Request processed in 196us (513us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065124.931285:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5005 00002000:00100000:2.0:1746065124.931290:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (466944->471039) req@ffff88009f46e300 x1830881261099776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.931296:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46e300 with x1830881261099776 ext(466944->471039) 00002000:00010000:2.0:1746065124.931299:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46e300 00000100:00100000:0.0:1746065124.934596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.934677:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261099904 00000100:00100000:1.0:1746065124.934688:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261099904 00010000:00010000:1.0:1746065124.935203:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 28 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.935244:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5447 00000100:00100000:1.0:1746065124.935254:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261099904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.935268:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.935293:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 28 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.935306:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 28 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.935342:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4f378a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4505599) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c8 expref: 28 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.935370:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.935372:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.935379:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.935387:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.935394:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.935395:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.935397:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.935403:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.935434:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.935445:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259755520:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.935553:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.935560:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259755648:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065124.935579:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065124.938763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.938875:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259755520:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065124.938885:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259755648:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.938904:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.938944:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881261099904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3691us (4353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.938953:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5447 00000100:00100000:2.0:1746065124.939149:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261100160 00000100:00100000:2.0:1746065124.939155:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261100160 00002000:00100000:2.0:1746065124.939184:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (4505600->5029887) req@ffff88009f46ea00 x1830881261100160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.939194:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46ea00 with x1830881261100160 ext(4505600->5029887) 00002000:00010000:2.0:1746065124.939198:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46ea00 00000100:00100000:2.0:1746065124.939220:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5006 00000100:00100000:2.0:1746065124.939227:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261100160:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065124.945983:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261100160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6742us (7212us total) trans 0 rc 524288/524288 00000100:00100000:2.0:1746065124.945996:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5006 00002000:00100000:2.0:1746065124.946010:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (4505600->5029887) req@ffff88009f46ea00 x1830881261100160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 524288/524288 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.946020:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46ea00 with x1830881261100160 ext(4505600->5029887) 00002000:00010000:2.0:1746065124.946027:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46ea00 00000100:00100000:0.0:1746065124.946919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.947013:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261100416 00000100:00100000:3.0:1746065124.947026:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261100416 00002000:00100000:3.0:1746065124.947074:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f46ed80 x1830881261100416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.947083:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46ed80 with x1830881261100416 ext(2097152->3145727) 00002000:00010000:3.0:1746065124.947091:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46ed80 00000100:00100000:3.0:1746065124.947137:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5007 00000100:00100000:3.0:1746065124.947144:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261100416:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065124.953006:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261100416:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5853us (6080us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.953016:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5007 00002000:00100000:3.0:1746065124.953027:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f46ed80 x1830881261100416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.953035:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46ed80 with x1830881261100416 ext(2097152->3145727) 00002000:00010000:3.0:1746065124.953039:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46ed80 00000100:00100000:0.0:1746065124.961946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.962029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.962108:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261100672 00000100:00100000:3.0:1746065124.962115:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261100672 00000100:00100000:3.0:1746065124.962141:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261100544 00000100:00100000:3.0:1746065124.962143:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261100544 00000100:00100000:1.0:1746065124.962146:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10936 00000100:00100000:1.0:1746065124.962154:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:29053:x1830881261100672:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:3.0:1746065124.962168:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10937 00010000:00010000:1.0:1746065124.962168:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065124.962173:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+7:29056:x1830881261100544:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065124.962179:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065124.962181:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b42a expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.962188:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b431 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.962201:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.962201:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.962207:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065124.962209:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065124.962209:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.962212:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.962214:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.962215:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.962218:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.962231:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.962240:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 16 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065124.962250:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259755776:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.962259:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.962267:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 26 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.962275:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259755904:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065124.962326:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065124.962670:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.962678:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 12 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.962686:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259756032:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.962703:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.964142:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259755904:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065124.964150:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259756032:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065124.964169:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.964179:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756400, rc 0) 00000100:00100000:1.0:1746065124.964202:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:29053:x1830881261100672:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2049us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.964209:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10936 00000100:00100000:0.0:1746065124.964866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.964902:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259755776:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065124.964906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065124.964917:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.964932:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094758200, rc 0) 00000100:00100000:3.0:1746065124.964959:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+8:29056:x1830881261100544:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2785us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065124.964964:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10937 00000100:00100000:1.0:1746065124.964968:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261100928 00000100:00100000:1.0:1746065124.964972:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261100928 00010000:00010000:1.0:1746065124.964990:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.965006:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5448 00000100:00100000:1.0:1746065124.965011:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261100928:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.965020:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065124.965081:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261100800 00000100:00100000:2.0:1746065124.965084:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261100800 00002000:00100000:2.0:1746065124.965104:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (4075520->4194303) req@ffff88009f46fb80 x1830881261100800/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.965112:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46fb80 with x1830881261100800 ext(4075520->4194303) 00010000:00010000:2.0:1746065124.965117:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 17 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.965125:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 17 pid: 8429 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746065124.965136:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f46fb80 00000100:00100000:2.0:1746065124.965155:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1533 00000100:00100000:2.0:1746065124.965159:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881261100800:12345-192.168.202.46@tcp:4:cat.0 00010000:00010000:1.0:1746065124.965401:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.965411:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.965428:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4f380f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4505600->5029887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b423 expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.965448:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.965471:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261100928:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 460us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.965477:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5448 00000100:00100000:0.0:1746065124.966287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.966621:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261101056 00000100:00100000:1.0:1746065124.966625:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261101056 00010000:00010000:1.0:1746065124.966641:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 12 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.966953:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5449 00000100:00100000:1.0:1746065124.966959:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881261101056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.966970:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.966983:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 12 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.966992:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 12 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.967006:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4f3801 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b415 expref: 12 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.967014:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.967016:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.967022:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.967029:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.967050:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.967059:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259756160:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065124.967745:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065124.968583:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881261100800:12345-192.168.202.46@tcp:4:cat.0 Request processed in 3420us (3674us total) trans 21474840080 rc 0/0 00000100:00100000:2.0:1746065124.968592:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1533 00002000:00100000:2.0:1746065124.968601:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (4075520->4194303) req@ffff88009f46fb80 x1830881261100800/t21474840080(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:40/0 lens 488/448 e 0 to 0 dl 1746065135 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.968610:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46fb80 with x1830881261100800 ext(4075520->4194303) 00010000:00010000:2.0:1746065124.968617:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 19 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065124.968629:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 19 pid: 8429 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746065124.968635:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f46fb80 00000100:00100000:0.0:1746065124.971264:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065124.971335:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261101312 00000100:00100000:2.0:1746065124.971341:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261101312 00002000:00100000:2.0:1746065124.971371:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (3911680->3915775) req@ffff8800a0084380 x1830881261101312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.971380:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084380 with x1830881261101312 ext(3911680->3915775) 00002000:00010000:2.0:1746065124.971384:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084380 00000100:00100000:2.0:1746065124.971408:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5008 00000100:00100000:2.0:1746065124.971415:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881261101312:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065124.971540:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881261101312:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 124us (282us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065124.971546:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5008 00002000:00100000:2.0:1746065124.971551:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (3911680->3915775) req@ffff8800a0084380 x1830881261101312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.971558:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084380 with x1830881261101312 ext(3911680->3915775) 00002000:00010000:2.0:1746065124.971560:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084380 00000100:00100000:1.0:1746065124.971625:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259756160:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.971640:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.971667:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261101056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4708us (5382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.971673:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5449 00000100:00100000:0.0:1746065124.972236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065124.972386:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261101440 00000100:00100000:1.0:1746065124.972389:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261101440 00010000:00010000:1.0:1746065124.972403:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 19 pid: 8429 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065124.972548:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5450 00000100:00100000:1.0:1746065124.972554:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881261101440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065124.972562:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065124.972575:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 19 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.972585:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 19 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.972603:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927dba00/0x14b4f8542d4f3783 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3c1 expref: 19 pid: 8429 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065124.972790:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.972792:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065124.972799:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 7 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.972810:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 7 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065124.972958:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 7 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065124.972968:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259756288:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065124.973296:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065124.975051:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259756288:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065124.975065:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065124.975100:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881261101440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2545us (2864us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065124.975108:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5450 00000100:00100000:0.0:1746065124.979205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.979236:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065124.979272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.979381:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261101696 00000100:00100000:3.0:1746065124.979391:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261101696 00002000:00100000:3.0:1746065124.979430:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a0084a80 x1830881261101696/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.979439:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084a80 with x1830881261101696 ext(2097152->3145727) 00002000:00010000:3.0:1746065124.979444:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0084a80 00000100:00100000:3.0:1746065124.979464:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5009 00000100:00100000:3.0:1746065124.979471:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261101696:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065124.979659:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261101952 00000100:00100000:2.0:1746065124.979663:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261101952 00002000:00100000:2.0:1746065124.979678:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800a0084e00 x1830881261101952/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.979685:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084e00 with x1830881261101952 ext(3145728->4194303) 00002000:00010000:2.0:1746065124.979688:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0084e00 00000100:00100000:2.0:1746065124.979698:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5010 00000100:00100000:2.0:1746065124.979706:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261102208 00000100:00100000:2.0:1746065124.979707:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261102208 00002000:00100000:2.0:1746065124.979717:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3911679) req@ffff8800a0085180 x1830881261102208/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/0 e 0 to 0 dl 1746065135 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.979723:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085180 with x1830881261102208 ext(3145728->3911679) 00002000:00010000:2.0:1746065124.979726:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0085180 00000100:00100000:2.0:1746065124.979746:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5011 00000100:00100000:2.0:1746065124.979750:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261102208:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065124.982181:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261101952:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065124.990921:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261102208:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11161us (11639us total) trans 0 rc 765952/765952 00000100:00100000:2.0:1746065124.990931:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5011 00002000:00100000:2.0:1746065124.990941:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3911679) req@ffff8800a0085180 x1830881261102208/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 765952/765952 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.990950:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085180 with x1830881261102208 ext(3145728->3911679) 00002000:00010000:2.0:1746065124.990955:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0085180 00000100:00100000:3.0:1746065124.995118:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261101696:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 15639us (15915us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065124.995128:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5009 00002000:00100000:3.0:1746065124.995138:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a0084a80 x1830881261101696/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065124.995147:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084a80 with x1830881261101696 ext(2097152->3145727) 00002000:00010000:3.0:1746065124.995155:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0084a80 00000100:00100000:2.0:1746065124.998122:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261101952:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 18409us (18875us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065124.998132:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5010 00002000:00100000:2.0:1746065124.998142:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800a0084e00 x1830881261101952/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:40/0 lens 488/440 e 0 to 0 dl 1746065135 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065124.998151:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084e00 with x1830881261101952 ext(3145728->4194303) 00002000:00010000:2.0:1746065124.998156:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0084e00 00000100:00100000:0.0:1746065124.999377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065124.999433:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261102336 00000100:00100000:3.0:1746065124.999441:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261102336 00000100:00100000:3.0:1746065124.999478:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10938 00000100:00100000:3.0:1746065124.999486:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+8:29053:x1830881261102336:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065124.999500:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065124.999512:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b438 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.999536:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.999543:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.999545:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065124.999548:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->3899391] (req 3145728->3899391) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.999572:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065124.999582:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 9 pid: 4545 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065124.999593:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259756416:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065124.999658:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065125.001478:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259756416:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.001501:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->3899391] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.001514:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094759a00, rc 0) 00000100:00100000:3.0:1746065125.001543:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+9:29053:x1830881261102336:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2058us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.001552:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10938 00000100:00100000:0.0:1746065125.004022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.004146:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261102464 00000100:00100000:3.0:1746065125.004153:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261102464 00000100:00100000:3.0:1746065125.004836:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10939 00000100:00100000:3.0:1746065125.004844:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261102464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.004859:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.004875:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094759600/0x14b4f8542d4f382b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b43f expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.004916:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259756544:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065125.004985:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60b40 going to sleep for 11 seconds 00000100:00080000:0.0:1746065125.005282:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065125.006914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.006981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.007035:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261102592 00000100:00100000:1.0:1746065125.007041:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261102592 00000100:00100000:1.0:1746065125.007086:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10940 00000100:00100000:1.0:1746065125.007093:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:1958:x1830881261102592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.007106:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.007119:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f3832 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b446 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.007136:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.007145:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f3832 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b446 expref: 10 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.007159:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f3832 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b446 expref: 10 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.007171:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da000, rc 0) 00000100:00100000:1.0:1746065125.007204:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:1958:x1830881261102592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 112us (296us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065125.007209:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10940 00000100:00100000:1.0:1746065125.007229:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261102720 00000100:00100000:1.0:1746065125.007231:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261102720 00010000:00010000:1.0:1746065125.007242:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 9 pid: 4545 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.007257:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5451 00000100:00100000:1.0:1746065125.007261:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261102720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065125.007267:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065125.007284:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 9 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.007293:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 9 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.007307:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094758200/0x14b4f8542d4f381d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b431 expref: 9 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.007326:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.007328:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.007333:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.007340:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.007365:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 8 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.007375:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259756672:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065125.007418:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065125.007837:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259756544:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065125.007856:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094759600/0x14b4f8542d4f382b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b43f expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.007866:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094759600/0x14b4f8542d4f382b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b43f expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.007876:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094759600, rc 0) 00000100:00100000:3.0:1746065125.007895:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261102464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3052us (3880us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065125.007900:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10939 00000100:00100000:0.0:1746065125.008129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065125.008207:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065125.008299:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261102848 00000100:00100000:1.0:1746065125.008302:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261102848 00000100:00080000:0.0:1746065125.008472:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065125.008563:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9063 00000100:00100000:1.0:1746065125.008570:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29061:x1830881261102848:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065125.008583:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.008594:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f3839 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b44d expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.008637:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.008645:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.008653:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.008662:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.008667:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.008672:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.009988:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.010002:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f9 expref: 258 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.010008:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.010029:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f9 expref: 258 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.010039:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f9 expref: 258 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.010048:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259756800:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.010116:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7df00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065125.013043:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259756672:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065125.013062:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.013496:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259756800:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.013511:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065125.013670:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261102720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6406us (6687us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.013680:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5451 00000100:00100000:0.0:1746065125.013797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.014132:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261103104 00000100:00100000:2.0:1746065125.014136:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261103104 00000100:00080000:0.0:1746065125.014326:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065125.014351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.014391:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3707 00000100:00100000:2.0:1746065125.014398:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:27246:x1830881261103104:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065125.015089:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:27246:x1830881261103104:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 690us (1290us total) trans 8589943121 rc 0/0 00000100:00100000:2.0:1746065125.015129:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3707 00000100:00100000:3.0:1746065125.015166:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261103360 00000100:00100000:3.0:1746065125.015169:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261103360 00002000:00100000:3.0:1746065125.015191:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff8800a0086680 x1830881261103360/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.015206:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086680 with x1830881261103360 ext(4194304->5029887) 00002000:00010000:3.0:1746065125.015210:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0086680 00000100:00100000:3.0:1746065125.015224:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5012 00000100:00100000:3.0:1746065125.015229:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261103360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.017396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.017449:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261103488 00000100:00100000:1.0:1746065125.017456:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261103488 00010000:00010000:1.0:1746065125.017480:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f9 expref: 260 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.017501:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5452 00000100:00100000:1.0:1746065125.017507:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1960:x1830881261103488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065125.017516:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065125.017521:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f9 expref: 260 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.017531:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f9 expref: 260 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.017548:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da800/0x14b4f8542d4f37de lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3f9 expref: 260 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.017574:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.017578:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.017586:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.017592:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.017610:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065125.017634:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1960:x1830881261103488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 128us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.017639:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5452 00010000:00010000:2.0:1746065125.017687:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017693:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065125.017726:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065125.017730:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065125.017742:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017750:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017757:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017763:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017768:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017773:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c757400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065125.017776:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017781:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017789:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065125.017791:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065125.017794:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017799:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757400/0x14b4f8542d4f3840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017808:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017835:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017841:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017844:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c756000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065125.017847:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017851:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017857:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a54e6600) 00010000:00010000:2.0:1746065125.017859:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065125.017861:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017866:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4f3847 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.017892:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4f3839 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b44d expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.017905:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b44d expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.017911:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.017913:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065125.017915:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935dda00, rc 0) 00000100:00100000:2.0:1746065125.017935:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:29061:x1830881261102848:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 9367us (9807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.017941:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9063 00000100:00100000:2.0:1746065125.023669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.023912:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261103744 00000100:00100000:3.0:1746065125.023920:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261103744 00002000:00100000:3.0:1746065125.023952:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (3895296->3899391) req@ffff88012f542a00 x1830881261103744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.023965:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f542a00 with x1830881261103744 ext(3895296->3899391) 00002000:00010000:3.0:1746065125.023970:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f542a00 00000100:00100000:3.0:1746065125.023997:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5013 00000100:00100000:3.0:1746065125.024004:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+8:1959:x1830881261103744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.024125:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+8:1959:x1830881261103744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 121us (463us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065125.024131:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5013 00002000:00100000:3.0:1746065125.024135:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (3895296->3899391) req@ffff88012f542a00 x1830881261103744/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.024141:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f542a00 with x1830881261103744 ext(3895296->3899391) 00002000:00010000:3.0:1746065125.024143:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f542a00 00000100:00100000:0.0:1746065125.024397:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261103360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9166us (10043us total) trans 0 rc 835584/835584 00000100:00100000:0.0:1746065125.024406:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5012 00002000:00100000:0.0:1746065125.024411:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff8800a0086680 x1830881261103360/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.024418:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086680 with x1830881261103360 ext(4194304->5029887) 00002000:00010000:0.0:1746065125.024421:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0086680 00000100:00100000:0.0:1746065125.027428:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.027457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.027482:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261103872 00000100:00100000:0.0:1746065125.027483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.027490:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261103872 00000100:00100000:0.0:1746065125.027506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065125.027519:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065125.027532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.027863:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261104000 00000100:00100000:1.0:1746065125.027864:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261104128 00000100:00100000:2.0:1746065125.027866:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261104000 00000100:00100000:1.0:1746065125.027868:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261104128 00000100:00100000:2.0:1746065125.027892:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261104384 00000100:00100000:1.0:1746065125.027892:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261104256 00000100:00100000:1.0:1746065125.027894:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261104256 00000100:00100000:2.0:1746065125.027895:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261104384 00000100:00100000:1.0:1746065125.027906:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10941 00000100:00100000:1.0:1746065125.027913:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261103872:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065125.027926:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.027940:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935dcc00/0x14b4f8542d4f3855 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b454 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.027982:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259756928:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065125.028041:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7df00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.028113:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10942 00000100:00100000:2.0:1746065125.028120:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261104000:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065125.028127:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.028137:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b45b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.028149:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.028151:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.028158:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b45b expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.028174:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b45b expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.028182:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35ca00, rc 0) 00000100:00100000:2.0:1746065125.028203:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261104000:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 85us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.028208:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10942 00000100:00100000:2.0:1746065125.028220:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10943 00000100:00100000:2.0:1746065125.028225:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261104128:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065125.028230:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.028235:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b462 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.028244:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.028245:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.028249:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b462 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.028256:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b462 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.028262:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35d800, rc 0) 00000100:00100000:2.0:1746065125.028274:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261104128:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 50us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.028279:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10943 00000100:00100000:2.0:1746065125.028289:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10944 00000100:00100000:2.0:1746065125.028293:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261104256:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:0.0:1746065125.028301:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10945 00000100:00100000:0.0:1746065125.028307:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261104384:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065125.028322:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065125.028329:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c76d200/0x14b4f8542d4f386a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b470 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.028349:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259757056:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065125.028368:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00010000:00010000:2.0:1746065125.028661:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.028669:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b469 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.028680:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.028682:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.028686:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b469 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.028695:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b469 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065125.028697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065125.028701:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35c800, rc 0) 00000100:00100000:2.0:1746065125.028718:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261104256:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 424us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.028719:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261104512 00000100:00100000:3.0:1746065125.028723:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261104512 00000100:00100000:2.0:1746065125.028723:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10944 00000100:00100000:0.0:1746065125.028724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.028738:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261104768 00000100:00100000:2.0:1746065125.028741:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261104768 00000100:00100000:3.0:1746065125.028743:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10946 00000100:00100000:3.0:1746065125.028748:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261104512:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065125.028754:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065125.028759:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3708 00010000:00010000:3.0:1746065125.028761:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094a29800/0x14b4f8542d4f3878 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b477 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.028761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.028764:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:29053:x1830881261104768:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065125.028773:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261104896 00000100:00100000:0.0:1746065125.028776:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261104896 00000100:00100000:3.0:1746065125.028784:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259757184:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065125.028792:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10947 00000100:00100000:0.0:1746065125.028797:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881261104896:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065125.028803:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065125.028806:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746065125.028808:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c76de00/0x14b4f8542d4f387f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b47e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.028848:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133298380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259757312:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065125.028872:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.028909:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:29053:x1830881261104768:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 144us (184us total) trans 8589943122 rc 0/0 00000100:00100000:2.0:1746065125.028914:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3708 00000100:00100000:2.0:1746065125.031241:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259757056:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065125.031241:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133298380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259757312:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065125.031263:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c76d200/0x14b4f8542d4f386a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b470 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065125.031263:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c76de00/0x14b4f8542d4f387f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b47e expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.031274:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c76d200/0x14b4f8542d4f386a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b470 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065125.031274:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c76de00/0x14b4f8542d4f387f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b47e expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.031283:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76d200, rc 0) 00010000:00010000:0.0:1746065125.031285:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76de00, rc 0) 00000100:00100000:0.0:1746065125.031311:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881261104896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2512us (2549us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065125.031324:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259756928:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065125.031330:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10947 00010000:00010000:1.0:1746065125.031342:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935dcc00/0x14b4f8542d4f3855 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b454 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.031349:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935dcc00/0x14b4f8542d4f3855 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b454 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.031359:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935dcc00, rc 0) 00000100:00100000:2.0:1746065125.031447:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261104384:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 3140us (3913us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065125.031453:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10945 00000100:00100000:1.0:1746065125.031504:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261103872:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 3591us (4082us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065125.031509:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10941 00000100:00100000:3.0:1746065125.031694:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259757184:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065125.031709:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094a29800/0x14b4f8542d4f3878 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b477 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.031718:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a29800/0x14b4f8542d4f3878 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b477 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.031736:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a29800, rc 0) 00000100:00100000:3.0:1746065125.031760:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261104512:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 3011us (3063us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065125.031765:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10946 00000100:00100000:0.0:1746065125.033152:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.034323:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261105024 00000100:00100000:3.0:1746065125.034331:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261105024 00000100:00100000:3.0:1746065125.034381:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10948 00000100:00100000:3.0:1746065125.034388:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261105024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.034404:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.034417:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c732200/0x14b4f8542d4f3886 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b485 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.034461:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259757440:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065125.034607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.035007:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.035373:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261105280 00000100:00100000:2.0:1746065125.035378:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261105280 00000100:00100000:2.0:1746065125.035414:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9064 00000100:00100000:2.0:1746065125.035420:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:29061:x1830881261105280:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065125.035429:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.035439:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35cc00/0x14b4f8542d4f388d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b48c expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.035507:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.035520:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b44d expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.035526:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.035547:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b44d expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.035555:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b44d expref: 12 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065125.035563:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259757568:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.035610:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065125.036062:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259757440:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065125.036081:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c732200/0x14b4f8542d4f3886 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b485 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.036090:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c732200/0x14b4f8542d4f3886 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b485 expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.036099:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c732200, rc 0) 00000100:00100000:3.0:1746065125.036131:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261105024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1743us (2983us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065125.036137:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10948 00000100:00100000:2.0:1746065125.037999:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259757568:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.038017:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065125.038282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.038337:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261105408 00000100:00100000:3.0:1746065125.038343:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261105408 00010000:00010000:3.0:1746065125.038367:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b44d expref: 13 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.038395:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5453 00000100:00100000:3.0:1746065125.038401:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1960:x1830881261105408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.038411:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.038417:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b44d expref: 13 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.038426:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b44d expref: 13 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.038442:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935dda00/0x14b4f8542d4f384e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b44d expref: 13 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.038454:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.038458:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065125.038465:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065125.038471:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065125.038846:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065125.040134:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.040147:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065125.040164:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000100:00100000:3.0:1746065125.040194:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261105408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1788us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.040203:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5453 00010000:00010000:2.0:1746065125.040296:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35cc00/0x14b4f8542d4f388d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b48c expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.040311:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b48c expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.040330:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.040333:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065125.040335:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35ce00, rc 0) 00000100:00100000:2.0:1746065125.040378:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29061:x1830881261105280:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 4958us (5771us total) trans 8589943123 rc 0/0 00000100:00100000:2.0:1746065125.040385:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9064 00000100:00100000:0.0:1746065125.045393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.045479:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261105664 00000100:00100000:2.0:1746065125.045488:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261105664 00000100:00100000:2.0:1746065125.045653:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9065 00000100:00100000:2.0:1746065125.045662:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29061:x1830881261105664:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065125.045682:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.045685:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065125.045707:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35ce00/0x14b4f8542d4f3894 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b48c expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.046092:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.046096:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065125.046108:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f38a2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b493 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.046188:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.046199:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.046207:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065125.046217:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065125.046307:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35d600/0x14b4f8542d4f38a2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b493 expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.046334:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b493 expref: 13 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.046339:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.046342:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065125.046344:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35c200, rc 0) 00000100:00100000:2.0:1746065125.047324:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:29061:x1830881261105664:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1651us (1926us total) trans 8589943124 rc 0/0 00000100:00100000:2.0:1746065125.047331:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9065 00000100:00100000:0.0:1746065125.050107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.050175:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261105792 00000100:00100000:2.0:1746065125.050183:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261105792 00000100:00100000:2.0:1746065125.050215:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9066 00000100:00100000:2.0:1746065125.050222:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:29061:x1830881261105792:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065125.050239:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.050253:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35dc00/0x14b4f8542d4f38b7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b49a expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.050296:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35dc00/0x14b4f8542d4f38b7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b49a expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.050312:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35dc00/0x14b4f8542d4f38b7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b49a expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.050334:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.050337:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065125.050340:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f35dc00, rc 0) 00000100:00100000:2.0:1746065125.050389:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:29061:x1830881261105792:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 167us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.050394:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9066 00000100:00100000:0.0:1746065125.053364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.053399:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.054235:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.054610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.054625:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261106048 00000100:00100000:3.0:1746065125.054633:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261106048 00000100:00100000:2.0:1746065125.054656:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261105920 00000100:00100000:2.0:1746065125.054659:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261105920 00000100:00100000:3.0:1746065125.054671:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261106176 00000100:00100000:3.0:1746065125.054673:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261106176 00000100:00100000:2.0:1746065125.054678:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10949 00000100:00100000:2.0:1746065125.054685:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261106048:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:3.0:1746065125.054692:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10950 00000100:00100000:3.0:1746065125.054696:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261105920:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065125.054719:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.054719:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.054734:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.054734:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b37b expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.054740:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065125.054741:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b45b expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.054742:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065125.054745:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.054747:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b397 expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.054752:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.054753:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.054754:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.054767:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.054767:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b397 expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.054778:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 25 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.054778:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b397 expref: 17 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.054789:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259757824:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.054789:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259757696:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.054876:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261106432 00000100:00100000:1.0:1746065125.054880:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261106432 00000100:00100000:1.0:1746065125.054897:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10951 00000100:00100000:1.0:1746065125.054902:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261106176:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065125.054916:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.054924:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b382 expref: 7 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.054931:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b462 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.054937:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b39e expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.054942:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.054943:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.054945:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.054957:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b39e expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.054964:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b39e expref: 17 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.054970:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259757952:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.055141:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b45b expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.055149:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b45b expref: 9 pid: 9716 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.055156:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259758080:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.055164:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746065125.055175:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b37b expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065125.055181:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10952 00010000:00010000:2.0:1746065125.055182:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b37b expref: 7 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.055186:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261106432:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:2.0:1746065125.055189:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259758208:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.055199:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.055201:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1600 going to sleep for 11 seconds 00010000:00010000:3.0:1746065125.055208:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 10 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.055213:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065125.055214:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065125.055216:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.055229:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 10 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.055236:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 10 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.055244:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259758336:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.055261:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d60840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.055350:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.055393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065125.055481:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b462 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.055498:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b462 expref: 9 pid: 9716 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.055506:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259758464:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.055525:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b382 expref: 7 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.055532:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b382 expref: 7 pid: 21235 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.055538:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259758592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.055550:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7df00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065125.055561:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261106304 00000100:00100000:1.0:1746065125.055563:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261106304 00000100:00100000:1.0:1746065125.055577:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261106560 00000100:00100000:1.0:1746065125.055579:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261106560 00000100:00100000:1.0:1746065125.055588:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10953 00000100:00100000:1.0:1746065125.055592:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261106304:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065125.055606:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.055615:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b389 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.055621:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b469 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.055635:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3a5 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.055640:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.055641:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.055643:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.055656:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3a5 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.055663:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3a5 expref: 25 pid: 8428 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.055670:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259758720:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.055692:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b469 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.055699:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b469 expref: 8 pid: 9716 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.055705:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259758848:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.055722:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b389 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.055733:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b389 expref: 10 pid: 8428 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.055740:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259758976:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.055750:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065125.055761:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10954 00000100:00100000:1.0:1746065125.055766:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261106560:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065125.055777:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.055786:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 7 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.055791:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065125.055792:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065125.055794:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.055805:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 7 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.055812:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 7 pid: 4545 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.055832:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259759104:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.055847:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b246fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065125.058604:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259758336:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065125.058621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065125.058629:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.058652:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261106688 00000100:00100000:3.0:1746065125.058657:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261106688 00000100:00100000:0.0:1746065125.058676:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065125.058679:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b45b expref: 11 pid: 9716 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746065125.058691:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261106944 00000100:00100000:0.0:1746065125.058694:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261106944 00000100:00100000:3.0:1746065125.058698:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5454 00000100:00100000:3.0:1746065125.058703:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881261106688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.058714:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746065125.058715:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3911680->4194303) req@ffff88013329a680 x1830881261106944/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.058723:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329a680 with x1830881261106944 ext(3911680->4194303) 00010000:00010000:0.0:1746065125.058728:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 11 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.058730:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b45b expref: 11 pid: 9716 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746065125.058736:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 11 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.058738:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b45b expref: 11 pid: 9716 timeout: 824 lvb_type: 1 00002000:00010000:0.0:1746065125.058742:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013329a680 00000100:00100000:0.0:1746065125.058753:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1534 00010000:00010000:3.0:1746065125.058756:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065125.058757:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881261106944:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065125.058783:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881261106688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.058787:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5454 00000100:00100000:3.0:1746065125.058835:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259757824:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.058843:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259759104:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.058846:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.058857:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.058874:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259757952:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.058880:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259758464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.058886:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259758592:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.058900:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.058910:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f35ca00/0x14b4f8542d4f385c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b45b expref: 10 pid: 9716 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.058912:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259758720:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.058919:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259758848:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.058926:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259758976:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.058930:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259758080:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.058937:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.058940:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259758208:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.058946:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259757696:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.058964:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.062879:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.063695:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.063901:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261107072 00000100:00100000:3.0:1746065125.063908:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261107072 00000100:00100000:0.0:1746065125.063914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.063930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065125.063933:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b397 expref: 18 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746065125.063948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.063958:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261107328 00000100:00100000:3.0:1746065125.063960:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261107328 00000100:00100000:0.0:1746065125.063962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065125.063969:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b462 expref: 10 pid: 9716 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746065125.063974:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.063979:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261107584 00000100:00100000:3.0:1746065125.063981:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261107584 00010000:00010000:3.0:1746065125.063990:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b469 expref: 9 pid: 9716 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746065125.063995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.063997:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261107200 00000100:00100000:3.0:1746065125.063999:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261107200 00010000:00010000:3.0:1746065125.064006:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b37b expref: 8 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746065125.064007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.064014:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261107456 00000100:00100000:3.0:1746065125.064015:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261107456 00010000:00010000:3.0:1746065125.064022:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b39e expref: 19 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746065125.064022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.064034:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261107712 00000100:00100000:3.0:1746065125.064035:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261107712 00010000:00010000:3.0:1746065125.064041:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b382 expref: 9 pid: 21235 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.064048:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261108096 00000100:00100000:3.0:1746065125.064049:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261108096 00010000:00010000:3.0:1746065125.064056:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b389 expref: 13 pid: 8428 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.064064:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261107968 00000100:00100000:3.0:1746065125.064065:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261107968 00010000:00010000:3.0:1746065125.064072:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3a5 expref: 26 pid: 8428 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.064082:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5455 00000100:00100000:1.0:1746065125.064086:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261107840 00000100:00100000:3.0:1746065125.064087:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881261107072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065125.064088:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261107840 00010000:00010000:3.0:1746065125.064097:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746065125.064109:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3899391) req@ffff88013329b480 x1830881261107840/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065125.064113:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b397 expref: 19 pid: 4545 timeout: 824 lvb_type: 1 00002000:00100000:1.0:1746065125.064117:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329b480 with x1830881261107840 ext(3145728->3899391) 00010000:00010000:3.0:1746065125.064122:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b397 expref: 19 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065125.064123:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 10 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.064130:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 10 pid: 4545 timeout: 824 lvb_type: 0 00002000:00010000:1.0:1746065125.064135:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013329b480 00010000:00010000:3.0:1746065125.064138:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd83400/0x14b4f8542d4f373d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b397 expref: 19 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.064154:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261106816 00000100:00100000:1.0:1746065125.064156:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261106816 00010000:00010000:3.0:1746065125.064157:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065125.064165:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (139264->471039) req@ffff88013329b800 x1830881261106816/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.064171:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329b800 with x1830881261106816 ext(139264->471039) 00010000:00010000:1.0:1746065125.064175:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.064180:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00002000:00010000:1.0:1746065125.064185:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013329b800 00000100:00100000:3.0:1746065125.064187:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881261107072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 100us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.064193:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5455 00000100:00100000:1.0:1746065125.064193:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1535 00000100:00100000:1.0:1746065125.064197:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261107840:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065125.064208:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5456 00000100:00100000:3.0:1746065125.064212:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261107328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.064216:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.064223:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b462 expref: 10 pid: 9716 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064229:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b462 expref: 10 pid: 9716 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064239:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f35d800/0x14b4f8542d4f3863 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b462 expref: 10 pid: 9716 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064247:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.064258:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261107328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.064262:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5456 00000100:00100000:3.0:1746065125.064276:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5457 00000100:00100000:3.0:1746065125.064280:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261107584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.064286:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.064294:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b469 expref: 9 pid: 9716 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064302:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b469 expref: 9 pid: 9716 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064312:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f35c800/0x14b4f8542d4f3871 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b469 expref: 9 pid: 9716 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064329:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.064341:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261107584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.064346:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5457 00000100:00100000:3.0:1746065125.064354:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5458 00000100:00100000:3.0:1746065125.064358:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261107200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.064363:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.064369:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b37b expref: 10 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064376:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b37b expref: 10 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064385:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8e7000/0x14b4f8542d4f3728 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b37b expref: 10 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064393:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.064394:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.064398:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.064406:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.064421:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.064431:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:1961:x1830881261107200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.064436:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5458 00000100:00100000:3.0:1746065125.064460:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5459 00000100:00100000:3.0:1746065125.064464:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881261107456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.064469:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.064474:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b39e expref: 17 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064481:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b39e expref: 17 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064490:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fd82800/0x14b4f8542d4f374b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b39e expref: 17 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064496:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.064505:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881261107456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 41us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.064510:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5459 00000100:00100000:3.0:1746065125.064524:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5460 00000100:00100000:3.0:1746065125.064528:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881261107712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.064533:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.064538:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b382 expref: 8 pid: 21235 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064546:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b382 expref: 8 pid: 21235 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064554:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f717800/0x14b4f8542d4f3721 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b382 expref: 8 pid: 21235 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064562:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.064563:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.064566:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.064571:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.064583:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.064593:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261107712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.064597:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5460 00000100:00100000:3.0:1746065125.064605:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5461 00000100:00100000:3.0:1746065125.064609:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261108096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.064614:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.064620:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b389 expref: 13 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064631:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b389 expref: 13 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064640:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fd83000/0x14b4f8542d4f372f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b389 expref: 13 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064647:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.064656:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261108096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.064660:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5461 00000100:00100000:3.0:1746065125.064668:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5462 00000100:00100000:3.0:1746065125.064672:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881261107968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.064677:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.064682:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3a5 expref: 27 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064689:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3a5 expref: 27 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064697:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f717e00/0x14b4f8542d4f3736 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b3a5 expref: 27 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.064704:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.064705:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.064708:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.064714:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.064724:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.064736:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881261107968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.064740:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5462 00000100:00100000:3.0:1746065125.064763:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1536 00000100:00100000:3.0:1746065125.064768:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261106816:12345-192.168.202.46@tcp:4:cat.0 00010000:00010000:1.0:1746065125.064773:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064780:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064783:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064792:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064793:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064800:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064805:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064806:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064811:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064811:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927da000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065125.064829:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064830:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064835:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f35c000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065125.064836:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064838:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064843:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064845:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064849:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927da000/0x14b4f8542d4f38cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064852:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.064863:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f35c000/0x14b4f8542d4f38c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.064881:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261106176:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 9979us (11020us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.064886:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10951 00000100:00100000:2.0:1746065125.064893:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261106048:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 10208us (11535us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.064899:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10949 00010000:00010000:1.0:1746065125.064901:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064907:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064919:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064925:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064930:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064934:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093815a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065125.064936:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064941:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064948:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.064953:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093815a00/0x14b4f8542d4f38da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.064976:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261106304:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 9384us (9627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.064981:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10953 00000100:00100000:2.0:1746065125.065913:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881261106944:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7152us (7233us total) trans 17179872854 rc 0/0 00000100:00100000:2.0:1746065125.065921:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1534 00002000:00100000:2.0:1746065125.065927:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3911680->4194303) req@ffff88013329a680 x1830881261106944/t17179872854(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.065935:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329a680 with x1830881261106944 ext(3911680->4194303) 00010000:00010000:2.0:1746065125.065941:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 12 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.065949:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 12 pid: 8851 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746065125.065956:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013329a680 00000100:00100000:0.0:1746065125.071090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.071214:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261108224 00000100:00100000:3.0:1746065125.071221:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261108224 00010000:00010000:3.0:1746065125.071248:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 12 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.071270:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5463 00000100:00100000:3.0:1746065125.071276:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881261108224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.071287:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.071304:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 12 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.071326:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 12 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.071345:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c756400/0x14b4f8542d4f3816 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b42a expref: 12 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.071361:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.071362:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.071366:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071372:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071389:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065125.071404:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071410:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071427:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071433:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071438:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071444:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c395400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065125.071447:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071530:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071539:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.071544:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c395400/0x14b4f8542d4f38d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.071595:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261106432:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 16408us (16985us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.071602:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10952 00000100:00100000:3.0:1746065125.071627:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261108224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 351us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.071632:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5463 00000100:00100000:1.0:1746065125.075175:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881261107840:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10969us (11236us total) trans 21474840081 rc 0/0 00000100:00100000:1.0:1746065125.075185:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1535 00002000:00100000:1.0:1746065125.075196:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3899391) req@ffff88013329b480 x1830881261107840/t21474840081(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.075206:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329b480 with x1830881261107840 ext(3145728->3899391) 00010000:00010000:1.0:1746065125.075215:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 8 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.075226:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 8 pid: 4545 timeout: 824 lvb_type: 0 00002000:00010000:1.0:1746065125.075232:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013329b480 00000100:00100000:3.0:1746065125.077210:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261106816:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12435us (13254us total) trans 17179872855 rc 0/0 00000100:00100000:3.0:1746065125.077219:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1536 00002000:00100000:3.0:1746065125.077227:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x37d:0x0] (139264->471039) req@ffff88013329b800 x1830881261106816/t17179872855(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.077236:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329b800 with x1830881261106816 ext(139264->471039) 00010000:00010000:3.0:1746065125.077244:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.077259:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746065125.077265:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013329b800 00000100:00100000:0.0:1746065125.078321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.078358:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261108352 00000100:00100000:3.0:1746065125.078365:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261108352 00010000:00010000:3.0:1746065125.078388:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 8 pid: 4545 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.078417:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5464 00000100:00100000:3.0:1746065125.078423:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1959:x1830881261108352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.078432:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.078446:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 8 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.078455:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 8 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.078471:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094759a00/0x14b4f8542d4f3824 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b438 expref: 8 pid: 4545 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.078481:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.078482:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.078486:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.078497:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.078760:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.078795:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+7:1959:x1830881261108352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 370us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.078800:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5464 00010000:00010000:1.0:1746065125.080078:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.080088:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.080110:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.080923:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.081033:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.081045:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ffbfc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065125.081048:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.081054:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.081069:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.081074:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4f38e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.081111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.081244:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261108480 00000100:00100000:3.0:1746065125.081250:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261108480 00000100:00100000:1.0:1746065125.081258:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261106560:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 25490us (25862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.081266:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10954 00010000:00010000:3.0:1746065125.081274:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.081292:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5465 00000100:00100000:3.0:1746065125.081298:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5beec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881261108480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.081307:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.081329:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.081382:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.081396:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4f37fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 139264->471039) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b40e expref: 27 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.081404:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.081406:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.081410:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.081416:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.081433:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.081462:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5beec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881261108480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 163us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.081467:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5465 00010000:00010000:0.0:1746065125.081624:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.081633:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.081648:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.081654:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.081660:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.081665:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c732400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065125.081668:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.081674:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.081683:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.081694:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4f38be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.081745:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881261105920:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 27047us (28345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.081751:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10950 00000100:00100000:0.0:1746065125.087890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.088013:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261108736 00000100:00100000:2.0:1746065125.088021:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261108736 00000100:00100000:2.0:1746065125.088070:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9067 00000100:00100000:2.0:1746065125.088078:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:29061:x1830881261108736:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:2.0:1746065125.088352:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.088376:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35dc00/0x14b4f8542d4f38b7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b49a expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.088402:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.088407:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065125.088432:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.088442:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 258 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.088448:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 258 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.088453:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.088458:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b0 expref: 258 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.088463:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.088487:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b0 expref: 258 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.088498:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b0 expref: 258 pid: 14643 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065125.088508:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259759232:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.089224:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.089234:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 14 pid: 14644 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065125.089243:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259759360:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.089353:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 258 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.089360:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 258 pid: 16767 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065125.089368:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259759488:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.089391:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 258 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.089398:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 258 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065125.089404:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259759616:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.089417:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.092150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.092235:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261108992 00000100:00100000:1.0:1746065125.092242:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261108992 00000100:00100000:1.0:1746065125.092278:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3709 00000100:00100000:1.0:1746065125.092284:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:19663:x1830881261108992:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065125.092367:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259759232:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065125.092376:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259759360:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065125.092382:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259759488:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065125.092409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.092530:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:19663:x1830881261108992:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 245us (386us total) trans 8589943125 rc 0/0 00000100:00100000:1.0:1746065125.092536:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3709 00000100:00100000:3.0:1746065125.092694:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261109120 00000100:00100000:3.0:1746065125.092698:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261109120 00000100:00100000:0.0:1746065125.092701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065125.092716:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 15 pid: 14644 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.092731:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261109248 00000100:00100000:3.0:1746065125.092733:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261109248 00000100:00100000:0.0:1746065125.092739:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5466 00010000:00010000:3.0:1746065125.092740:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 260 pid: 16767 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746065125.092745:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261109120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065125.092751:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5467 00010000:00010000:0.0:1746065125.092753:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065125.092754:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1961:x1830881261109248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065125.092758:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 15 pid: 14644 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.092759:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.092762:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 260 pid: 16767 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.092766:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 15 pid: 14644 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.092808:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 260 pid: 16767 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.092846:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084600/0x14b4f8542d4f3506 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b224 expref: 15 pid: 14644 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.092902:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135452400/0x14b4f8542d4f34f1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b216 expref: 260 pid: 16767 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746065125.092902:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065125.092906:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.092913:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065125.092920:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.092923:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065125.092927:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.092950:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1961:x1830881261109248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 194us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.092956:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5467 00000100:00100000:1.0:1746065125.093167:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881261109120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 421us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.093175:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5466 00000100:00100000:2.0:1746065125.093726:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259759616:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.093748:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065125.095297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.095361:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261109376 00000100:00100000:1.0:1746065125.095368:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261109376 00010000:00010000:1.0:1746065125.095388:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 259 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.095457:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5468 00000100:00100000:1.0:1746065125.095465:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1961:x1830881261109376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065125.095476:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065125.095482:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 259 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.095491:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 259 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.095506:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135452800/0x14b4f8542d4f34ea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b20f expref: 259 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.095515:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.095520:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.095526:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065125.095588:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1961:x1830881261109376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 123us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.095593:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5468 00000100:00100000:2.0:1746065125.095794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.096038:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261109504 00000100:00100000:1.0:1746065125.096042:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261109504 00010000:00010000:1.0:1746065125.096053:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b0 expref: 258 pid: 14643 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.096081:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5469 00000100:00100000:1.0:1746065125.096086:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1960:x1830881261109504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065125.096092:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065125.096096:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b0 expref: 258 pid: 14643 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.096103:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b0 expref: 258 pid: 14643 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.096113:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0094000/0x14b4f8542d4f35d1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b2b0 expref: 258 pid: 14643 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.096121:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.096124:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.096130:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.096136:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.096163:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065125.096192:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1960:x1830881261109504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 105us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.096197:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5469 00010000:00010000:2.0:1746065125.096286:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.096292:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000040:00080000:2.0:1746065125.096943:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2566, 88 off215632 00000004:00080000:2.0:1746065125.096950:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724388134826ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065125.096985:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2502, 88 off209816 00000004:00080000:2.0:1746065125.096990:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724388174241ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065125.097000:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2503, 88 off209904 00000004:00080000:2.0:1746065125.097002:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724388187096ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065125.097009:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2567, 88 off215720 00000004:00080000:2.0:1746065125.097012:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724388196615ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065125.097018:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2568, 88 off215808 00000004:00080000:2.0:1746065125.097020:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724388204516ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065125.097025:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2504, 88 off209992 00000004:00080000:2.0:1746065125.097028:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724388212252ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065125.097033:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2505, 88 off210080 00000004:00080000:2.0:1746065125.097035:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724388220026ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065125.097041:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2506, 88 off210168 00000004:00080000:2.0:1746065125.097043:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724388227631ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065125.097049:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2569, 88 off215896 00000004:00080000:2.0:1746065125.097051:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724388235460ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065125.097056:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2507, 88 off210256 00000004:00080000:2.0:1746065125.097058:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724388243186ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065125.097065:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2570, 88 off215984 00000004:00080000:2.0:1746065125.097067:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724388252196ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065125.097073:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2508, 88 off210344 00000004:00080000:2.0:1746065125.097075:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724388260126ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065125.097082:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2571, 88 off216072 00000004:00080000:2.0:1746065125.097084:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724388268697ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065125.097090:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2572, 88 off216160 00000004:00080000:2.0:1746065125.097092:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724388276591ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065125.097098:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2573, 88 off216248 00000004:00080000:2.0:1746065125.097100:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724388284550ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065125.097106:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2574, 88 off216336 00000004:00080000:2.0:1746065125.097108:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724388292606ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065125.097113:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2509, 88 off210432 00000004:00080000:2.0:1746065125.097116:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724388301018ns, next at 666938887344ns, rc = 0 00000004:00010000:1.0:1746065125.120697:0:24350:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801363a1180 reply state ffff88009352f800 transno 8589943126 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065125.120709:0:24350:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065125.120790:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:29061:x1830881261108736:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 32710us (32904us total) trans 8589943126 rc 0/0 00000100:00100000:1.0:1746065125.120797:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9067 00000001:00080000:3.0:1746065125.121217:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943125 is committed 00000001:00080000:3.0:1746065125.121226:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943119 is committed 00000001:00080000:3.0:1746065125.121244:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943126 is committed 00000004:00080000:3.0:1746065125.121248:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1802 committed 00000004:00080000:3.0:1746065125.121261:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1867 committed 00000004:00080000:3.0:1746065125.121265:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1866 committed 00000004:00080000:3.0:1746065125.121267:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1865 committed 00000004:00080000:3.0:1746065125.121268:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1864 committed 00000004:00080000:3.0:1746065125.121269:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1801 committed 00000004:00080000:3.0:1746065125.121271:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1863 committed 00000004:00080000:3.0:1746065125.121272:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1800 committed 00000004:00080000:3.0:1746065125.121274:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1862 committed 00000004:00080000:3.0:1746065125.121275:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1799 committed 00000004:00080000:3.0:1746065125.121276:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1798 committed 00000004:00080000:3.0:1746065125.121278:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1797 committed 00000004:00080000:3.0:1746065125.121279:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1861 committed 00000004:00080000:3.0:1746065125.121280:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1860 committed 00000004:00080000:3.0:1746065125.121282:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1796 committed 00000004:00080000:3.0:1746065125.121284:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1795 committed 00000004:00080000:3.0:1746065125.121285:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1859 committed 00000001:00080000:3.0:1746065125.121292:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943122 is committed 00000100:00100000:0.0:1746065125.121433:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259759744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.121466:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065125.121493:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259760256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.121503:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065125.121513:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065125.121516:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259759872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.121526:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065125.121533:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259760384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.121542:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065125.121555:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259760000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.121568:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065125.121578:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259760512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.121588:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065125.121598:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065125.121601:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259760128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.121611:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065125.121620:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259760640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.121630:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065125.121648:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259759744 00000100:00100000:0.0:1746065125.121653:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259759744 00000100:00100000:0.0:1746065125.121678:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259760256 00000100:00100000:0.0:1746065125.121680:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259760256 00000100:00100000:0.0:1746065125.121687:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259759872 00000100:00100000:0.0:1746065125.121688:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259759872 00000100:00100000:0.0:1746065125.121693:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259760384 00000100:00100000:0.0:1746065125.121694:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259760384 00000100:00100000:0.0:1746065125.121698:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259760000 00000100:00100000:0.0:1746065125.121699:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259760000 00000100:00100000:0.0:1746065125.121704:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259760512 00000100:00100000:0.0:1746065125.121705:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259760512 00000100:00100000:0.0:1746065125.121709:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259760128 00000100:00100000:0.0:1746065125.121710:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259760128 00000100:00100000:0.0:1746065125.121714:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259760640 00000100:00100000:0.0:1746065125.121715:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259760640 00000100:00100000:0.0:1746065125.121721:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10955 00000100:00100000:0.0:1746065125.121726:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881259759744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.121809:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10956 00000100:00100000:1.0:1746065125.121836:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881259760256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.121914:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881259759744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 187us (447us total) trans 21474840082 rc 0/0 00000100:00100000:0.0:1746065125.121919:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10955 00000100:00100000:0.0:1746065125.121930:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10957 00000100:00100000:0.0:1746065125.121933:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881259759872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065125.121952:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:1.0:1746065125.121956:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:1.0:1746065125.121958:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065125.121960:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:1.0:1746065125.121961:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:1.0:1746065125.121984:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881259760256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (479us total) trans 21474840083 rc 0/0 00000100:00100000:1.0:1746065125.121990:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10956 00000100:00100000:1.0:1746065125.122001:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10958 00000100:00100000:1.0:1746065125.122005:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881259760384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.122012:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881259759872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (485us total) trans 21474840084 rc 0/0 00000100:00100000:0.0:1746065125.122017:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10957 00000100:00100000:0.0:1746065125.122025:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10959 00000100:00100000:0.0:1746065125.122028:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881259760000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065125.122076:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065125.122078:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065125.122080:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065125.122081:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065125.122083:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065125.122089:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881259760000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (520us total) trans 21474840086 rc 0/0 00000100:00100000:0.0:1746065125.122094:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10959 00000100:00100000:0.0:1746065125.122101:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10960 00000100:00100000:1.0:1746065125.122102:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881259760384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (558us total) trans 21474840085 rc 0/0 00000100:00100000:0.0:1746065125.122104:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881259760512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.122107:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10958 00000100:00100000:1.0:1746065125.122119:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10961 00000100:00100000:1.0:1746065125.122123:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881259760128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.122149:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10962 00000100:00100000:0.0:1746065125.122154:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881259760640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.122221:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881259760640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (589us total) trans 21474840087 rc 0/0 00000100:00100000:0.0:1746065125.122225:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10962 00000100:00080000:0.0:1746065125.122239:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065125.122240:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881259760128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (626us total) trans 21474840088 rc 0/0 00000100:00100000:1.0:1746065125.122245:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10961 00000100:00100000:0.0:1746065125.122246:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259761024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065125.122259:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.122268:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259761024 00000100:00100000:1.0:1746065125.122270:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259761024 00000100:00100000:0.0:1746065125.122274:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259761536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065125.122284:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.122291:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259761536 00000100:00100000:1.0:1746065125.122293:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259761536 00000100:00100000:0.0:1746065125.122300:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840076 gen 2 00000100:00100000:1.0:1746065125.122301:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10963 00000004:00080000:0.0:1746065125.122303:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff22300, transno 21474839951 00000100:00100000:1.0:1746065125.122305:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3297:x1830881259761024:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065125.122307:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131b08000, transno 21474839952 00000004:00080000:0.0:1746065125.122309:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131b09180, transno 21474839953 00000004:00080000:0.0:1746065125.122311:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d137b80, transno 21474839954 00000004:00080000:0.0:1746065125.122324:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff23800, transno 21474839955 00000004:00080000:0.0:1746065125.122326:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d136300, transno 21474839956 00000004:00080000:0.0:1746065125.122328:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff23100, transno 21474839957 00000004:00080000:0.0:1746065125.122330:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff21880, transno 21474839958 00000004:00080000:0.0:1746065125.122332:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d137800, transno 21474839962 00000004:00080000:0.0:1746065125.122334:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d135880, transno 21474839963 00000004:00080000:0.0:1746065125.122335:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d134700, transno 21474839964 00000004:00080000:0.0:1746065125.122338:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d136d80, transno 21474839965 00000004:00080000:0.0:1746065125.122340:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d135500, transno 21474839966 00000004:00080000:0.0:1746065125.122342:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d137480, transno 21474839967 00000004:00080000:0.0:1746065125.122344:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d135c00, transno 21474839968 00000004:00080000:0.0:1746065125.122346:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d134e00, transno 21474839969 00000004:00080000:0.0:1746065125.122348:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095351180, transno 21474839970 00000004:00080000:0.0:1746065125.122350:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131b0b480, transno 21474839971 00000004:00080000:0.0:1746065125.122352:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095353800, transno 21474839972 00000004:00080000:0.0:1746065125.122354:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131b08380, transno 21474839973 00000004:00080000:0.0:1746065125.122356:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095350000, transno 21474839974 00000004:00080000:0.0:1746065125.122358:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094245180, transno 21474839975 00000004:00080000:0.0:1746065125.122360:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095353b80, transno 21474839976 00000004:00080000:0.0:1746065125.122361:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095353480, transno 21474839977 00000004:00080000:0.0:1746065125.122363:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd73b80, transno 21474839985 00000004:00080000:0.0:1746065125.122365:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd70380, transno 21474839986 00000004:00080000:0.0:1746065125.122366:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd71880, transno 21474839987 00000004:00080000:0.0:1746065125.122368:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd70000, transno 21474839988 00000004:00080000:0.0:1746065125.122370:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd70e00, transno 21474839989 00000004:00080000:0.0:1746065125.122372:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd72680, transno 21474839990 00000004:00080000:0.0:1746065125.122373:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd73800, transno 21474839991 00000004:00080000:0.0:1746065125.122375:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd71f80, transno 21474839992 00000004:00080000:0.0:1746065125.122377:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc59500, transno 21474839996 00000004:00080000:0.0:1746065125.122379:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc59f80, transno 21474839997 00000004:00080000:0.0:1746065125.122380:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc58380, transno 21474839998 00000004:00080000:0.0:1746065125.122382:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc5aa00, transno 21474839999 00000004:00080000:0.0:1746065125.122383:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc59180, transno 21474840000 00000004:00080000:0.0:1746065125.122386:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d508000, transno 21474840001 00000004:00080000:0.0:1746065125.122387:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc58a80, transno 21474840002 00000004:00080000:0.0:1746065125.122389:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc59880, transno 21474840003 00000004:00080000:0.0:1746065125.122390:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5883b80, transno 21474840004 00000004:00080000:0.0:1746065125.122393:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5881500, transno 21474840005 00000004:00080000:0.0:1746065125.122394:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880e00, transno 21474840006 00000004:00080000:0.0:1746065125.122396:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5882a00, transno 21474840007 00000004:00080000:0.0:1746065125.122398:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5882680, transno 21474840008 00000004:00080000:0.0:1746065125.122400:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880380, transno 21474840009 00000004:00080000:0.0:1746065125.122401:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5882d80, transno 21474840010 00000004:00080000:0.0:1746065125.122403:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5881180, transno 21474840011 00000004:00080000:0.0:1746065125.122404:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45e300, transno 21474840022 00000004:00080000:0.0:1746065125.122406:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45f800, transno 21474840023 00000004:00080000:0.0:1746065125.122408:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45ea00, transno 21474840024 00000004:00080000:0.0:1746065125.122409:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45d880, transno 21474840025 00000004:00080000:0.0:1746065125.122411:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45e680, transno 21474840026 00000004:00080000:0.0:1746065125.122412:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45f480, transno 21474840027 00000004:00080000:0.0:1746065125.122414:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45ed80, transno 21474840028 00000004:00080000:0.0:1746065125.122415:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45d500, transno 21474840029 00000004:00080000:0.0:1746065125.122417:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7ac700, transno 21474840033 00000004:00080000:0.0:1746065125.122419:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7af100, transno 21474840034 00000004:00080000:0.0:1746065125.122420:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7ad880, transno 21474840035 00000004:00080000:0.0:1746065125.122422:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7adf80, transno 21474840036 00000004:00080000:0.0:1746065125.122424:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7ac380, transno 21474840037 00000100:00100000:1.0:1746065125.122426:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3297:x1830881259761024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (165us total) trans 17179872856 rc 0/0 00000004:00080000:0.0:1746065125.122426:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7aea00, transno 21474840038 00000004:00080000:0.0:1746065125.122427:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7ae300, transno 21474840039 00000004:00080000:0.0:1746065125.122428:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7ad180, transno 21474840040 00000004:00080000:0.0:1746065125.122430:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d0000, transno 21474840041 00000004:00080000:0.0:1746065125.122432:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d2d80, transno 21474840042 00000004:00080000:0.0:1746065125.122433:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d1f80, transno 21474840043 00000004:00080000:0.0:1746065125.122435:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff20a80, transno 21474840044 00000004:00080000:0.0:1746065125.122437:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d3480, transno 21474840045 00000004:00080000:0.0:1746065125.122438:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff20e00, transno 21474840046 00000004:00080000:0.0:1746065125.122440:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d3100, transno 21474840047 00000004:00080000:0.0:1746065125.122442:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d1c00, transno 21474840048 00000004:00080000:0.0:1746065125.122444:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba1180, transno 21474840053 00000004:00080000:0.0:1746065125.122446:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f045500, transno 21474840054 00000004:00080000:0.0:1746065125.122447:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f046a00, transno 21474840055 00000004:00080000:0.0:1746065125.122449:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba3b80, transno 21474840056 00000004:00080000:0.0:1746065125.122451:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba0000, transno 21474840057 00000004:00080000:0.0:1746065125.122452:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba1500, transno 21474840058 00000004:00080000:0.0:1746065125.122454:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f047100, transno 21474840059 00000004:00080000:0.0:1746065125.122455:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba0e00, transno 21474840060 00000004:00080000:0.0:1746065125.122457:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fbb80, transno 21474840061 00000004:00080000:0.0:1746065125.122458:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba1c00, transno 21474840062 00000004:00080000:0.0:1746065125.122460:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913faa00, transno 21474840063 00000004:00080000:0.0:1746065125.122461:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba0700, transno 21474840064 00000004:00080000:0.0:1746065125.122463:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380c000, transno 21474840065 00000004:00080000:0.0:1746065125.122465:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fb800, transno 21474840066 00000004:00080000:0.0:1746065125.122466:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fad80, transno 21474840067 00000004:00080000:0.0:1746065125.122468:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f8a80, transno 21474840068 00000004:00080000:0.0:1746065125.122470:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009009f480, transno 21474840069 00000004:00080000:0.0:1746065125.122471:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009009ed80, transno 21474840070 00000004:00080000:0.0:1746065125.122473:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009009df80, transno 21474840071 00000004:00080000:0.0:1746065125.122474:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009009f100, transno 21474840072 00000004:00080000:0.0:1746065125.122476:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009009f800, transno 21474840073 00000004:00080000:0.0:1746065125.122477:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009009ca80, transno 21474840074 00000004:00080000:0.0:1746065125.122479:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6d90700, transno 21474840075 00000004:00080000:0.0:1746065125.122480:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6d93800, transno 21474840076 00000100:00100000:0.0:1746065125.122485:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8801363a2a00 x1830881259760128/t21474840088(21474840088) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065141 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746065125.122493:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a2a00/2, rc 0, transno 21474840088 00000100:00100000:0.0:1746065125.122495:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259760128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065125.122504:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a3800/2, rc 0, transno 21474840087 00000100:00100000:0.0:1746065125.122506:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259760640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065125.122510:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a2680/2, rc 0, transno 21474840086 00000100:00100000:0.0:1746065125.122512:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259760000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.122520:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872848 gen 2 00000004:00080000:0.0:1746065125.122522:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130268a80, transno 17179872729 00000004:00080000:0.0:1746065125.122527:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026b480, transno 17179872730 00000004:00080000:0.0:1746065125.122528:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026a680, transno 17179872731 00000004:00080000:0.0:1746065125.122530:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026aa00, transno 17179872732 00000004:00080000:0.0:1746065125.122531:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013026ad80, transno 17179872733 00000004:00080000:0.0:1746065125.122533:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130268700, transno 17179872734 00000100:00100000:1.0:1746065125.122535:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10963 00000004:00080000:0.0:1746065125.122535:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130269500, transno 17179872735 00000004:00080000:0.0:1746065125.122536:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130268000, transno 17179872736 00000004:00080000:0.0:1746065125.122538:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90ace00, transno 17179872737 00000004:00080000:0.0:1746065125.122540:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130447800, transno 17179872738 00000004:00080000:0.0:1746065125.122541:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130446300, transno 17179872739 00000004:00080000:0.0:1746065125.122543:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d0380, transno 17179872740 00000004:00080000:0.0:1746065125.122545:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130445f80, transno 17179872741 00000004:00080000:0.0:1746065125.122546:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d0e00, transno 17179872742 00000100:00100000:1.0:1746065125.122547:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10964 00000004:00080000:0.0:1746065125.122548:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095357100, transno 17179872743 00000004:00080000:0.0:1746065125.122550:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3d1180, transno 17179872744 00000100:00100000:1.0:1746065125.122551:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3297:x1830881259761536:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065125.122551:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095356300, transno 17179872745 00000004:00080000:0.0:1746065125.122553:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd06d80, transno 17179872746 00000004:00080000:0.0:1746065125.122555:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4ea680, transno 17179872753 00000004:00080000:0.0:1746065125.122557:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4e8700, transno 17179872754 00000004:00080000:0.0:1746065125.122558:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4e8e00, transno 17179872755 00000004:00080000:0.0:1746065125.122560:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4eaa00, transno 17179872756 00000004:00080000:0.0:1746065125.122562:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4e9f80, transno 17179872757 00000004:00080000:0.0:1746065125.122563:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4eb480, transno 17179872758 00000004:00080000:0.0:1746065125.122565:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4e9180, transno 17179872759 00000004:00080000:0.0:1746065125.122566:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4ead80, transno 17179872760 00000004:00080000:0.0:1746065125.122568:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095350380, transno 17179872761 00000004:00080000:0.0:1746065125.122570:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c126d80, transno 17179872765 00000004:00080000:0.0:1746065125.122571:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095351c00, transno 17179872766 00000004:00080000:0.0:1746065125.122573:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c127100, transno 17179872767 00000004:00080000:0.0:1746065125.122574:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095351500, transno 17179872768 00000004:00080000:0.0:1746065125.122576:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4e8380, transno 17179872769 00000004:00080000:0.0:1746065125.122577:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095350a80, transno 17179872770 00000004:00080000:0.0:1746065125.122579:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4eb800, transno 17179872771 00000004:00080000:0.0:1746065125.122580:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095350e00, transno 17179872772 00000004:00080000:0.0:1746065125.122581:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d509180, transno 17179872773 00000004:00080000:0.0:1746065125.122583:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b5180, transno 17179872774 00000004:00080000:0.0:1746065125.122585:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b7b80, transno 17179872775 00000004:00080000:0.0:1746065125.122586:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b7480, transno 17179872776 00000004:00080000:0.0:1746065125.122588:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b4e00, transno 17179872777 00000004:00080000:0.0:1746065125.122589:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b5f80, transno 17179872778 00000004:00080000:0.0:1746065125.122591:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b6d80, transno 17179872779 00000004:00080000:0.0:1746065125.122593:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd71c00, transno 17179872780 00000004:00080000:0.0:1746065125.122594:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b6680, transno 17179872781 00000004:00080000:0.0:1746065125.122596:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b5500, transno 17179872782 00000004:00080000:0.0:1746065125.122597:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa2680, transno 17179872788 00000004:00080000:0.0:1746065125.122599:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa1f80, transno 17179872789 00000004:00080000:0.0:1746065125.122600:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa1880, transno 17179872790 00000004:00080000:0.0:1746065125.122602:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa1180, transno 17179872791 00000004:00080000:0.0:1746065125.122604:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa2300, transno 17179872792 00000004:00080000:0.0:1746065125.122605:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa0e00, transno 17179872793 00000004:00080000:0.0:1746065125.122607:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa3b80, transno 17179872794 00000004:00080000:0.0:1746065125.122609:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa0a80, transno 17179872795 00000004:00080000:0.0:1746065125.122611:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d7ff100, transno 17179872796 00000004:00080000:0.0:1746065125.122613:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fdf80, transno 17179872800 00000004:00080000:0.0:1746065125.122615:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380ca80, transno 17179872801 00000004:00080000:0.0:1746065125.122616:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380f480, transno 17179872802 00000004:00080000:0.0:1746065125.122618:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380df80, transno 17179872803 00000004:00080000:0.0:1746065125.122619:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380f800, transno 17179872804 00000004:00080000:0.0:1746065125.122621:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380ce00, transno 17179872805 00000004:00080000:0.0:1746065125.122623:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380d500, transno 17179872806 00000004:00080000:0.0:1746065125.122624:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc5b800, transno 17179872807 00000004:00080000:0.0:1746065125.122626:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380e680, transno 17179872808 00000004:00080000:0.0:1746065125.122628:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3ed80, transno 17179872809 00000004:00080000:0.0:1746065125.122630:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f8a80, transno 17179872810 00000004:00080000:0.0:1746065125.122631:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3f480, transno 17179872811 00000004:00080000:0.0:1746065125.122633:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3fb480, transno 17179872812 00000004:00080000:0.0:1746065125.122635:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3e300, transno 17179872813 00000004:00080000:0.0:1746065125.122636:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3fa300, transno 17179872814 00000004:00080000:0.0:1746065125.122638:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3fbb80, transno 17179872815 00000004:00080000:0.0:1746065125.122639:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3fb100, transno 17179872816 00000004:00080000:0.0:1746065125.122641:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7adc00, transno 17179872817 00000004:00080000:0.0:1746065125.122642:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49fb80, transno 17179872822 00000004:00080000:0.0:1746065125.122644:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49d500, transno 17179872823 00000004:00080000:0.0:1746065125.122646:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49f800, transno 17179872824 00000004:00080000:0.0:1746065125.122647:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49d180, transno 17179872825 00000004:00080000:0.0:1746065125.122649:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6d90e00, transno 17179872826 00000004:00080000:0.0:1746065125.122650:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49e300, transno 17179872827 00000004:00080000:0.0:1746065125.122652:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49d880, transno 17179872828 00000004:00080000:0.0:1746065125.122653:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49ca80, transno 17179872829 00000100:00100000:1.0:1746065125.122655:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3297:x1830881259761536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (369us total) trans 17179872857 rc 0/0 00000004:00080000:0.0:1746065125.122655:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49c700, transno 17179872830 00000004:00080000:0.0:1746065125.122656:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6147480, transno 17179872831 00000004:00080000:0.0:1746065125.122658:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6145500, transno 17179872832 00000100:00100000:1.0:1746065125.122660:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10964 00000004:00080000:0.0:1746065125.122660:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6145880, transno 17179872833 00000004:00080000:0.0:1746065125.122661:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6146300, transno 17179872834 00000004:00080000:0.0:1746065125.122662:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6145c00, transno 17179872835 00000004:00080000:0.0:1746065125.122664:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6145f80, transno 17179872836 00000004:00080000:0.0:1746065125.122666:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6144000, transno 17179872837 00000004:00080000:0.0:1746065125.122667:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6146d80, transno 17179872838 00000004:00080000:0.0:1746065125.122670:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f15df80, transno 17179872839 00000004:00080000:0.0:1746065125.122671:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49c380, transno 17179872840 00000004:00080000:0.0:1746065125.122673:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45fb80, transno 17179872841 00000004:00080000:0.0:1746065125.122674:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49f100, transno 17179872842 00000004:00080000:0.0:1746065125.122676:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45ca80, transno 17179872843 00000004:00080000:0.0:1746065125.122678:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45dc00, transno 17179872844 00000004:00080000:0.0:1746065125.122679:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90af800, transno 17179872845 00000004:00080000:0.0:1746065125.122681:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45ce00, transno 17179872846 00000004:00080000:0.0:1746065125.122683:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90adc00, transno 17179872847 00000004:00080000:0.0:1746065125.122684:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4b1500, transno 17179872848 00000100:00100000:0.0:1746065125.122687:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009f46e680 x1830881259761024/t17179872856(17179872856) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065141 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746065125.122692:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46e680/2, rc 0, transno 17179872856 00000100:00100000:0.0:1746065125.122695:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259761024:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746065125.122840:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.122848:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.122853:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.122859:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c3efe00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065125.122862:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.122867:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.122878:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.122881:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065125.122884:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.122888:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4f38e8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065125.122905:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259761152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065125.122922:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065125.122937:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259761664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065125.122947:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065125.122963:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259761152 00000100:00100000:2.0:1746065125.122965:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259761152 00000100:00100000:2.0:1746065125.122977:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259761664 00000100:00100000:2.0:1746065125.122979:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259761664 00000100:00100000:2.0:1746065125.122985:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10965 00000100:00100000:2.0:1746065125.122989:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3298:x1830881259761152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065125.123053:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065125.123055:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065125.123057:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065125.123058:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065125.123060:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065125.123076:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3298:x1830881259761152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (154us total) trans 17179872858 rc 0/0 00000100:00100000:2.0:1746065125.123080:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10965 00000100:00100000:2.0:1746065125.123088:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10966 00000100:00100000:2.0:1746065125.123091:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3298:x1830881259761664:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065125.123092:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 11 in progress, 7 in flight, 96 done 00000004:00080000:1.0:1746065125.123139:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 7 in flight, 3 done 00000100:00100000:2.0:1746065125.123149:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3298:x1830881259761664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (201us total) trans 17179872859 rc 0/0 00000100:00100000:2.0:1746065125.123153:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10966 00000004:00080000:2.0:1746065125.123168:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46f800/2, rc 0, transno 17179872858 00000100:00100000:2.0:1746065125.123171:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259761152:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065125.123176:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46ce00/2, rc 0, transno 17179872859 00000100:00100000:2.0:1746065125.123178:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259761664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.123278:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259760896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.123295:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.123323:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259761408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.123335:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.123344:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1746065125.123348:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259760768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.123357:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.123363:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259761280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.123372:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.123378:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259761792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.123387:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.123415:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259760896 00000100:00100000:3.0:1746065125.123417:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259760896 00000100:00100000:3.0:1746065125.123431:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259761408 00000100:00100000:3.0:1746065125.123433:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259761408 00000100:00100000:3.0:1746065125.123439:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259760768 00000100:00100000:3.0:1746065125.123440:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259760768 00000100:00100000:3.0:1746065125.123445:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259761280 00000100:00100000:3.0:1746065125.123446:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259761280 00000100:00100000:3.0:1746065125.123450:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259761792 00000100:00100000:3.0:1746065125.123451:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259761792 00000100:00100000:3.0:1746065125.123456:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10967 00000100:00100000:3.0:1746065125.123460:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881259760896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.123544:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881259760896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (248us total) trans 17179872860 rc 0/0 00000100:00100000:3.0:1746065125.123550:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10967 00000100:00100000:3.0:1746065125.123559:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10968 00000100:00100000:3.0:1746065125.123563:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881259761408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065125.123619:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065125.123621:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.123623:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.123625:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.123626:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065125.123642:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881259761408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (306us total) trans 17179872861 rc 0/0 00000100:00100000:3.0:1746065125.123647:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10968 00000100:00100000:3.0:1746065125.123657:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10969 00000100:00100000:3.0:1746065125.123661:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881259760768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.123727:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881259760768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (368us total) trans 17179872862 rc 0/0 00000100:00100000:3.0:1746065125.123732:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10969 00000100:00100000:3.0:1746065125.123739:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10970 00000100:00100000:3.0:1746065125.123742:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881259761280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065125.123788:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065125.123790:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.123791:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.123793:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.123794:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065125.123808:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881259761280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (435us total) trans 17179872863 rc 0/0 00000100:00100000:3.0:1746065125.123831:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10970 00000100:00100000:3.0:1746065125.123839:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10971 00000100:00100000:3.0:1746065125.123842:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881259761792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.123900:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881259761792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (512us total) trans 17179872864 rc 0/0 00000100:00100000:3.0:1746065125.123904:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10971 00000004:00080000:3.0:1746065125.123921:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46d500/2, rc 0, transno 17179872862 00000100:00100000:3.0:1746065125.123924:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259760768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065125.123929:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46c700/2, rc 0, transno 17179872863 00000100:00100000:3.0:1746065125.123931:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259761280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065125.123935:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46d880/2, rc 0, transno 17179872864 00000100:00100000:3.0:1746065125.123937:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259761792:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065125.123941:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46d180/2, rc 0, transno 17179872860 00000100:00100000:3.0:1746065125.123943:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259760896:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065125.123947:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46c380/2, rc 0, transno 17179872861 00000100:00100000:3.0:1746065125.123949:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259761408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065125.126258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065125.126278:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746065125.126310:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a2300/2, rc 0, transno 21474840084 00000100:00100000:0.0:1746065125.126328:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259759872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065125.126336:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a3100/2, rc 0, transno 21474840085 00000100:00100000:0.0:1746065125.126339:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259760384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065125.126345:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a1f80/2, rc 0, transno 21474840082 00000100:00100000:0.0:1746065125.126348:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259759744:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065125.126353:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a2d80/2, rc 0, transno 21474840083 00000100:00100000:0.0:1746065125.126355:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259760256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065125.126764:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 1 in flight, 96 done 00002000:00010000:0.0:1746065125.126845:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065125.126848:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065125.126850:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065125.126852:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065125.126853:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065125.126885:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881259760512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4779us (5294us total) trans 21474840089 rc 0/0 00000100:00100000:0.0:1746065125.126892:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10960 00000004:00080000:0.0:1746065125.127850:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46ca80/2, rc 0, transno 17179872857 00000100:00100000:0.0:1746065125.127855:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259761536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065125.127862:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a3480/2, rc 0, transno 21474840089 00000100:00100000:0.0:1746065125.127865:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259760512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.127943:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261109632 00000100:00100000:1.0:1746065125.127948:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261109632 00000100:00100000:1.0:1746065125.127973:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9068 00000100:00100000:1.0:1746065125.127979:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29061:x1830881261109632:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065125.127993:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.128006:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4a1 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.128047:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a1 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.128058:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a1 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.128070:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.128073:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065125.128075:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b163200, rc 0) 00000100:00100000:1.0:1746065125.128104:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29061:x1830881261109632:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 126us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.128109:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9068 00000100:00100000:0.0:1746065125.130023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.130448:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261109760 00000100:00100000:1.0:1746065125.130456:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261109760 00000100:00100000:1.0:1746065125.130492:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9069 00000100:00100000:1.0:1746065125.130499:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29061:x1830881261109760:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065125.130513:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.130526:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4f38f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4a8 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.130583:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065125.130592:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065125.130600:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065125.130620:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:1.0:1746065125.130624:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065125.130633:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065125.130649:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4f38f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a8 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.130659:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a8 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.130665:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.130668:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065125.130670:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c733200, rc 0) 00000100:00100000:1.0:1746065125.130700:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29061:x1830881261109760:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 202us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.130704:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9069 00000100:00100000:0.0:1746065125.135162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.135180:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.135247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.135359:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261110016 00000100:00100000:1.0:1746065125.135367:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261110016 00000100:00100000:1.0:1746065125.135393:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261110272 00000100:00100000:1.0:1746065125.135395:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261110272 00000100:00100000:1.0:1746065125.135660:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261110528 00000100:00100000:1.0:1746065125.135663:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261110528 00000100:00100000:2.0:1746065125.135687:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10972 00000100:00100000:2.0:1746065125.135695:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261110016:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065125.135709:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.135723:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4b6 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065125.135741:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6e4, atime: 0x6812d6e4, ctime: 0x6812d6e4, blocks: 0x821 00010000:00010000:2.0:1746065125.135755:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.135757:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.135764:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4b6 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.135777:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4b6 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.135786:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7de00, rc 0) 00000100:00100000:2.0:1746065125.135838:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261110016:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 144us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.135843:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10972 00000100:00100000:2.0:1746065125.135857:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10973 00000100:00100000:2.0:1746065125.135861:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881261110272:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065125.135867:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.135875:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4c4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065125.135887:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6e5, atime: 0x6812d6e4, ctime: 0x6812d6e5, blocks: 0x821 00010000:00010000:2.0:1746065125.135894:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.135895:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.135899:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4c4 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.135907:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4c4 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.135913:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7d600, rc 0) 00000100:00100000:2.0:1746065125.135924:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261110272:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 63us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.135929:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10973 00000100:00100000:2.0:1746065125.135936:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10974 00000100:00100000:2.0:1746065125.135939:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261110528:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065125.135944:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.135949:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4d2 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065125.135957:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6e5, atime: 0x6812d6e5, ctime: 0x6812d6e5, blocks: 0x102b 00010000:00010000:2.0:1746065125.135963:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.135965:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.135968:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d2 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.135975:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d2 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.135981:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7ce00, rc 0) 00000100:00100000:2.0:1746065125.135991:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261110528:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 51us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.135995:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10974 00000100:00100000:0.0:1746065125.136186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.136200:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261109888 00000100:00100000:0.0:1746065125.136203:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261109888 00000100:00100000:1.0:1746065125.136293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.136481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.136510:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261110144 00000100:00100000:0.0:1746065125.136512:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261110144 00000100:00100000:0.0:1746065125.136526:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10975 00000100:00100000:0.0:1746065125.136530:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261109888:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065125.136537:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065125.136544:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4af expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065125.136556:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e5, atime: 0x6812d6e5, ctime: 0x6812d6e5, blocks: 0x7f1 00010000:00010000:0.0:1746065125.136564:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.136565:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.136568:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4af expref: 7 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065125.136577:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4af expref: 7 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065125.136583:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b163000, rc 0) 00000100:00100000:0.0:1746065125.136597:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261109888:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 67us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.136602:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10975 00000100:00100000:0.0:1746065125.136615:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10976 00000100:00100000:0.0:1746065125.136619:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261110144:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065125.136624:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065125.136630:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4bd expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065125.136639:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6e4, atime: 0x6812d6e3, ctime: 0x6812d6e4, blocks: 0x81d 00010000:00010000:0.0:1746065125.136644:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.136646:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.136650:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4bd expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065125.136657:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4bd expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065125.136663:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e8000, rc 0) 00000100:00100000:0.0:1746065125.136673:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261110144:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 54us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.136677:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10976 00000100:00100000:1.0:1746065125.136778:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261110400 00000100:00100000:1.0:1746065125.136781:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261110400 00000100:00100000:1.0:1746065125.136799:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10977 00000100:00100000:1.0:1746065125.136804:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261110400:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065125.136810:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.136831:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4cb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065125.136841:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6e5, atime: 0x6812d6e5, ctime: 0x6812d6e5, blocks: 0x16a9 00010000:00010000:1.0:1746065125.136848:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.136850:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.136854:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4cb expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.136863:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4cb expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.136869:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c733c00, rc 0) 00000100:00100000:1.0:1746065125.136884:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261110400:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 80us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.136889:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10977 00000100:00100000:0.0:1746065125.164577:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.164665:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261110784 00000100:00100000:2.0:1746065125.164673:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261110784 00000100:00100000:0.0:1746065125.164717:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.164718:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9070 00000100:00100000:2.0:1746065125.164724:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+7:29068:x1830881261110784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065125.164745:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065125.164747:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261111040 00000100:00100000:0.0:1746065125.164749:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261111040 00010000:00010000:2.0:1746065125.164762:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c200/0x14b4f8542d4f392e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4d9 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.164782:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9071 00000100:00100000:0.0:1746065125.164788:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:29067:x1830881261111040:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065125.164796:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065125.164801:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5000/0x14b4f8542d4f3935 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4e0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.164877:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.164878:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.164887:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.164896:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.164896:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.164901:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.164909:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.164915:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.164915:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.164920:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.164924:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.164930:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165018:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.165018:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.165025:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165031:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065125.165038:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065125.165136:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b493 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.165144:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.165152:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165157:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165162:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165168:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b7c600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065125.165171:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165175:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.165179:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b493 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.165190:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b493 expref: 8 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.165201:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00000100:00100000:0.0:1746065125.165201:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff23100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259761920:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.165204:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065125.165206:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.165212:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165215:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c600/0x14b4f8542d4f3958 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165240:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165244:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165249:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165253:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b7c000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065125.165255:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165259:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165264:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065125.165266:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065125.165268:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165272:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c000/0x14b4f8542d4f3943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065125.165274:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00010000:00010000:2.0:1746065125.165278:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165283:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165287:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165291:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b7c800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065125.165293:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165297:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165301:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6fe00) 00010000:00010000:2.0:1746065125.165303:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065125.165305:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165309:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3951 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065125.165344:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c200/0x14b4f8542d4f392e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d9 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.165350:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c200/0x14b4f8542d4f392e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d9 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.165355:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7c200, rc 0) 00000100:00100000:2.0:1746065125.165539:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:29068:x1830881261110784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 814us (969us total) trans 8589943127 rc 301/301 00000100:00100000:2.0:1746065125.165545:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9070 00000100:00100000:0.0:1746065125.167912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.167951:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff23100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259761920:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.167953:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261111296 00000100:00100000:3.0:1746065125.167959:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261111296 00010000:00010000:2.0:1746065125.167971:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065125.167991:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3710 00000100:00100000:3.0:1746065125.167997:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+8:29068:x1830881261111296:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065125.168011:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.168151:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:29068:x1830881261111296:12345-192.168.202.46@tcp:35:cat.0 Request processed in 154us (245us total) trans 8589943128 rc 0/0 00000100:00100000:3.0:1746065125.168157:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3710 00000100:00100000:2.0:1746065125.168490:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261111424 00000100:00100000:2.0:1746065125.168494:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261111424 00010000:00010000:2.0:1746065125.168512:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b493 expref: 9 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065125.168539:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5470 00000100:00100000:2.0:1746065125.168545:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261111424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.168553:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.168558:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b493 expref: 9 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.168568:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b493 expref: 9 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.168584:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f35c200/0x14b4f8542d4f38a9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b493 expref: 9 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.168594:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.168599:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.168606:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.168612:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.168640:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.168660:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261111424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 115us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.168665:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5470 00010000:00010000:0.0:1746065125.168673:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.168680:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065125.168691:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065125.168739:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.168746:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.168751:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.168755:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b6a2a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065125.168758:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.168764:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.168771:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065125.168773:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065125.168776:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.168780:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4f395f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.168807:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.168812:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169037:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169042:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb5200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065125.169044:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169049:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169057:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065125.169059:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065125.169061:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169065:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x14b4f8542d4f393c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169075:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169080:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169084:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169087:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938e9400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065125.169089:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169093:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169098:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6fe00) 00010000:00010000:0.0:1746065125.169100:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065125.169101:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169106:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e9400/0x14b4f8542d4f394a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065125.169137:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5000/0x14b4f8542d4f3935 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e0 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.169143:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5000/0x14b4f8542d4f3935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e0 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.169153:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5000, rc 0) 00000100:00100000:0.0:1746065125.169484:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29067:x1830881261111040:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4484us (4555us total) trans 8589943129 rc 301/301 00000100:00100000:0.0:1746065125.169490:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9071 00000100:00100000:0.0:1746065125.170087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.170305:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261111552 00000100:00100000:2.0:1746065125.170309:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261111552 00000100:00100000:2.0:1746065125.170356:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9072 00000100:00100000:2.0:1746065125.170363:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:29068:x1830881261111552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065125.170375:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.170386:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d800/0x14b4f8542d4f3974 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4e7 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.170436:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.170445:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.170453:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065125.170471:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065125.170474:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065125.170483:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.170499:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7d800/0x14b4f8542d4f3974 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e7 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.170509:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e7 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.170516:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.170518:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065125.170520:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7cc00, rc 0) 00000100:00100000:2.0:1746065125.170555:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:29068:x1830881261111552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 193us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.170561:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9072 00000100:00100000:0.0:1746065125.175425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.175470:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261111680 00000100:00100000:2.0:1746065125.175477:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261111680 00000100:00100000:2.0:1746065125.175511:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10978 00000100:00100000:2.0:1746065125.175518:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261111680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065125.175532:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.175545:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4ee expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.175563:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.175564:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.175571:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.175582:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.175591:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7ca00, rc 0) 00000100:00100000:2.0:1746065125.175635:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881261111680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 118us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.175640:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10978 00000100:00100000:0.0:1746065125.176068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.176117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.176233:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261111808 00000100:00100000:2.0:1746065125.176236:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261111808 00000100:00100000:2.0:1746065125.176251:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261111936 00000100:00100000:2.0:1746065125.176253:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261111936 00000100:00100000:3.0:1746065125.176264:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10979 00000100:00100000:2.0:1746065125.176270:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10980 00000100:00100000:3.0:1746065125.176271:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881261111808:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065125.176275:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261111936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.176279:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.176281:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.176287:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4f5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.176288:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b4fc expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.176298:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.176299:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.176300:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.176301:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.176305:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4f5 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.176305:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4fc expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.176324:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4fc expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.176325:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4f5 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.176331:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133084800, rc 0) 00010000:00010000:2.0:1746065125.176331:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7c800, rc 0) 00000100:00100000:3.0:1746065125.176363:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261111808:12345-192.168.202.46@tcp:101:cat.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.176367:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10979 00000100:00100000:2.0:1746065125.177397:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261111936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1118us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.177403:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10980 00000100:00100000:1.0:1746065125.177568:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.177601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.177636:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.177674:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261112064 00000100:00100000:3.0:1746065125.177679:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261112064 00000100:00100000:3.0:1746065125.177698:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261112192 00000100:00100000:3.0:1746065125.177699:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261112192 00000100:00100000:3.0:1746065125.177708:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261112320 00000100:00100000:3.0:1746065125.177709:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261112320 00000100:00100000:3.0:1746065125.177720:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10981 00000100:00100000:3.0:1746065125.177724:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261112064:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.177732:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.177742:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b503 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.177754:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.177755:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.177760:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b503 expref: 14 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.177769:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b503 expref: 14 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.177775:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085200, rc 0) 00000100:00100000:0.0:1746065125.177792:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10982 00000100:00100000:3.0:1746065125.177796:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881261112064:12345-192.168.202.46@tcp:101:cat.0 Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.177799:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261112192:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065125.177801:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10981 00010000:00010000:0.0:1746065125.177806:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065125.177810:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10983 00000100:00100000:3.0:1746065125.177830:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+9:1961:x1830881261112320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065125.177833:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b50a expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.177835:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.177841:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b511 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.177844:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.177846:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.177850:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.177850:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b50a expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.177852:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.177855:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b511 expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065125.177859:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b50a expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.177863:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b511 expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065125.177867:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e5600, rc 0) 00010000:00010000:3.0:1746065125.177873:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133084400, rc 0) 00000100:00100000:0.0:1746065125.177883:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261112192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.177887:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261112320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.177888:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10982 00000100:00100000:3.0:1746065125.177891:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10983 00000100:00100000:0.0:1746065125.180872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.182097:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261112576 00000100:00100000:3.0:1746065125.182106:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261112576 00000100:00100000:3.0:1746065125.182160:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9073 00000100:00100000:3.0:1746065125.182169:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29071:x1830881261112576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.182189:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.182209:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f39ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b518 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.182393:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182404:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182413:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182424:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182428:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182433:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182519:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182525:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182530:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065125.182538:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065125.182598:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182604:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182609:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182613:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133085800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065125.182616:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182620:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182629:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.182632:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065125.182634:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182638:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f39c1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182668:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182673:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182676:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182684:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133084e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065125.182686:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182690:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182695:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065125.182697:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065125.182699:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182703:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f39b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182709:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182714:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182717:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182721:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133085000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065125.182723:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182727:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182732:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093631400) 00010000:00010000:3.0:1746065125.182734:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065125.182736:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182739:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f39ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.182767:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f39ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b518 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.182773:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f39ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b518 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.182779:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085400, rc 0) 00000100:00100000:3.0:1746065125.182853:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29071:x1830881261112576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 686us (1989us total) trans 8589943130 rc 301/301 00000100:00100000:3.0:1746065125.182859:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9073 00000100:00100000:0.0:1746065125.190209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.190244:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261112704 00000100:00100000:3.0:1746065125.190252:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261112704 00000100:00100000:3.0:1746065125.190284:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9074 00000100:00100000:3.0:1746065125.190289:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29071:x1830881261112704:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.190304:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.190327:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f39cf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b51f expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.190383:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f39d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.190391:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f39d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.190397:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f39d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065125.190413:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065125.190415:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065125.190423:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f39d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.190437:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f39cf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b51f expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.190458:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f39d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b51f expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.190465:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.190467:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065125.190470:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085400, rc 0) 00000100:00100000:3.0:1746065125.190545:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29071:x1830881261112704:12345-192.168.202.46@tcp:101:cat.0 Request processed in 255us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.190549:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9074 00000100:00100000:0.0:1746065125.194657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.194690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.194714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.194805:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261112832 00000100:00100000:1.0:1746065125.194812:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261112832 00000100:00100000:3.0:1746065125.194894:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261113088 00000100:00100000:3.0:1746065125.194953:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261113088 00002000:00100000:3.0:1746065125.194980:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8800913f8a80 x1830881261113088/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.194994:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f8a80 with x1830881261113088 ext(0->1048575) 00002000:00010000:3.0:1746065125.194999:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f8a80 00000100:00100000:3.0:1746065125.195014:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5014 00000100:00100000:3.0:1746065125.195020:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881261113088:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.195091:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261113344 00000100:00100000:1.0:1746065125.195095:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261113344 00000100:00100000:1.0:1746065125.195113:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10984 00000100:00100000:1.0:1746065125.195118:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881261112832:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.195129:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.195141:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b526 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.195156:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.195158:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.195164:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b526 expref: 27 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.195177:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b526 expref: 27 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.195185:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15d400, rc 0) 00000100:00100000:1.0:1746065125.195219:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881261112832:12345-192.168.202.46@tcp:101:cat.0 Request processed in 100us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.195225:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10984 00000100:00100000:1.0:1746065125.195239:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10985 00000100:00100000:1.0:1746065125.195243:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261113344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.195249:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.195257:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b52d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.195267:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.195268:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.195272:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b52d expref: 17 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.195281:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b52d expref: 17 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.195288:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15de00, rc 0) 00000100:00100000:1.0:1746065125.195304:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881261113344:12345-192.168.202.46@tcp:101:cat.0 Request processed in 59us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.195308:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10985 00000100:00100000:0.0:1746065125.196215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.196262:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261113472 00000100:00100000:2.0:1746065125.196267:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261113472 00000100:00100000:0.0:1746065125.196273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:2.0:1746065125.196284:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a6d93800 x1830881261113472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.196292:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d93800 with x1830881261113472 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.196295:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d93800 00000100:00100000:2.0:1746065125.196325:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5015 00000100:00100000:2.0:1746065125.196331:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881261113472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065125.196333:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.196345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.196355:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.196365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.196387:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.196398:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261113984 00000100:00100000:0.0:1746065125.196401:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261113984 00002000:00100000:0.0:1746065125.196414:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6145500 x1830881261113984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.196422:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6145500 with x1830881261113984 ext(1048576->2097151) 00002000:00010000:0.0:1746065125.196425:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6145500 00000100:00100000:0.0:1746065125.196432:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261114496 00000100:00100000:0.0:1746065125.196434:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261114496 00002000:00100000:0.0:1746065125.196441:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a6145c00 x1830881261114496/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.196448:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6145c00 with x1830881261114496 ext(1048576->2097151) 00002000:00010000:0.0:1746065125.196451:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6145c00 00000100:00100000:0.0:1746065125.196458:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5016 00000100:00100000:0.0:1746065125.196462:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261113984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065125.197548:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5017 00000100:00100000:0.0:1746065125.197555:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881261114496:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.197721:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261113728 00000100:00100000:2.0:1746065125.197726:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261113728 00000100:00100000:2.0:1746065125.197744:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261113856 00000100:00100000:2.0:1746065125.197745:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261113856 00000100:00100000:2.0:1746065125.197758:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261114112 00000100:00100000:2.0:1746065125.197760:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261114112 00000100:00100000:2.0:1746065125.197767:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261114368 00000100:00100000:2.0:1746065125.197769:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261114368 00000100:00100000:1.0:1746065125.198444:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10986 00000100:00100000:1.0:1746065125.198452:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881261113728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.198462:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.198475:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b534 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.198491:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.198492:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.198498:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b534 expref: 19 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.198509:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b534 expref: 19 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.198517:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15cc00, rc 0) 00000100:00100000:1.0:1746065125.198543:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881261113728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 91us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.198548:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10986 00000100:00100000:1.0:1746065125.198560:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10987 00000100:00100000:1.0:1746065125.198564:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261113856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.198572:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.198579:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b53b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.198588:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.198590:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.198593:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b53b expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.198602:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b53b expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.198607:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15d200, rc 0) 00000100:00100000:1.0:1746065125.198620:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261113856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 56us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.198624:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10987 00000100:00100000:1.0:1746065125.198633:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10988 00000100:00100000:1.0:1746065125.198637:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261114112:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.198641:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.198646:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b542 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.198655:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.198656:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.198659:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b542 expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.198666:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b542 expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.198672:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15ce00, rc 0) 00000100:00100000:1.0:1746065125.198683:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261114112:12345-192.168.202.46@tcp:101:cat.0 Request processed in 46us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.198687:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10988 00000100:00100000:1.0:1746065125.198695:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10989 00000100:00100000:1.0:1746065125.198700:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881261114368:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.198705:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.198710:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b549 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.198717:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.198719:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.198722:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b549 expref: 19 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.198729:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b549 expref: 19 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.198735:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15ca00, rc 0) 00000100:00100000:1.0:1746065125.198746:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881261114368:12345-192.168.202.46@tcp:101:cat.0 Request processed in 47us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.198751:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10989 00000100:00100000:2.0:1746065125.207505:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881261113984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11032us (11149us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.207763:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5016 00002000:00100000:2.0:1746065125.207774:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6145500 x1830881261113984/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.207786:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6145500 with x1830881261113984 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.207791:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6145500 00000100:00100000:2.0:1746065125.215969:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881261113472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19629us (19746us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.215981:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5015 00002000:00100000:2.0:1746065125.215991:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a6d93800 x1830881261113472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.215999:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d93800 with x1830881261113472 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.216118:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6d93800 00000100:00100000:0.0:1746065125.216452:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.216480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.216509:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.216535:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261114752 00000100:00100000:0.0:1746065125.216541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.216542:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261114752 00000100:00100000:1.0:1746065125.216591:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261115008 00000100:00100000:1.0:1746065125.216594:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261115008 00002000:00100000:1.0:1746065125.216622:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a6144000 x1830881261115008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.216630:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144000 with x1830881261115008 ext(1048576->2097151) 00002000:00010000:1.0:1746065125.216634:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6144000 00000100:00100000:1.0:1746065125.216645:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261115264 00000100:00100000:1.0:1746065125.216647:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261115264 00002000:00100000:1.0:1746065125.216655:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6146d80 x1830881261115264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.216661:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6146d80 with x1830881261115264 ext(1048576->2097151) 00002000:00010000:1.0:1746065125.216663:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6146d80 00000100:00100000:1.0:1746065125.216671:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261115520 00000100:00100000:1.0:1746065125.216672:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261115520 00002000:00100000:1.0:1746065125.216680:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012b45e300 x1830881261115520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.216686:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e300 with x1830881261115520 ext(1048576->2097151) 00000100:00100000:2.0:1746065125.216688:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5018 00002000:00010000:1.0:1746065125.216688:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45e300 00000100:00100000:2.0:1746065125.216696:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881261115008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.216697:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5019 00000100:00100000:1.0:1746065125.216702:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881261115264:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.216775:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5020 00000100:00100000:1.0:1746065125.216780:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261115520:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065125.217921:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8800a6145f80 x1830881261114752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.217930:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6145f80 with x1830881261114752 ext(0->1048575) 00002000:00010000:3.0:1746065125.217934:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6145f80 00000100:00100000:3.0:1746065125.217948:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5021 00000100:00100000:3.0:1746065125.217955:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261114752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.225429:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261114496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27867us (29033us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065125.225439:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5017 00002000:00100000:1.0:1746065125.225448:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a6145c00 x1830881261114496/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.225463:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6145c00 with x1830881261114496 ext(1048576->2097151) 00002000:00010000:1.0:1746065125.225467:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6145c00 00000100:00100000:3.0:1746065125.226673:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881261113088:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31649us (31978us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.226681:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5014 00002000:00100000:3.0:1746065125.226688:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8800913f8a80 x1830881261113088/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.226696:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f8a80 with x1830881261113088 ext(0->1048575) 00002000:00010000:3.0:1746065125.226700:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f8a80 00000100:00100000:2.0:1746065125.234009:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881261115264:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17297us (17490us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.234020:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5019 00002000:00100000:2.0:1746065125.234030:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a6146d80 x1830881261115264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.234039:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6146d80 with x1830881261115264 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.234044:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6146d80 00000100:00100000:1.0:1746065125.234103:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261115520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17321us (17560us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065125.234109:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5020 00002000:00100000:1.0:1746065125.234115:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012b45e300 x1830881261115520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.234120:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e300 with x1830881261115520 ext(1048576->2097151) 00002000:00010000:1.0:1746065125.234123:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45e300 00000100:00100000:3.0:1746065125.238839:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261114752:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20850us (22353us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.238852:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5021 00002000:00100000:3.0:1746065125.238862:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8800a6145f80 x1830881261114752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.238872:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6145f80 with x1830881261114752 ext(0->1048575) 00002000:00010000:3.0:1746065125.238876:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6145f80 00000100:00100000:2.0:1746065125.242499:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881261115008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25797us (26010us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.242510:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5018 00002000:00100000:2.0:1746065125.242519:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a6144000 x1830881261115008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.242527:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6144000 with x1830881261115008 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.242532:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6144000 00000100:00100000:0.0:1746065125.257149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.257186:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.257222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.257297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.257353:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261115776 00000100:00100000:0.0:1746065125.257361:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261115776 00002000:00100000:0.0:1746065125.257405:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012b45f800 x1830881261115776/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.257415:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f800 with x1830881261115776 ext(2097152->3145727) 00002000:00010000:0.0:1746065125.257420:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45f800 00000100:00100000:0.0:1746065125.257440:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261116032 00000100:00100000:0.0:1746065125.257444:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261116032 00002000:00100000:0.0:1746065125.257461:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012b45ea00 x1830881261116032/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.257484:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ea00 with x1830881261116032 ext(3145728->4194303) 00002000:00010000:0.0:1746065125.257487:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45ea00 00000100:00100000:0.0:1746065125.257501:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261116288 00000100:00100000:0.0:1746065125.257505:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261116288 00000100:00100000:2.0:1746065125.257507:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261116544 00000100:00100000:2.0:1746065125.257511:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261116544 00002000:00100000:0.0:1746065125.257520:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012b45d880 x1830881261116288/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.257527:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881261116288 ext(2097152->3145727) 00002000:00010000:0.0:1746065125.257530:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45d880 00002000:00100000:2.0:1746065125.257531:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012b45e680 x1830881261116544/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.257539:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e680 with x1830881261116544 ext(3145728->4194303) 00002000:00010000:2.0:1746065125.257542:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45e680 00000100:00100000:0.0:1746065125.257547:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5022 00000100:00100000:2.0:1746065125.257572:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5023 00000100:00100000:0.0:1746065125.257572:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261115776:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.257579:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261116032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.257629:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5024 00000100:00100000:3.0:1746065125.258001:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5025 00000100:00100000:3.0:1746065125.258010:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261116544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.260376:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261116288:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.262778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.262876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.263074:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261116800 00000100:00100000:2.0:1746065125.263080:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261116800 00002000:00100000:2.0:1746065125.263111:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009c126d80 x1830881261116800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.263120:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c126d80 with x1830881261116800 ext(2097152->3145727) 00002000:00010000:2.0:1746065125.263124:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c126d80 00000100:00100000:2.0:1746065125.263135:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261117056 00000100:00100000:2.0:1746065125.263137:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261117056 00002000:00100000:2.0:1746065125.263145:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009c127100 x1830881261117056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.263150:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c127100 with x1830881261117056 ext(3145728->4194303) 00002000:00010000:2.0:1746065125.263152:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c127100 00000100:00100000:2.0:1746065125.263161:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5026 00000100:00100000:2.0:1746065125.263167:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261116800:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.264174:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5027 00000100:00100000:2.0:1746065125.264182:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261117056:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065125.267736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.267792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.267812:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.267860:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261117312 00000100:00100000:0.0:1746065125.267868:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261117312 00002000:00100000:0.0:1746065125.267900:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012b45f480 x1830881261117312/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.267909:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f480 with x1830881261117312 ext(2097152->3145727) 00002000:00010000:0.0:1746065125.267914:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45f480 00000100:00100000:0.0:1746065125.267926:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261117568 00000100:00100000:0.0:1746065125.267927:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261117568 00002000:00100000:0.0:1746065125.267937:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012b45d500 x1830881261117568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.267943:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d500 with x1830881261117568 ext(3145728->4194303) 00002000:00010000:0.0:1746065125.267946:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45d500 00000100:00100000:0.0:1746065125.267958:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5028 00000100:00100000:0.0:1746065125.267964:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881261117312:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.268354:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5029 00000100:00100000:3.0:1746065125.268361:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881261117568:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.269413:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261117824 00000100:00100000:3.0:1746065125.269419:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261117824 00000100:00100000:3.0:1746065125.269449:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9075 00000100:00100000:3.0:1746065125.269454:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:29073:x1830881261117824:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065125.269465:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.269481:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b550 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.269561:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269572:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269581:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269592:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269597:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269603:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269683:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269690:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269696:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065125.269703:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065125.269761:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269766:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269772:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269776:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133084c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065125.269780:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269785:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269793:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.269795:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065125.269799:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269806:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f3a1c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269838:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269843:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269847:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269850:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133085800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065125.269852:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269856:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269862:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065125.269864:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065125.269867:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269871:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f3a0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269879:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.269883:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.271120:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.271125:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133084a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065125.271128:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.271132:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.271139:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093631400) 00010000:00010000:3.0:1746065125.271141:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065125.271143:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.271147:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3a15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.271179:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b550 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.271185:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b550 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.271191:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133084e00, rc 0) 00000100:00100000:3.0:1746065125.271214:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:29073:x1830881261117824:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1760us (3422us total) trans 8589943131 rc 301/301 00000100:00100000:3.0:1746065125.271220:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9075 00000100:00100000:3.0:1746065125.275104:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261116544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17086us (17797us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.275115:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5025 00002000:00100000:3.0:1746065125.275128:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012b45e680 x1830881261116544/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.275138:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e680 with x1830881261116544 ext(3145728->4194303) 00002000:00010000:3.0:1746065125.275143:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45e680 00000100:00100000:3.0:1746065125.277755:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261116032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20168us (20559us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.277766:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5023 00002000:00100000:3.0:1746065125.277778:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012b45ea00 x1830881261116032/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.277787:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ea00 with x1830881261116032 ext(3145728->4194303) 00002000:00010000:3.0:1746065125.277792:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45ea00 00000100:00100000:1.0:1746065125.281551:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261115776:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23990us (24402us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065125.281563:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5022 00002000:00100000:1.0:1746065125.281572:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012b45f800 x1830881261115776/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.281581:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f800 with x1830881261115776 ext(2097152->3145727) 00002000:00010000:1.0:1746065125.281586:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45f800 00000100:00100000:2.0:1746065125.285497:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261116288:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27854us (28266us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.285507:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5024 00002000:00100000:2.0:1746065125.285601:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012b45d880 x1830881261116288/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.285610:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881261116288 ext(2097152->3145727) 00002000:00010000:2.0:1746065125.285616:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45d880 00000100:00100000:3.0:1746065125.286861:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261116800:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23691us (24096us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.286870:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5026 00002000:00100000:3.0:1746065125.286880:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009c126d80 x1830881261116800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.286888:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c126d80 with x1830881261116800 ext(2097152->3145727) 00002000:00010000:3.0:1746065125.286892:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c126d80 00000100:00100000:2.0:1746065125.292537:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261117056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28347us (29653us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.292548:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5027 00002000:00100000:2.0:1746065125.292558:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009c127100 x1830881261117056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.292567:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c127100 with x1830881261117056 ext(3145728->4194303) 00002000:00010000:2.0:1746065125.292573:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c127100 00000100:00100000:3.0:1746065125.294450:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881261117568:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26082us (26629us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.294460:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5029 00002000:00100000:3.0:1746065125.294468:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012b45d500 x1830881261117568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.294477:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d500 with x1830881261117568 ext(3145728->4194303) 00002000:00010000:3.0:1746065125.294482:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45d500 00000100:00100000:2.0:1746065125.295517:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881261117312:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27548us (30102us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.295525:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5028 00002000:00100000:2.0:1746065125.295532:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012b45f480 x1830881261117312/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.295540:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f480 with x1830881261117312 ext(2097152->3145727) 00002000:00010000:2.0:1746065125.295544:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45f480 00000100:00100000:0.0:1746065125.302571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.302663:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261118080 00000100:00100000:2.0:1746065125.302671:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261118080 00002000:00100000:2.0:1746065125.302709:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012b45ce00 x1830881261118080/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.302718:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ce00 with x1830881261118080 ext(4194304->5029887) 00002000:00010000:2.0:1746065125.302723:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45ce00 00000100:00100000:2.0:1746065125.302755:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5030 00000100:00100000:2.0:1746065125.302761:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881261118080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065125.309347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.309926:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881261118080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7163us (7361us total) trans 0 rc 835584/835584 00000100:00100000:2.0:1746065125.309937:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5030 00002000:00100000:2.0:1746065125.309947:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012b45ce00 x1830881261118080/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.309955:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ce00 with x1830881261118080 ext(4194304->5029887) 00002000:00010000:2.0:1746065125.309961:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45ce00 00000100:00100000:2.0:1746065125.309982:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261118336 00000100:00100000:2.0:1746065125.309988:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261118336 00002000:00100000:2.0:1746065125.310012:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012b45fb80 x1830881261118336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.310018:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45fb80 with x1830881261118336 ext(4194304->5029887) 00002000:00010000:2.0:1746065125.310020:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45fb80 00000100:00100000:2.0:1746065125.310034:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5031 00000100:00100000:2.0:1746065125.310040:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261118336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.315382:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261118336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5330us (6032us total) trans 0 rc 835584/835584 00000100:00100000:2.0:1746065125.315394:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5031 00002000:00100000:2.0:1746065125.315408:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012b45fb80 x1830881261118336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.315416:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45fb80 with x1830881261118336 ext(4194304->5029887) 00002000:00010000:2.0:1746065125.315422:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45fb80 00000100:00100000:0.0:1746065125.320473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.320559:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261118592 00000100:00100000:3.0:1746065125.320569:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261118592 00000100:00100000:3.0:1746065125.320633:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3711 00000100:00100000:3.0:1746065125.320643:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29071:x1830881261118592:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065125.320952:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29071:x1830881261118592:12345-192.168.202.46@tcp:35:cat.0 Request processed in 308us (483us total) trans 8589943132 rc 0/0 00000100:00100000:3.0:1746065125.320960:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3711 00000100:00100000:0.0:1746065125.328518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.328586:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261118848 00000100:00100000:3.0:1746065125.328594:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261118848 00000100:00100000:3.0:1746065125.328644:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9076 00000100:00100000:3.0:1746065125.328652:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29067:x1830881261118848:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065125.328675:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.328678:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065125.328700:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f39d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b51f expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.328729:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.328733:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065125.328746:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3a2a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b557 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.328786:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.328797:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a1 expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.328808:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a8 expref: 7 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.329164:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e7 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.329172:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.329196:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e7 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.329206:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e7 expref: 10 pid: 14644 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.329217:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259762048:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.329360:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a8 expref: 7 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.329495:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a8 expref: 7 pid: 14643 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.329504:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259762176:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.329543:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a1 expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.329549:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a1 expref: 7 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.329557:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259762304:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.329573:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.330535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.330581:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261118976 00000100:00100000:2.0:1746065125.330587:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261118976 00010000:00010000:2.0:1746065125.330609:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e7 expref: 11 pid: 14644 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.330615:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259762048:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.330649:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5471 00000100:00100000:2.0:1746065125.330683:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261118976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.330692:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.330696:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e7 expref: 11 pid: 14644 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.330704:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e7 expref: 11 pid: 14644 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.330718:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7cc00/0x14b4f8542d4f397b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4e7 expref: 11 pid: 14644 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.330742:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.330745:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.330751:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.330756:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.330779:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881261118976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.330786:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5471 00000100:00100000:0.0:1746065125.330963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.330987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.331004:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261119104 00000100:00100000:1.0:1746065125.331008:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261119104 00000100:00100000:2.0:1746065125.331100:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261119232 00000100:00100000:2.0:1746065125.331103:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261119232 00010000:00010000:2.0:1746065125.331115:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a8 expref: 9 pid: 14643 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.331117:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259762176:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.331124:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259762304:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.331133:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5472 00000100:00100000:2.0:1746065125.331138:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261119232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.331143:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.331145:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.331146:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a8 expref: 9 pid: 14643 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.331154:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a8 expref: 9 pid: 14643 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.331165:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4f38fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a8 expref: 9 pid: 14643 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.331173:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.331175:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.331180:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.331183:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065125.331206:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a1 expref: 8 pid: 24350 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.331228:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5473 00000100:00100000:1.0:1746065125.331234:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261119104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065125.331240:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065125.331243:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a1 expref: 8 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.331250:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a1 expref: 8 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.331258:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b163200/0x14b4f8542d4f38ef lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4a1 expref: 8 pid: 24350 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746065125.331281:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.331284:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065125.331290:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065125.331295:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065125.331324:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065125.331343:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261119104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 108us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.331348:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5473 00010000:00010000:3.0:1746065125.331367:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.331373:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065125.331415:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261119232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 276us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.331420:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5472 00000040:00080000:3.0:1746065125.331943:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2575, 88 off216424 00000004:00080000:3.0:1746065125.331949:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724623133426ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065125.331988:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2510, 88 off210520 00000004:00080000:3.0:1746065125.331992:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724623176248ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065125.332012:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2511, 88 off210608 00000004:00080000:3.0:1746065125.332015:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724623199366ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065125.332022:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2576, 88 off216512 00000004:00080000:3.0:1746065125.332024:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724623208924ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065125.332031:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2577, 88 off216600 00000004:00080000:3.0:1746065125.332033:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724623217506ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065125.332679:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2512, 88 off210696 00000004:00080000:3.0:1746065125.332684:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724623868906ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065125.332702:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2513, 88 off210784 00000004:00080000:3.0:1746065125.332704:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724623888994ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065125.332711:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2514, 88 off210872 00000004:00080000:3.0:1746065125.332713:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724623898058ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065125.332721:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2578, 88 off216688 00000004:00080000:3.0:1746065125.332723:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724623908205ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065125.332742:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2515, 88 off210960 00000004:00080000:3.0:1746065125.332745:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724623930101ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065125.332752:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2579, 88 off216776 00000004:00080000:3.0:1746065125.332754:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724623938551ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065125.332760:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2516, 88 off211048 00000004:00080000:3.0:1746065125.332762:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724623946513ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065125.332768:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2580, 88 off216864 00000004:00080000:3.0:1746065125.332770:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724623954516ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065125.332775:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2581, 88 off216952 00000004:00080000:3.0:1746065125.332778:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724623962588ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065125.332783:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2582, 88 off217040 00000004:00080000:3.0:1746065125.332786:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724623970474ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065125.332792:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2583, 88 off217128 00000004:00080000:3.0:1746065125.332795:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 724623979126ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065125.332801:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2517, 88 off211136 00000004:00080000:3.0:1746065125.332803:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724623988106ns, next at 666938887344ns, rc = 0 00010000:00010000:3.0:1746065125.352927:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.352939:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.352942:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065125.352954:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3a2a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 253 pid: 14644 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065125.352968:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.352993:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.352995:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065125.352997:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133084e00, rc 0) 00000100:00100000:3.0:1746065125.353046:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29067:x1830881261118848:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 24394us (24534us total) trans 8589943133 rc 0/0 00000100:00100000:3.0:1746065125.353053:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9076 00000001:00080000:3.0:1746065125.353082:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943129 is committed 00000001:00080000:3.0:1746065125.353097:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943127 is committed 00000001:00080000:3.0:1746065125.353102:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943133 is committed 00000004:00080000:3.0:1746065125.353106:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1810 committed 00000004:00080000:3.0:1746065125.353468:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1876 committed 00000004:00080000:3.0:1746065125.353482:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1875 committed 00000004:00080000:3.0:1746065125.353484:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1874 committed 00000004:00080000:3.0:1746065125.353486:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1873 committed 00000004:00080000:3.0:1746065125.353487:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1809 committed 00000004:00080000:3.0:1746065125.353489:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1872 committed 00000004:00080000:3.0:1746065125.353490:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1808 committed 00000004:00080000:3.0:1746065125.353492:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1871 committed 00000004:00080000:3.0:1746065125.353493:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1807 committed 00000004:00080000:3.0:1746065125.353494:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1806 committed 00000004:00080000:3.0:1746065125.353496:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1805 committed 00000004:00080000:3.0:1746065125.353497:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1870 committed 00000004:00080000:3.0:1746065125.353499:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1869 committed 00000004:00080000:3.0:1746065125.353500:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1804 committed 00000004:00080000:3.0:1746065125.353502:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1803 committed 00000004:00080000:3.0:1746065125.353504:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1868 committed 00000001:00080000:3.0:1746065125.353511:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943131 is committed 00000100:00100000:3.0:1746065125.353640:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259762432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.353697:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.353727:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259762432 00000100:00100000:3.0:1746065125.353732:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259762432 00000100:00100000:3.0:1746065125.353757:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10990 00000100:00100000:3.0:1746065125.353762:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881259762432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.353844:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259762560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.353868:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.353886:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259762816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.353901:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065125.353922:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065125.353926:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065125 -> 1746065125 00000100:00100000:1.0:1746065125.353926:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259762560 00002000:00010000:3.0:1746065125.353928:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065125 -> 1746065125 00000100:00100000:1.0:1746065125.353929:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259762560 00002000:00010000:3.0:1746065125.353930:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065125 -> 1746065125 00002000:00010000:3.0:1746065125.353931:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:1.0:1746065125.353946:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259762816 00000100:00100000:1.0:1746065125.353948:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259762816 00000100:00100000:3.0:1746065125.353954:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3296:x1830881259762432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (257us total) trans 17179872865 rc 0/0 00000100:00100000:1.0:1746065125.353958:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10991 00000100:00100000:3.0:1746065125.353961:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10990 00000100:00100000:1.0:1746065125.353962:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881259762560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065125.353971:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10992 00000100:00100000:3.0:1746065125.353976:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881259762816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065125.354090:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065125.354093:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065125.354095:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065125.354097:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065125.354099:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065125.354117:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3297:x1830881259762560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 155us (249us total) trans 21474840090 rc 0/0 00000100:00100000:1.0:1746065125.354122:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10991 00002000:00010000:3.0:1746065125.354219:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065125.354222:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065125 -> 1746065125 00002000:00010000:3.0:1746065125.354224:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065125 -> 1746065125 00002000:00010000:3.0:1746065125.354225:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065125 -> 1746065125 00002000:00010000:3.0:1746065125.354227:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746065125.354262:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3295:x1830881259762816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 285us (359us total) trans 21474840091 rc 0/0 00000100:00100000:3.0:1746065125.354270:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10992 00000004:00080000:3.0:1746065125.354758:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a1880/2, rc 0, transno 17179872865 00000004:00080000:1.0:1746065125.354867:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90af800/2, rc 0, transno 21474840090 00000100:00100000:1.0:1746065125.354872:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259762560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.354878:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259763072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.354896:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.354919:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259763584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.354935:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.354948:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259764096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.354958:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.354965:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259762432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.354968:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746065125.354972:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259762688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065125.354975:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259762944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.354983:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.354993:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259763200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.354994:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.355006:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.355009:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259763456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.355017:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259763712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.355023:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.355034:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259763072 00000100:00100000:1.0:1746065125.355037:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259763072 00000100:00100000:3.0:1746065125.355039:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259763968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065125.355050:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.355051:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259763584 00000100:00100000:1.0:1746065125.355052:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259763584 00000100:00100000:1.0:1746065125.355058:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259764096 00000100:00100000:1.0:1746065125.355059:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259764096 00000100:00100000:3.0:1746065125.355061:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746065125.355065:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259763840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.355065:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259762688 00000100:00100000:1.0:1746065125.355066:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259762688 00000100:00100000:1.0:1746065125.355072:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259762944 00000100:00100000:1.0:1746065125.355073:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259762944 00000100:00100000:3.0:1746065125.355078:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.355079:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259763200 00000100:00100000:1.0:1746065125.355080:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259763200 00000100:00100000:3.0:1746065125.355085:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259764352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.355087:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10993 00000100:00100000:1.0:1746065125.355091:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3297:x1830881259763072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.355095:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.355108:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259763456 00000100:00100000:3.0:1746065125.355111:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259763456 00000100:00100000:3.0:1746065125.355122:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259763968 00000100:00100000:3.0:1746065125.355124:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259763968 00000100:00100000:3.0:1746065125.355130:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259763840 00000100:00100000:3.0:1746065125.355131:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259763840 00000100:00100000:3.0:1746065125.355136:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259764352 00000100:00100000:3.0:1746065125.355137:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259764352 00000100:00100000:3.0:1746065125.355144:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10994 00000100:00100000:3.0:1746065125.355148:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3297:x1830881259763584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.355160:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10995 00000100:00100000:3.0:1746065125.355163:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3297:x1830881259764096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065125.355167:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:1.0:1746065125.355169:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065125 -> 1746065125 00002000:00010000:1.0:1746065125.355171:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065125 -> 1746065125 00002000:00010000:1.0:1746065125.355172:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065125 -> 1746065125 00002000:00010000:1.0:1746065125.355173:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5801 -> 5801 00000100:00100000:1.0:1746065125.355188:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881259763072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (292us total) trans 17179872866 rc 0/0 00000100:00100000:1.0:1746065125.355191:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10993 00000100:00100000:1.0:1746065125.355198:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10996 00000100:00100000:1.0:1746065125.355201:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3297:x1830881259762688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065125.355230:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10997 00000100:00100000:3.0:1746065125.355234:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881259762944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065125.355300:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065125.355303:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065125 -> 1746065125 00002000:00010000:3.0:1746065125.355305:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:3.0:1746065125.355306:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065125 -> 1746065125 00002000:00010000:3.0:1746065125.355308:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065125.355323:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10998 00000100:00100000:1.0:1746065125.355328:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881259763200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.355343:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881259762944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (347us total) trans 17179872867 rc 0/0 00000100:00100000:3.0:1746065125.355348:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10997 00000100:00100000:3.0:1746065125.355358:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10999 00000100:00100000:3.0:1746065125.355362:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881259763456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065125.355387:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065125.355388:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065125.355389:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065125.355390:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065125.355391:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065125.355405:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881259763200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (398us total) trans 17179872868 rc 0/0 00000100:00100000:1.0:1746065125.355408:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10998 00002000:00010000:3.0:1746065125.355421:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1746065125.355422:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11000 00002000:00010000:3.0:1746065125.355423:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.355425:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746065125.355425:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259763968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065125.355426:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.355428:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1746065125.355438:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5883b80/2, rc 0, transno 21474840091 00000100:00100000:1.0:1746065125.355440:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259762816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.355444:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259763328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.355447:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881259763456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (423us total) trans 17179872869 rc 0/0 00000100:00100000:3.0:1746065125.355452:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10999 00000100:00100000:1.0:1746065125.355454:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065125.355461:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259763328 00000100:00100000:3.0:1746065125.355463:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259763328 00000100:00100000:2.0:1746065125.355463:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11001 00000100:00100000:1.0:1746065125.355469:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11002 00000100:00100000:1.0:1746065125.355472:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259764352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065125.355474:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11003 00000100:00100000:2.0:1746065125.355477:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259763840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065125.355478:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881259763328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.355478:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065125.355482:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259764224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.355490:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065125.355496:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a1c00/2, rc 0, transno 17179872866 00000100:00100000:1.0:1746065125.355498:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259763072:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065125.355502:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46f480/2, rc 0, transno 17179872868 00000100:00100000:1.0:1746065125.355504:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259763200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.356064:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065125.356070:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259764480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.356086:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065125.356186:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065125.356189:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.356190:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.356191:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.356193:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065125.356214:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259763328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 736us (758us total) trans 17179872870 rc 0/0 00000100:00100000:3.0:1746065125.356219:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11003 00000004:00080000:1.0:1746065125.356225:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4ea680/2, rc 0, transno 17179872870 00000100:00100000:3.0:1746065125.356228:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259763712 00000100:00100000:1.0:1746065125.356228:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259763328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.356230:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259763712 00000100:00100000:3.0:1746065125.356237:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259764224 00000100:00100000:3.0:1746065125.356239:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259764224 00000100:00100000:3.0:1746065125.356244:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259764480 00000100:00100000:3.0:1746065125.356246:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259764480 00000100:00100000:3.0:1746065125.356252:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11004 00000100:00100000:3.0:1746065125.356255:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259763712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.356351:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259763712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (871us total) trans 17179872871 rc 0/0 00000100:00100000:3.0:1746065125.356356:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11004 00000100:00100000:3.0:1746065125.356365:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11005 00000100:00100000:3.0:1746065125.356370:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259764224:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065125.356375:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4eaa00/2, rc 0, transno 17179872871 00000100:00100000:1.0:1746065125.356379:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259763712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.356381:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11006 00000100:00100000:3.0:1746065125.356384:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830881259764480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.356460:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881259764480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (372us total) trans 17179872872 rc 0/0 00000100:00100000:3.0:1746065125.356465:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11006 00000004:00080000:1.0:1746065125.356471:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095353b80/2, rc 0, transno 17179872872 00000100:00100000:1.0:1746065125.356475:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259764480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065125.356557:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259763584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1408us (1620us total) trans 17179872873 rc 0/0 00000100:00100000:3.0:1746065125.356565:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10994 00000004:00080000:1.0:1746065125.356569:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4e8e00/2, rc 0, transno 17179872873 00000100:00100000:1.0:1746065125.356573:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259763584:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065125.356709:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065125.356712:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.356714:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.356715:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.356716:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746065125.356734:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065125.356736:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065124 -> 1746065124 00000100:00100000:3.0:1746065125.356738:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259764096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1574us (1778us total) trans 21474840092 rc 0/0 00002000:00010000:1.0:1746065125.356738:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065123 -> 1746065123 00002000:00010000:1.0:1746065125.356740:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065125.356742:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065125.356743:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10995 00000100:00100000:1.0:1746065125.356761:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259762688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1559us (1776us total) trans 21474840093 rc 0/0 00000100:00100000:1.0:1746065125.356766:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10996 00000004:00080000:3.0:1746065125.356770:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a1500/2, rc 0, transno 17179872867 00000100:00100000:3.0:1746065125.356774:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259762944:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065125.356781:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4e8700/2, rc 0, transno 17179872869 00000100:00100000:3.0:1746065125.356783:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259763456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065125.356911:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881259764352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1437us (1814us total) trans 21474840095 rc 0/0 00000100:00100000:2.0:1746065125.356915:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881259763840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1443us (1835us total) trans 21474840096 rc 0/0 00000100:00100000:1.0:1746065125.356916:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11002 00000100:00100000:2.0:1746065125.356920:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11001 00000004:00080000:3.0:1746065125.356924:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5881500/2, rc 0, transno 21474840096 00000100:00100000:3.0:1746065125.356928:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259763840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065125.356936:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880380/2, rc 0, transno 21474840095 00000004:00080000:1.0:1746065125.356936:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90adc00/2, rc 0, transno 21474840093 00000100:00100000:3.0:1746065125.356939:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259764352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065125.356940:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259762688:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065125.356947:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5882a00/2, rc 0, transno 21474840092 00000100:00100000:1.0:1746065125.356949:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259764096:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065125.357005:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065125.357007:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.357009:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.357010:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065125.357012:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1746065125.357037:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065125.357040:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065125.357042:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065125.357043:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065125.357045:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:3.0:1746065125.357050:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881259764224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 680us (1558us total) trans 21474840097 rc 0/0 00000100:00100000:3.0:1746065125.357054:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11005 00000100:00100000:0.0:1746065125.357065:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259763968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1639us (2014us total) trans 21474840094 rc 0/0 00000100:00100000:0.0:1746065125.357070:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11000 00000004:00080000:3.0:1746065125.357072:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880e00/2, rc 0, transno 21474840094 00000100:00100000:3.0:1746065125.357076:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259763968:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065125.357123:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5882680/2, rc 0, transno 21474840097 00000100:00100000:1.0:1746065125.357126:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259764224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065125.359702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.359782:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261119360 00000100:00100000:3.0:1746065125.359788:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261119360 00000100:00100000:0.0:1746065125.360617:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9077 00000100:00100000:0.0:1746065125.360626:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+7:29073:x1830881261119360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065125.360645:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065125.360660:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b55e expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.360705:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b55e expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.360718:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b55e expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.360731:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065125.360734:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065125.360737:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b464c00, rc 0) 00000100:00100000:0.0:1746065125.360781:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:29073:x1830881261119360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 157us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.360787:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9077 00000100:00100000:0.0:1746065125.365603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.365848:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261119488 00000100:00100000:2.0:1746065125.365855:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261119488 00000100:00100000:2.0:1746065125.365905:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11007 00000100:00100000:2.0:1746065125.365912:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:29067:x1830881261119488:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065125.365927:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.365941:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b565 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.365963:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4bd expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.365970:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b534 expref: 20 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.365976:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4fc expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.365981:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.365983:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.365986:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1179648->2097151] (req 1179648->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.366008:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4fc expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.366018:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4fc expref: 9 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.366027:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259764608:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.366116:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b534 expref: 20 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.366123:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b534 expref: 20 pid: 8427 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.366130:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259764736:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.366148:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4bd expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.366155:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4bd expref: 8 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.366161:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259764864:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.366173:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.368028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.368047:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259764608:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065125.368051:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.368057:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259764736:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.368064:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259764864:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065125.368077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065125.368081:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1179648->2097151] (req 1179648->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.368097:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8de800, rc 0) 00000100:00100000:2.0:1746065125.368122:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:29067:x1830881261119488:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2211us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.368128:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11007 00000100:00100000:3.0:1746065125.368136:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261119616 00000100:00100000:3.0:1746065125.368140:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261119616 00010000:00010000:3.0:1746065125.368159:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4fc expref: 10 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.368182:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261119744 00000100:00100000:1.0:1746065125.368232:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261119872 00000100:00100000:1.0:1746065125.368236:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261119872 00010000:00010000:1.0:1746065125.368251:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4bd expref: 9 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.368256:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5474 00000100:00100000:2.0:1746065125.368262:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261119616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065125.368268:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5475 00010000:00010000:2.0:1746065125.368271:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065125.368273:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881261119872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065125.368279:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.368287:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4fc expref: 10 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065125.368288:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4bd expref: 9 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.368296:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4fc expref: 10 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.368323:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261119744 00010000:00010000:3.0:1746065125.368336:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b534 expref: 20 pid: 8427 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.368354:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5476 00000100:00100000:3.0:1746065125.368359:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881261119744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.368365:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065125.368394:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4bd expref: 9 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065125.368414:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e8000/0x14b4f8542d4f3920 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4bd expref: 9 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.368427:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3990 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4fc expref: 10 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065125.368428:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065125.368429:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b534 expref: 20 pid: 8427 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.368438:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b534 expref: 20 pid: 8427 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.368443:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881261119872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 170us (366us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065125.368444:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065125.368448:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5475 00010000:00010000:3.0:1746065125.368451:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15cc00/0x14b4f8542d4f39eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b534 expref: 20 pid: 8427 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.368460:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261119616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 198us (435us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065125.368464:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.368465:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065125.368465:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5474 00010000:00010000:3.0:1746065125.368471:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.369042:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.369067:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.369076:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259764992:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065125.369138:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065125.373626:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259764992:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065125.373647:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.373690:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881261119744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5329us (5636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.373699:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5476 00000100:00100000:1.0:1746065125.373845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.373895:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261120128 00000100:00100000:2.0:1746065125.373901:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261120128 00002000:00100000:2.0:1746065125.373930:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1179648->1183743) req@ffff880095350380 x1830881261120128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.373945:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350380 with x1830881261120128 ext(1179648->1183743) 00002000:00010000:2.0:1746065125.373949:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350380 00000100:00100000:3.0:1746065125.374005:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5032 00000100:00100000:3.0:1746065125.374012:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881261120128:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065125.374146:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881261120128:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 134us (302us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065125.374152:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5032 00002000:00100000:3.0:1746065125.374157:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1179648->1183743) req@ffff880095350380 x1830881261120128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.374164:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350380 with x1830881261120128 ext(1179648->1183743) 00002000:00010000:3.0:1746065125.374167:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350380 00000100:00100000:0.0:1746065125.374606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.374651:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261120256 00000100:00100000:2.0:1746065125.374655:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261120256 00000100:00100000:2.0:1746065125.374687:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11008 00000100:00100000:2.0:1746065125.374693:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:29073:x1830881261120256:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065125.374702:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.374714:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b56c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.374735:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4cb expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.374743:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b542 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.374750:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b50a expref: 15 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.374756:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.374758:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.374761:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2281472->2981887] (req 2281472->2981887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.374783:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b50a expref: 15 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.374797:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b50a expref: 15 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.374808:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765120:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.374900:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b542 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.374908:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b542 expref: 28 pid: 8427 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.374916:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765248:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.375179:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4cb expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.375188:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4cb expref: 7 pid: 8428 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.375196:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765376:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.375217:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.379019:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765120:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.379031:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765248:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065125.379287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.379349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.379416:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261120512 00000100:00100000:3.0:1746065125.379421:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261120512 00010000:00010000:3.0:1746065125.379448:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b542 expref: 29 pid: 8427 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.379469:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261120384 00000100:00100000:3.0:1746065125.379472:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261120384 00010000:00010000:3.0:1746065125.379482:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b50a expref: 16 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.379496:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5477 00000100:00100000:3.0:1746065125.379502:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261120512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.379511:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.379527:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b542 expref: 29 pid: 8427 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.379537:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b542 expref: 29 pid: 8427 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.379554:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b15ce00/0x14b4f8542d4f39f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b542 expref: 29 pid: 8427 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.379571:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.379609:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261120512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.379615:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5477 00000100:00100000:3.0:1746065125.379629:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5478 00000100:00100000:3.0:1746065125.379634:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881261120384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.379640:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.379647:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b50a expref: 16 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.379655:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b50a expref: 16 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.379665:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938e5600/0x14b4f8542d4f399e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b50a expref: 16 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.379673:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.379688:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261120384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.379692:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5478 00000100:00100000:0.0:1746065125.380598:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765376:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065125.380620:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2281472->2981887] (req 2281472->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.380634:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0da00, rc 0) 00000100:00100000:0.0:1746065125.380666:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:29073:x1830881261120256:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5973us (6061us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.380672:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11008 00000100:00100000:0.0:1746065125.382431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.382477:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261120640 00000100:00100000:2.0:1746065125.382483:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261120640 00000100:00100000:0.0:1746065125.382491:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065125.382505:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4cb expref: 8 pid: 8428 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.382540:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5479 00000100:00100000:1.0:1746065125.382541:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261120768 00000100:00100000:1.0:1746065125.382545:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261120768 00000100:00100000:2.0:1746065125.382546:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261120640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.382557:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065125.382565:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11009 00000100:00100000:1.0:1746065125.382570:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:29067:x1830881261120768:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065125.382571:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4cb expref: 8 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.382581:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4cb expref: 8 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065125.382581:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.382595:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4f3927 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4cb expref: 8 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065125.382597:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b573 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.382609:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.382611:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.382616:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.382618:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4c4 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.382623:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.382626:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b53b expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.382633:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b503 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.382644:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.382654:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259765504:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065125.382707:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9180 going to sleep for 11 seconds 00010000:00010000:1.0:1746065125.382784:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.382786:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.382789:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1048576->1138687] (req 1048576->1138687) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.382806:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b503 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.382852:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b503 expref: 13 pid: 21235 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.382861:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765632:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.382895:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b53b expref: 29 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.382902:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b53b expref: 29 pid: 8427 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.382908:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765760:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.382923:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4c4 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.382929:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4c4 expref: 7 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.382936:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765888:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.382944:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.386064:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259765504:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065125.386065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065125.386080:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065125.386089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.386113:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261120640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3567us (3684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.386122:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5479 00000100:00100000:1.0:1746065125.386129:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765632:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065125.386170:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261121152 00000100:00100000:2.0:1746065125.386174:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261121152 00010000:00010000:2.0:1746065125.386191:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b503 expref: 14 pid: 21235 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.386209:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5480 00000100:00100000:2.0:1746065125.386214:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:1958:x1830881261121152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.386224:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065125.386232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065125.386240:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b503 expref: 14 pid: 21235 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.386249:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b503 expref: 14 pid: 21235 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746065125.386252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065125.386266:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133085200/0x14b4f8542d4f3997 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b503 expref: 14 pid: 21235 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.386275:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.386292:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881261121152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.386301:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5480 00000100:00100000:2.0:1746065125.386308:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261121408 00000100:00100000:2.0:1746065125.386326:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261121408 00010000:00010000:2.0:1746065125.386336:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4c4 expref: 7 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.386339:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261121280 00000100:00100000:3.0:1746065125.386343:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261121280 00010000:00010000:3.0:1746065125.386361:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b53b expref: 30 pid: 8427 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.386363:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5481 00000100:00100000:2.0:1746065125.386368:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261121408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.386374:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065125.386378:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5482 00000100:00100000:1.0:1746065125.386379:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765760:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.386381:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4c4 expref: 7 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.386383:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261121280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065125.386387:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259765888:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.386389:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.386389:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4c4 expref: 7 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.386400:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b7d600/0x14b4f8542d4f390b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4c4 expref: 7 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.386448:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b53b expref: 30 pid: 8427 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.386458:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b53b expref: 30 pid: 8427 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.386469:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b15d200/0x14b4f8542d4f39f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b53b expref: 30 pid: 8427 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.386473:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.386475:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.386481:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.386762:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.386931:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.386948:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261121280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 565us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.386953:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5482 00010000:00010000:1.0:1746065125.387039:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.387045:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.387048:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a2800, rc 0) 00000100:00100000:2.0:1746065125.387056:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259766016:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065125.387071:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:29067:x1830881261120768:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4501us (4580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.387080:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11009 00000100:00100000:2.0:1746065125.387099:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.387184:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261121024 00000100:00100000:2.0:1746065125.387188:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261121024 00002000:00100000:2.0:1746065125.387209:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2281472->2285567) req@ffff88008fd70000 x1830881261121024/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.387216:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70000 with x1830881261121024 ext(2281472->2285567) 00002000:00010000:2.0:1746065125.387220:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70000 00000100:00100000:2.0:1746065125.387232:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5033 00000100:00100000:2.0:1746065125.387237:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881261121024:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065125.387362:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881261121024:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 125us (1299us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065125.387368:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5033 00002000:00100000:2.0:1746065125.387372:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2281472->2285567) req@ffff88008fd70000 x1830881261121024/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.387378:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70000 with x1830881261121024 ext(2281472->2285567) 00002000:00010000:2.0:1746065125.387381:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70000 00000100:00100000:2.0:1746065125.390566:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259766016:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065125.390584:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.390628:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261121408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4258us (4394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.390636:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5481 00000100:00100000:0.0:1746065125.391920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.391972:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261121664 00000100:00100000:2.0:1746065125.391980:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261121664 00002000:00100000:2.0:1746065125.392011:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1134592->1138687) req@ffff88008fd71f80 x1830881261121664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.392019:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71f80 with x1830881261121664 ext(1134592->1138687) 00002000:00010000:2.0:1746065125.392023:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd71f80 00000100:00100000:2.0:1746065125.392054:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5034 00000100:00100000:2.0:1746065125.392061:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881261121664:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065125.392206:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881261121664:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 144us (288us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065125.392212:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5034 00002000:00100000:2.0:1746065125.392217:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1134592->1138687) req@ffff88008fd71f80 x1830881261121664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.392224:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71f80 with x1830881261121664 ext(1134592->1138687) 00002000:00010000:2.0:1746065125.392227:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd71f80 00000100:00100000:0.0:1746065125.392930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.392950:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261121920 00000100:00100000:2.0:1746065125.392954:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261121920 00002000:00100000:2.0:1746065125.392971:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2977792->2981887) req@ffff88008fd71c00 x1830881261121920/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.392977:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71c00 with x1830881261121920 ext(2977792->2981887) 00002000:00010000:2.0:1746065125.392980:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd71c00 00000100:00100000:2.0:1746065125.393003:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5035 00000100:00100000:2.0:1746065125.393009:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261121920:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065125.393075:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261121920:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 65us (146us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065125.393081:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5035 00002000:00100000:2.0:1746065125.393085:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2977792->2981887) req@ffff88008fd71c00 x1830881261121920/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.393091:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71c00 with x1830881261121920 ext(2977792->2981887) 00002000:00010000:2.0:1746065125.393093:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd71c00 00000100:00100000:0.0:1746065125.393892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.394078:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261122176 00000100:00100000:3.0:1746065125.394083:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261122176 00000100:00100000:3.0:1746065125.394112:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3712 00000100:00100000:3.0:1746065125.394122:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29067:x1830881261122176:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065125.394364:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29067:x1830881261122176:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 241us (472us total) trans 8589943134 rc 0/0 00000100:00100000:3.0:1746065125.394370:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3712 00000100:00100000:2.0:1746065125.395171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.395206:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261122432 00000100:00100000:0.0:1746065125.395210:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261122432 00000100:00100000:0.0:1746065125.395230:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3713 00000100:00100000:0.0:1746065125.395235:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+8:29073:x1830881261122432:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065125.395360:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:29073:x1830881261122432:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 123us (189us total) trans 8589943135 rc 0/0 00000100:00100000:0.0:1746065125.395366:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3713 00000100:00100000:1.0:1746065125.435880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.435984:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261122688 00000100:00100000:3.0:1746065125.435992:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261122688 00000100:00100000:3.0:1746065125.436115:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9078 00000100:00100000:3.0:1746065125.436156:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29080:x1830881261122688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.436176:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.436192:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085200/0x14b4f8542d4f3a54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b57a expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.436275:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436285:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436293:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436305:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436323:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436329:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436416:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436423:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436428:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065125.436591:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065125.436656:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436662:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436666:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436671:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093815a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065125.436673:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436679:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436687:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.436690:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065125.436693:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436697:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a69 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436940:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436945:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436950:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436953:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133085400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065125.436954:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436958:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436964:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065125.436966:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065125.436968:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436971:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085400/0x14b4f8542d4f3a5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436979:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436983:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436987:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436989:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093814a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065125.436991:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436995:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.436999:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800982ac400) 00010000:00010000:3.0:1746065125.437000:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065125.437002:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.437005:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093814a00/0x14b4f8542d4f3a62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.437034:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085200/0x14b4f8542d4f3a54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b57a expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.437040:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085200/0x14b4f8542d4f3a54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b57a expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.437046:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085200, rc 0) 00000100:00100000:3.0:1746065125.437353:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29080:x1830881261122688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1229us (1477us total) trans 8589943136 rc 301/301 00000100:00100000:3.0:1746065125.437359:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9078 00000100:00100000:0.0:1746065125.440966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.441094:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261122816 00000100:00100000:3.0:1746065125.441106:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261122816 00000100:00100000:3.0:1746065125.441143:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9079 00000100:00100000:3.0:1746065125.441151:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29080:x1830881261122816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.441171:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.441184:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a77 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b581 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.441250:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.441261:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.441270:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065125.441291:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065125.441295:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065125.441304:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065125.441337:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093815a00/0x14b4f8542d4f3a77 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b581 expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.441360:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b581 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.441372:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065125.441374:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065125.441377:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a11b600, rc 0) 00000100:00100000:3.0:1746065125.441411:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29080:x1830881261122816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 261us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.441416:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9079 00000100:00100000:0.0:1746065125.443559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.443866:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261122944 00000100:00100000:1.0:1746065125.443874:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261122944 00000100:00100000:1.0:1746065125.443923:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11010 00000100:00100000:1.0:1746065125.443930:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881261122944:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.443944:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.443962:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4f3a85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b588 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.444005:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259766144:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065125.444574:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b19c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746065125.445763:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065125 -> 1746065126 00002000:00010000:1.0:1746065125.445768:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065125 -> 1746065126 00000100:00100000:1.0:1746065125.445786:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259766144:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065125.446009:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4f3a85 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b588 expref: 29 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.446023:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4f3a85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b588 expref: 29 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.446035:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596c600, rc 0) 00000100:00100000:1.0:1746065125.446072:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881261122944:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2141us (2518us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065125.446078:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11010 00000100:00100000:0.0:1746065125.453215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.453259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.453288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.453341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.453418:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261123200 00000100:00100000:2.0:1746065125.453425:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261123200 00002000:00100000:2.0:1746065125.453460:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88008fd70380 x1830881261123200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.453470:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70380 with x1830881261123200 ext(0->1048575) 00002000:00010000:2.0:1746065125.453475:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70380 00000100:00100000:2.0:1746065125.453489:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261123456 00000100:00100000:2.0:1746065125.453491:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261123456 00000100:00100000:1.0:1746065125.453500:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261123712 00002000:00100000:2.0:1746065125.453502:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012bd3ed80 x1830881261123456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065125.453505:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261123712 00002000:00100000:2.0:1746065125.453508:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3ed80 with x1830881261123456 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.453511:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3ed80 00000100:00100000:2.0:1746065125.453519:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261123968 00000100:00100000:2.0:1746065125.453521:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261123968 00002000:00100000:1.0:1746065125.453522:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1179647) req@ffff88012bd3c000 x1830881261123712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.453529:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1138688->2097151) req@ffff88012d137b80 x1830881261123968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.453529:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c000 with x1830881261123712 ext(1048576->1179647) 00002000:00010000:1.0:1746065125.453532:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3c000 00002000:00100000:2.0:1746065125.453535:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137b80 with x1830881261123968 ext(1138688->2097151) 00002000:00010000:2.0:1746065125.453537:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d137b80 00000100:00100000:1.0:1746065125.453547:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5036 00000100:00100000:1.0:1746065125.453553:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261123200:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.454265:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5037 00000100:00100000:2.0:1746065125.454274:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881261123456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.454483:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5038 00000100:00100000:3.0:1746065125.454499:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881261123712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.454536:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5039 00000100:00100000:2.0:1746065125.454542:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261123968:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.459671:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881261123712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5164us (6373us total) trans 0 rc 131072/131072 00000100:00100000:3.0:1746065125.459681:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5038 00002000:00100000:3.0:1746065125.459692:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1179647) req@ffff88012bd3c000 x1830881261123712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 131072/131072 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.459700:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c000 with x1830881261123712 ext(1048576->1179647) 00002000:00010000:3.0:1746065125.459704:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3c000 00000100:00100000:1.0:1746065125.463003:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261123200:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9441us (9819us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065125.463018:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5036 00002000:00100000:1.0:1746065125.463027:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88008fd70380 x1830881261123200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.463036:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70380 with x1830881261123200 ext(0->1048575) 00002000:00010000:1.0:1746065125.463040:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70380 00000100:00100000:3.0:1746065125.466305:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261123968:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11756us (12957us total) trans 0 rc 958464/958464 00000100:00100000:3.0:1746065125.466325:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5039 00000100:00100000:2.0:1746065125.466870:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881261123456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12596us (13609us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.466880:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5037 00002000:00100000:2.0:1746065125.466889:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012bd3ed80 x1830881261123456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.466896:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3ed80 with x1830881261123456 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.466901:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3ed80 00002000:00100000:3.0:1746065125.466952:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1138688->2097151) req@ffff88012d137b80 x1830881261123968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.466959:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137b80 with x1830881261123968 ext(1138688->2097151) 00002000:00010000:3.0:1746065125.466961:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d137b80 00000100:00100000:0.0:1746065125.473558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.473657:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261124096 00000100:00100000:1.0:1746065125.473666:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261124096 00000100:00100000:1.0:1746065125.473715:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11011 00000100:00100000:1.0:1746065125.473721:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:29080:x1830881261124096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.473735:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.473750:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b58f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.473772:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.473783:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065125.473784:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065125.473787:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.473842:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.473853:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 12 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.473863:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259766272:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.473952:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065125.475079:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259766272:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.475100:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.475110:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b97aa00, rc 0) 00000100:00100000:1.0:1746065125.475134:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:29080:x1830881261124096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1413us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.475141:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11011 00000100:00100000:0.0:1746065125.476330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.476379:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261124224 00000100:00100000:3.0:1746065125.476387:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261124224 00002000:00100000:3.0:1746065125.476417:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (2281472->2981887) req@ffff88012d137800 x1830881261124224/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.476426:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137800 with x1830881261124224 ext(2281472->2981887) 00010000:00010000:3.0:1746065125.476432:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 13 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.476444:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 13 pid: 8851 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746065125.476450:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d137800 00000100:00100000:3.0:1746065125.476476:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1537 00000100:00100000:3.0:1746065125.476481:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881261124224:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065125.488180:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261124224:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 11689us (11843us total) trans 17179872874 rc 0/0 00000100:00100000:2.0:1746065125.488191:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1537 00002000:00100000:2.0:1746065125.488201:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (2281472->2981887) req@ffff88012d137800 x1830881261124224/t17179872874(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.488210:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137800 with x1830881261124224 ext(2281472->2981887) 00010000:00010000:2.0:1746065125.488218:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 15 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.488233:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 15 pid: 8851 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746065125.488239:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d137800 00000100:00100000:0.0:1746065125.491038:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.491096:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261124352 00000100:00100000:2.0:1746065125.491105:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261124352 00010000:00010000:2.0:1746065125.491134:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 15 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065125.491164:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5483 00000100:00100000:2.0:1746065125.491170:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881261124352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.491182:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.491197:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 15 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.491207:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 15 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.491226:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e0da00/0x14b4f8542d4f3a46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2281472->2981887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b56c expref: 15 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.491252:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.491254:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.491259:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.491267:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.491291:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.491300:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259766400:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065125.491376:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.492871:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259766400:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065125.492889:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.492922:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:1959:x1830881261124352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1751us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.492930:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5483 00000100:00100000:0.0:1746065125.503127:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.503169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.503198:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.503281:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.503675:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261124608 00000100:00100000:1.0:1746065125.503683:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261124608 00002000:00100000:1.0:1746065125.503721:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012d134700 x1830881261124608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.503734:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134700 with x1830881261124608 ext(2097152->3145727) 00002000:00010000:1.0:1746065125.503738:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d134700 00000100:00100000:1.0:1746065125.503762:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261124736 00000100:00100000:1.0:1746065125.503765:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261124736 00002000:00100000:1.0:1746065125.503775:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012d136d80 x1830881261124736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.503781:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136d80 with x1830881261124736 ext(3145728->4194303) 00002000:00010000:1.0:1746065125.503783:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d136d80 00000100:00100000:1.0:1746065125.503796:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261125120 00000100:00100000:1.0:1746065125.503798:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261125120 00002000:00100000:1.0:1746065125.503811:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012d135500 x1830881261125120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.503842:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135500 with x1830881261125120 ext(2097152->3145727) 00002000:00010000:1.0:1746065125.503845:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d135500 00000100:00100000:1.0:1746065125.503854:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261125376 00000100:00100000:1.0:1746065125.503856:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261125376 00002000:00100000:1.0:1746065125.503866:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d137480 x1830881261125376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.503872:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137480 with x1830881261125376 ext(3145728->4194303) 00002000:00010000:1.0:1746065125.503874:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d137480 00000100:00100000:1.0:1746065125.503885:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5040 00000100:00100000:1.0:1746065125.503890:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261124608:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.504676:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5041 00000100:00100000:2.0:1746065125.504686:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261124736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.504912:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5042 00000100:00100000:3.0:1746065125.504920:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881261125120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.505031:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5043 00000100:00100000:3.0:1746065125.505036:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881261125376:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065125.516464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.516494:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261125632 00000100:00100000:0.0:1746065125.516500:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261125632 00000100:00100000:0.0:1746065125.516545:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9080 00000100:00100000:0.0:1746065125.516552:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29083:x1830881261125632:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065125.516568:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065125.516584:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad800/0x14b4f8542d4f3a93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b596 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.516674:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516684:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516693:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516703:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516709:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516714:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516800:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516808:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516833:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065125.516842:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065125.516905:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516910:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516915:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516919:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ad33a200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065125.516922:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516928:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516936:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065125.516939:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065125.516942:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516947:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33a200/0x14b4f8542d4f3aa8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516960:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516965:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516972:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516975:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ad33ae00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065125.516977:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516981:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516986:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065125.516988:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065125.516990:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.516994:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33ae00/0x14b4f8542d4f3a9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.517002:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.517006:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.517009:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.517012:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ad33aa00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065125.517014:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.517017:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.517024:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f041e00) 00010000:00010000:0.0:1746065125.517025:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065125.517027:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.517030:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad33aa00/0x14b4f8542d4f3aa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065125.517055:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad800/0x14b4f8542d4f3a93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b596 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.517062:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3ad800/0x14b4f8542d4f3a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b596 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.517070:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3ad800, rc 0) 00000100:00100000:1.0:1746065125.517095:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261124608:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13203us (13974us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065125.517107:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5040 00002000:00100000:1.0:1746065125.517114:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012d134700 x1830881261124608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.517123:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134700 with x1830881261124608 ext(2097152->3145727) 00002000:00010000:1.0:1746065125.517127:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d134700 00000100:00100000:0.0:1746065125.517586:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29083:x1830881261125632:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1033us (1132us total) trans 8589943137 rc 301/301 00000100:00100000:0.0:1746065125.517592:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9080 00000100:00100000:3.0:1746065125.523766:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881261125376:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18722us (20477us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.523776:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5043 00002000:00100000:3.0:1746065125.523786:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d137480 x1830881261125376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.523795:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137480 with x1830881261125376 ext(3145728->4194303) 00002000:00010000:3.0:1746065125.523800:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d137480 00000100:00100000:0.0:1746065125.529067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.529180:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261125888 00000100:00100000:1.0:1746065125.529188:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261125888 00000100:00100000:1.0:1746065125.529226:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9081 00000100:00100000:1.0:1746065125.529233:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:29084:x1830881261125888:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065125.529256:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.529270:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c600/0x14b4f8542d4f3ab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b59d expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.529380:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529391:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529401:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529412:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529417:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529421:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529519:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529526:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529531:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065125.529538:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065125.529600:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529605:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529610:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529615:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a505d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.529624:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529629:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529638:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.529640:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065125.529644:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.529648:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3acb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00000100:00100000:3.0:1746065125.531181:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881261125120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26250us (27970us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.531192:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5042 00002000:00100000:3.0:1746065125.531201:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012d135500 x1830881261125120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.531209:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135500 with x1830881261125120 ext(2097152->3145727) 00002000:00010000:3.0:1746065125.531214:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d135500 00010000:00010000:1.0:1746065125.531532:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531540:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531546:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531550:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a505c400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.531554:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531559:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531570:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065125.531572:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.531575:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531580:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3abd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531590:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531595:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531599:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531602:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a505da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.531606:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531610:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531615:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801331ac200) 00010000:00010000:1.0:1746065125.531617:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.531619:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531623:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ac4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.531662:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c600/0x14b4f8542d4f3ab6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b59d expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.531668:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c600/0x14b4f8542d4f3ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b59d expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.531675:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505c600, rc 0) 00000100:00100000:1.0:1746065125.533963:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:29084:x1830881261125888:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4721us (4895us total) trans 8589943138 rc 301/301 00000100:00100000:1.0:1746065125.533972:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9081 00000100:00100000:0.0:1746065125.537137:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261124736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 32444us (33958us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065125.537148:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5041 00002000:00100000:0.0:1746065125.537159:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012d136d80 x1830881261124736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.537168:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136d80 with x1830881261124736 ext(3145728->4194303) 00002000:00010000:0.0:1746065125.537173:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d136d80 00000100:00100000:2.0:1746065125.538730:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.539083:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261126144 00000100:00100000:1.0:1746065125.539090:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261126144 00000100:00100000:1.0:1746065125.539131:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9082 00000100:00100000:1.0:1746065125.539138:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:29087:x1830881261126144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.539156:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.539169:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5a4 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.539257:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539268:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539277:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539287:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539292:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539298:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539396:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539404:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539409:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065125.539416:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065125.539475:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539480:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539488:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539493:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a505d600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.539495:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539500:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539508:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.539510:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065125.539514:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539518:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d600/0x14b4f8542d4f3aee lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539539:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539544:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539548:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539552:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a505c400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.539554:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539558:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539567:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065125.539569:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.539571:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539575:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505c400/0x14b4f8542d4f3ae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539582:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539586:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539590:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539594:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a505d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.539596:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539601:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539605:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801331ac200) 00010000:00010000:1.0:1746065125.539607:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.539609:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539612:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505d200/0x14b4f8542d4f3ae7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.539641:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ad9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5a4 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.539649:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505da00/0x14b4f8542d4f3ad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5a4 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.539656:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505da00, rc 0) 00000100:00100000:1.0:1746065125.539707:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:29087:x1830881261126144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 568us (981us total) trans 8589943139 rc 301/301 00000100:00100000:1.0:1746065125.539713:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9082 00000100:00100000:0.0:1746065125.544206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.544271:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261126400 00000100:00100000:1.0:1746065125.544279:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261126400 00002000:00100000:1.0:1746065125.544324:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012d136680 x1830881261126400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.544333:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136680 with x1830881261126400 ext(4194304->5029887) 00002000:00010000:1.0:1746065125.544337:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d136680 00000100:00100000:1.0:1746065125.544652:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5044 00000100:00100000:1.0:1746065125.544659:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261126400:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065125.550050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.550113:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261126656 00000100:00100000:3.0:1746065125.550121:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261126656 00000100:00100000:3.0:1746065125.550172:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3714 00000100:00100000:3.0:1746065125.550179:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:29087:x1830881261126656:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065125.550384:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:29087:x1830881261126656:12345-192.168.202.46@tcp:35:cat.0 Request processed in 204us (341us total) trans 8589943140 rc 0/0 00000100:00100000:3.0:1746065125.550391:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3714 00000100:00100000:2.0:1746065125.553129:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261126400:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8462us (8923us total) trans 0 rc 835584/835584 00000100:00100000:2.0:1746065125.553139:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5044 00002000:00100000:2.0:1746065125.553148:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88012d136680 x1830881261126400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.553156:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136680 with x1830881261126400 ext(4194304->5029887) 00002000:00010000:2.0:1746065125.553161:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d136680 00000100:00100000:0.0:1746065125.553287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.554030:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261126784 00000100:00100000:2.0:1746065125.554037:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261126784 00000100:00100000:2.0:1746065125.554077:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9083 00000100:00100000:2.0:1746065125.554082:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:29087:x1830881261126784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065125.554100:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.554113:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4f3afc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5ab expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.554170:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.554182:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.554190:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065125.554212:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065125.554216:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065125.554227:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.554247:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4f3afc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ab expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.554262:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ab expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.554269:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.554272:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065125.554274:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25c600, rc 0) 00000100:00100000:2.0:1746065125.554297:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:29087:x1830881261126784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 215us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.554303:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9083 00000100:00100000:2.0:1746065125.559478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.559527:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261127040 00000100:00100000:0.0:1746065125.559536:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261127040 00000100:00100000:0.0:1746065125.559582:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3715 00000100:00100000:0.0:1746065125.559590:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29080:x1830881261127040:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065125.559789:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:29080:x1830881261127040:12345-192.168.202.46@tcp:35:cat.0 Request processed in 199us (317us total) trans 8589943141 rc 0/0 00000100:00100000:0.0:1746065125.559794:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3715 00000100:00100000:0.0:1746065125.561196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.561266:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261127168 00000100:00100000:1.0:1746065125.561271:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261127168 00000100:00100000:1.0:1746065125.561320:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11012 00000100:00100000:1.0:1746065125.561325:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:1959:x1830881261127168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.561336:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.561349:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a505d400/0x14b4f8542d4f3b0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5b2 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.561388:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259766528:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065125.561450:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.562214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.562245:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.562301:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261127424 00000100:00100000:3.0:1746065125.562304:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261127424 00000100:00100000:3.0:1746065125.562370:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261127296 00000100:00100000:3.0:1746065125.562373:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261127296 00000100:00100000:3.0:1746065125.563028:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11013 00000100:00100000:3.0:1746065125.563038:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881261127424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.563046:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.563057:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5c0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.563073:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.563074:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.563081:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c0 expref: 16 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.563093:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c0 expref: 16 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.563101:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093486800, rc 0) 00000100:00100000:1.0:1746065125.563153:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11014 00000100:00100000:1.0:1746065125.563158:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881261127296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.563165:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.563172:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a505d200/0x14b4f8542d4f3b18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5b9 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.563196:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259766656:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065125.564211:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881261127424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1175us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.564217:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11013 00000100:00100000:1.0:1746065125.564297:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746065125.565280:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime: 1746065124 -> 1746065126 00002000:00010000:1.0:1746065125.565284:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime: 1746065123 -> 1746065126 00002000:00010000:1.0:1746065125.565286:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime: 1746065124 -> 1746065126 00000100:00100000:1.0:1746065125.565302:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259766528:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065125.565336:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a505d400/0x14b4f8542d4f3b0a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5b2 expref: 10 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.565347:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a505d400/0x14b4f8542d4f3b0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5b2 expref: 10 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.565358:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505d400, rc 0) 00000100:00100000:1.0:1746065125.565394:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:1959:x1830881261127168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4068us (4201us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065125.565400:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11012 00002000:00010000:1.0:1746065125.566264:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065125 -> 1746065126 00002000:00010000:1.0:1746065125.566268:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065124 -> 1746065126 00002000:00010000:1.0:1746065125.566270:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065125 -> 1746065126 00000100:00100000:1.0:1746065125.566281:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259766656:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065125.566296:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a505d200/0x14b4f8542d4f3b18 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5b9 expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.566305:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a505d200/0x14b4f8542d4f3b18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5b9 expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.566322:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505d200, rc 0) 00000100:00100000:1.0:1746065125.566347:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881261127296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3188us (4101us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065125.566352:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11014 00000100:00100000:0.0:1746065125.573073:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.573115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.573190:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261127680 00000100:00100000:1.0:1746065125.573190:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261127552 00000100:00100000:2.0:1746065125.573198:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261127680 00000100:00100000:1.0:1746065125.573198:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261127552 00000100:00100000:1.0:1746065125.573253:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11015 00000100:00100000:1.0:1746065125.573260:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:29083:x1830881261127552:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065125.573275:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.573289:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5c7 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.573327:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4af expref: 5 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.573336:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b526 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.573343:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.573350:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.573352:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.573355:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [393216->892927] (req 393216->892927) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.573369:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11016 00000100:00100000:2.0:1746065125.573376:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:29084:x1830881261127680:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065125.573377:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.573383:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.573388:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 15 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.573390:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5ce expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.573398:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259766784:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065125.573403:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.573404:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.573407:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [970752->1048575] (req 970752->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.573416:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [970752->1048575] (req 970752->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.573425:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25d400, rc 0) 00000100:00100000:2.0:1746065125.573452:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:29084:x1830881261127680:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.573457:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11016 00010000:00010000:1.0:1746065125.573475:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b526 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.573483:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b526 expref: 30 pid: 8428 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.573491:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259766912:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.573514:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4af expref: 5 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.573522:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4af expref: 5 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.573534:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259767040:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.573548:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.573559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.573591:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261128064 00000100:00100000:3.0:1746065125.573595:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261128064 00002000:00100000:3.0:1746065125.573615:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880134d84380 x1830881261128064/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.573622:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84380 with x1830881261128064 ext(0->1048575) 00010000:00010000:3.0:1746065125.573627:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 16 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.573634:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 16 pid: 4545 timeout: 824 lvb_type: 1 00002000:00010000:3.0:1746065125.573640:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134d84380 00000100:00100000:3.0:1746065125.573654:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1538 00000100:00100000:3.0:1746065125.573658:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261128064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065125.575071:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.575869:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261128192 00000100:00100000:2.0:1746065125.575874:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261128192 00002000:00100000:2.0:1746065125.575898:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880134d84e00 x1830881261128192/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.575905:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84e00 with x1830881261128192 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.575909:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d84e00 00000100:00100000:2.0:1746065125.575937:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5045 00000100:00100000:2.0:1746065125.575943:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+9:1958:x1830881261128192:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.578200:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259766784:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.578235:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259766912:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.578254:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259767040:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.578280:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [393216->892927] (req 393216->892927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.578293:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505d600, rc 0) 00000100:00100000:1.0:1746065125.578329:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:29083:x1830881261127552:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5068us (5263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.578336:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11015 00000100:00100000:1.0:1746065125.578386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.579047:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261128320 00000100:00100000:3.0:1746065125.579053:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261128320 00010000:00010000:3.0:1746065125.579076:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4af expref: 6 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.579096:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5484 00000100:00100000:3.0:1746065125.579102:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261128320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.579111:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.579126:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4af expref: 6 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746065125.582078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065125.582765:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4af expref: 6 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.582788:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b163000/0x14b4f8542d4f3919 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4af expref: 6 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.582805:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.582874:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881261128320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3771us (4487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.582883:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5484 00000100:00100000:3.0:1746065125.582905:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261128448 00000100:00100000:3.0:1746065125.582911:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261128448 00010000:00010000:3.0:1746065125.582928:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b526 expref: 30 pid: 8428 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.582945:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5485 00000100:00100000:3.0:1746065125.582955:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261128448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.582969:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.582987:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b526 expref: 30 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.582996:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b526 expref: 30 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.583006:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b15d400/0x14b4f8542d4f39dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b526 expref: 30 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.583014:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.583032:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261128448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.583038:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5485 00000100:00100000:3.0:1746065125.591185:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261128064:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17517us (17618us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.591195:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1538 00002000:00100000:3.0:1746065125.591206:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880134d84380 x1830881261128064/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.591214:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84380 with x1830881261128064 ext(0->1048575) 00010000:00010000:3.0:1746065125.591222:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 16 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.591235:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 16 pid: 4545 timeout: 824 lvb_type: 1 00002000:00010000:3.0:1746065125.591240:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134d84380 00000100:00100000:2.0:1746065125.594453:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+9:1958:x1830881261128192:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18501us (19376us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.594464:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5045 00002000:00100000:2.0:1746065125.594473:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880134d84e00 x1830881261128192/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.594482:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84e00 with x1830881261128192 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.594486:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d84e00 00000100:00100000:0.0:1746065125.603074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.603141:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261128576 00000100:00100000:1.0:1746065125.603153:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261128576 00000100:00100000:1.0:1746065125.603726:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11017 00000100:00100000:1.0:1746065125.603736:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+9:29087:x1830881261128576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.603752:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.603769:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5d5 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.603793:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.603805:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065125.603807:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065125.603810:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.603871:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.603881:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 18 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.603892:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259767168:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.604087:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.604218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.604276:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261128704 00000100:00100000:1.0:1746065125.604280:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261128704 00010000:00010000:1.0:1746065125.604298:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 16 pid: 4545 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.604378:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5486 00000100:00100000:1.0:1746065125.604385:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881261128704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065125.604394:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065125.604417:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 16 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065125.604426:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 16 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065125.604442:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b7ca00/0x14b4f8542d4f3982 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4ee expref: 16 pid: 4545 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746065125.604635:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.604637:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.604643:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.604651:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.604657:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.604659:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.604662:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.604667:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.604685:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.604692:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259767296:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065125.604733:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.604920:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259767424:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065125.605070:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.606851:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259767296:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065125.606863:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259767424:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065125.606886:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.606919:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261128704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2533us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.606928:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5486 00000100:00100000:1.0:1746065125.607024:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259767168:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.607042:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.607054:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134d56600, rc 0) 00000100:00100000:1.0:1746065125.607079:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+10:29087:x1830881261128576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3345us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.607085:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11017 00000100:00100000:0.0:1746065125.607354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.607389:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.607421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.607743:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261129088 00000100:00100000:2.0:1746065125.607743:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261128832 00000100:00100000:3.0:1746065125.607747:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261129088 00000100:00100000:2.0:1746065125.607747:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261128832 00002000:00100000:3.0:1746065125.607773:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (393216->397311) req@ffff880134d86d80 x1830881261129088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.607773:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37a:0x0] (1179648->2097151) req@ffff880134d85180 x1830881261128832/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.607781:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86d80 with x1830881261129088 ext(393216->397311) 00002000:00100000:2.0:1746065125.607781:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85180 with x1830881261128832 ext(1179648->2097151) 00002000:00010000:3.0:1746065125.607785:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d86d80 00010000:00010000:2.0:1746065125.607786:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 19 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.607796:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261129344 00010000:00010000:2.0:1746065125.607796:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 19 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746065125.607797:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261129344 00002000:00010000:2.0:1746065125.607802:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d85180 00002000:00100000:3.0:1746065125.607805:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (970752->974847) req@ffff880134d84700 x1830881261129344/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.607811:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84700 with x1830881261129344 ext(970752->974847) 00000100:00100000:2.0:1746065125.607812:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1539 00002000:00010000:3.0:1746065125.607827:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d84700 00000100:00100000:2.0:1746065125.607831:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881261128832:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065125.607836:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5046 00000100:00100000:3.0:1746065125.607841:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261129088:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065125.607941:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261129088:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 100us (553us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065125.607947:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5046 00002000:00100000:3.0:1746065125.607952:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (393216->397311) req@ffff880134d86d80 x1830881261129088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.607958:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86d80 with x1830881261129088 ext(393216->397311) 00002000:00010000:3.0:1746065125.607961:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d86d80 00000100:00100000:3.0:1746065125.607970:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5047 00000100:00100000:3.0:1746065125.607974:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261129344:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.608025:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261129344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 50us (604us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065125.608030:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5047 00002000:00100000:3.0:1746065125.608034:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (970752->974847) req@ffff880134d84700 x1830881261129344/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.608041:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84700 with x1830881261129344 ext(970752->974847) 00002000:00010000:3.0:1746065125.608043:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d84700 00000100:00100000:0.0:1746065125.613111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.614336:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261129472 00000100:00100000:1.0:1746065125.614343:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261129472 00000100:00100000:1.0:1746065125.614581:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11018 00000100:00100000:1.0:1746065125.614590:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+10:29084:x1830881261129472:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065125.614606:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.614620:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5dc expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.614644:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4b6 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.614652:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b52d expref: 20 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.614662:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4f5 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.614667:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.614669:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.614672:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 11 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.614697:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4f5 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.614706:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4f5 expref: 11 pid: 8429 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.614716:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259767552:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.615413:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b52d expref: 20 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.615423:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b52d expref: 20 pid: 8428 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.615431:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259767680:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.615458:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4b6 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.615469:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4b6 expref: 7 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746065125.615476:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259767808:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.615491:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.615767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.616157:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261129728 00000100:00100000:1.0:1746065125.616161:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261129728 00002000:00100000:1.0:1746065125.616188:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (888832->892927) req@ffff880134d85500 x1830881261129728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.616197:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85500 with x1830881261129728 ext(888832->892927) 00002000:00010000:1.0:1746065125.616202:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d85500 00000100:00100000:1.0:1746065125.616230:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5048 00000100:00100000:1.0:1746065125.616237:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261129728:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065125.616384:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261129728:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 146us (616us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065125.616390:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5048 00002000:00100000:1.0:1746065125.616395:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (888832->892927) req@ffff880134d85500 x1830881261129728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.616402:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85500 with x1830881261129728 ext(888832->892927) 00002000:00010000:1.0:1746065125.616404:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d85500 00000100:00100000:0.0:1746065125.619735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.619754:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261129984 00000100:00100000:0.0:1746065125.619760:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261129984 00000100:00100000:1.0:1746065125.620042:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d509180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259767552:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.620050:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259767680:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065125.620174:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3716 00000100:00100000:0.0:1746065125.620181:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:29083:x1830881261129984:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065125.620646:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:29083:x1830881261129984:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 464us (916us total) trans 8589943142 rc 0/0 00000100:00100000:0.0:1746065125.620652:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3716 00000100:00100000:0.0:1746065125.621227:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.621272:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259767808:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.621305:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 11 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.621328:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134d57200, rc 0) 00000100:00100000:1.0:1746065125.621355:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+11:29084:x1830881261129472:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6767us (8251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.621361:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11018 00000100:00100000:2.0:1746065125.621616:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261130240 00000100:00100000:2.0:1746065125.621621:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261130240 00000100:00100000:0.0:1746065125.621632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065125.621638:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4b6 expref: 8 pid: 8851 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746065125.621653:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261130112 00000100:00100000:2.0:1746065125.621655:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261130112 00000100:00100000:3.0:1746065125.621659:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5487 00000100:00100000:0.0:1746065125.621659:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065125.621662:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4f5 expref: 11 pid: 8429 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746065125.621666:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881261130240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065125.621673:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261130368 00010000:00010000:3.0:1746065125.621675:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065125.621675:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261130368 00010000:00010000:2.0:1746065125.621681:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b52d expref: 21 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.621690:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4b6 expref: 8 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.621700:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4b6 expref: 8 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.621718:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b7de00/0x14b4f8542d4f3904 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4b6 expref: 8 pid: 8851 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.621731:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.621746:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5488 00000100:00100000:3.0:1746065125.621750:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881261130240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.621751:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881261130112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065125.621755:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5487 00010000:00010000:2.0:1746065125.621757:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065125.621766:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5489 00000100:00100000:3.0:1746065125.621771:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881261130368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065125.621776:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065125.621783:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b52d expref: 21 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.621793:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b52d expref: 21 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.621804:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15de00/0x14b4f8542d4f39e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b52d expref: 21 pid: 8428 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746065125.621812:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.621842:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881261130368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.621847:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5489 00010000:00010000:2.0:1746065125.621890:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4f5 expref: 11 pid: 8429 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.621902:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4f5 expref: 11 pid: 8429 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.621912:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133084800/0x14b4f8542d4f3989 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4f5 expref: 11 pid: 8429 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746065125.621980:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.621982:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.621988:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.621995:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.622196:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.622205:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259767936:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065125.622239:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065125.624564:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881261128832:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 16728us (17433us total) trans 21474840098 rc 0/0 00000100:00100000:3.0:1746065125.624572:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1539 00002000:00100000:3.0:1746065125.624581:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37a:0x0] (1179648->2097151) req@ffff880134d85180 x1830881261128832/t21474840098(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.624589:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85180 with x1830881261128832 ext(1179648->2097151) 00010000:00010000:3.0:1746065125.624596:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 20 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746065125.624609:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 20 pid: 8851 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746065125.624614:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d85180 00000100:00100000:3.0:1746065125.625665:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259767936:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065125.625678:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065125.627173:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:1959:x1830881261130112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5417us (5535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.627183:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5488 00000100:00100000:0.0:1746065125.628880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.628923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.628926:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261130752 00000100:00100000:3.0:1746065125.628932:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261130752 00000100:00100000:2.0:1746065125.628983:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261130624 00000100:00100000:2.0:1746065125.628986:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261130624 00010000:00010000:2.0:1746065125.629004:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 20 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065125.629034:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5490 00000100:00100000:2.0:1746065125.629041:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881261130624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.629052:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746065125.629076:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x379:0x0] (1503232->1507327) req@ffff880094ad7100 x1830881261130752/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.629085:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad7100 with x1830881261130752 ext(1503232->1507327) 00002000:00010000:3.0:1746065125.629088:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ad7100 00010000:00010000:2.0:1746065125.629182:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 20 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.629193:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 20 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.629209:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8de800/0x14b4f8542d4f3a3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b565 expref: 20 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.629232:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.629234:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.629240:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.629246:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.629269:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.629279:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259768064:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065125.629429:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065125.629903:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5049 00000100:00100000:1.0:1746065125.629910:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261130752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.630036:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261130752:12345-192.168.202.46@tcp:3:cat.0 Request processed in 126us (1161us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065125.630043:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5049 00002000:00100000:1.0:1746065125.630048:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1503232->1507327) req@ffff880094ad7100 x1830881261130752/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.630055:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad7100 with x1830881261130752 ext(1503232->1507327) 00002000:00010000:1.0:1746065125.630057:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ad7100 00000100:00100000:0.0:1746065125.631671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.631867:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259768064:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065125.631879:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.631904:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881261130624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2864us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.631912:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5490 00000100:00100000:1.0:1746065125.632068:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261131008 00000100:00100000:1.0:1746065125.632073:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261131008 00000100:00100000:1.0:1746065125.632099:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3717 00000100:00100000:1.0:1746065125.632103:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:29084:x1830881261131008:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065125.632259:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:29084:x1830881261131008:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 155us (591us total) trans 8589943143 rc 0/0 00000100:00100000:1.0:1746065125.632264:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3717 00000100:00100000:1.0:1746065125.633143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.633156:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261131264 00000100:00100000:1.0:1746065125.633159:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261131264 00002000:00100000:1.0:1746065125.633177:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009baa2680 x1830881261131264/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.633339:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2680 with x1830881261131264 ext(1048576->2097151) 00002000:00010000:1.0:1746065125.633343:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2680 00000100:00100000:1.0:1746065125.633385:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5050 00000100:00100000:1.0:1746065125.633391:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261131264:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.639382:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261131264:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5982us (6231us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065125.639393:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5050 00002000:00100000:1.0:1746065125.639403:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009baa2680 x1830881261131264/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.639412:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2680 with x1830881261131264 ext(1048576->2097151) 00002000:00010000:1.0:1746065125.639417:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2680 00000100:00100000:0.0:1746065125.645977:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.646062:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261131392 00000100:00100000:1.0:1746065125.646069:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261131392 00000100:00100000:1.0:1746065125.646111:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11019 00000100:00100000:1.0:1746065125.646116:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+15:29087:x1830881261131392:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.646131:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.646144:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5e3 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.646166:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.646171:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065125.646172:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065125.646174:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.646192:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.646200:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 28 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746065125.646207:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259768192:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065125.646272:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.648109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.648208:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259768192:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065125.648235:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.648249:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094a28400, rc 0) 00000100:00100000:1.0:1746065125.648291:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:29087:x1830881261131392:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2173us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065125.648297:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11019 00000100:00100000:2.0:1746065125.648383:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261131520 00000100:00100000:2.0:1746065125.648387:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261131520 00002000:00100000:2.0:1746065125.648413:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1138687) req@ffff880094ad4000 x1830881261131520/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.648421:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad4000 with x1830881261131520 ext(1048576->1138687) 00010000:00010000:2.0:1746065125.648426:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 29 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.648440:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 29 pid: 8851 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746065125.648445:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094ad4000 00000100:00100000:2.0:1746065125.648470:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1540 00000100:00100000:2.0:1746065125.648475:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261131520:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065125.651868:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261131520:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 3386us (3758us total) trans 17179872875 rc 0/0 00000100:00100000:2.0:1746065125.651876:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1540 00002000:00100000:2.0:1746065125.651885:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1138687) req@ffff880094ad4000 x1830881261131520/t17179872875(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.651892:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad4000 with x1830881261131520 ext(1048576->1138687) 00010000:00010000:2.0:1746065125.651900:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 31 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.651911:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 31 pid: 8851 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746065125.651917:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094ad4000 00000100:00100000:0.0:1746065125.656877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.657064:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261131648 00000100:00100000:2.0:1746065125.657071:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261131648 00010000:00010000:2.0:1746065125.657100:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 31 pid: 8851 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746065125.657126:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5491 00000100:00100000:2.0:1746065125.657133:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881261131648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.657145:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.657161:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 31 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.657170:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 31 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.657187:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3a4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b573 expref: 31 pid: 8851 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746065125.657503:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.657505:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.657512:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.657520:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.657548:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.657558:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259768320:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065125.658387:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.662480:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259768320:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065125.662498:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.662535:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881261131648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5401us (5666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.662544:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5491 00000100:00100000:0.0:1746065125.664431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.664499:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261131904 00000100:00100000:2.0:1746065125.664505:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261131904 00002000:00100000:2.0:1746065125.664536:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094ad6a00 x1830881261131904/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.664545:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad6a00 with x1830881261131904 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.664549:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad6a00 00000100:00100000:2.0:1746065125.666468:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5051 00000100:00100000:2.0:1746065125.666486:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261131904:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.677372:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261131904:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10886us (12936us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.677382:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5051 00002000:00100000:2.0:1746065125.677392:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094ad6a00 x1830881261131904/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.677401:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad6a00 with x1830881261131904 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.677405:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad6a00 00000100:00100000:0.0:1746065125.696788:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.696860:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.696886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.696911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.696943:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261132160 00000100:00100000:0.0:1746065125.696950:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261132160 00002000:00100000:0.0:1746065125.696984:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880094ad4e00 x1830881261132160/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.696992:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad4e00 with x1830881261132160 ext(2097152->3145727) 00002000:00010000:0.0:1746065125.696996:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad4e00 00000100:00100000:0.0:1746065125.697008:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261132416 00000100:00100000:0.0:1746065125.697011:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261132416 00002000:00100000:0.0:1746065125.697019:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880135cdea00 x1830881261132416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.697024:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdea00 with x1830881261132416 ext(3145728->4194303) 00000100:00100000:2.0:1746065125.697150:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261132672 00000100:00100000:2.0:1746065125.697153:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261132672 00002000:00100000:2.0:1746065125.697169:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880135cddf80 x1830881261132672/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.697174:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cddf80 with x1830881261132672 ext(2097152->3145727) 00002000:00010000:2.0:1746065125.697178:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cddf80 00000100:00100000:2.0:1746065125.697187:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261132800 00000100:00100000:2.0:1746065125.697188:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261132800 00002000:00100000:2.0:1746065125.697195:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880135cde300 x1830881261132800/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.697201:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde300 with x1830881261132800 ext(3145728->4194303) 00002000:00010000:2.0:1746065125.697203:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cde300 00000100:00100000:2.0:1746065125.697218:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5052 00000100:00100000:2.0:1746065125.697224:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881261132160:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.697410:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5053 00000100:00100000:3.0:1746065125.697417:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261132672:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.698244:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5054 00000100:00100000:2.0:1746065125.698250:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261132800:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:0.0:1746065125.699093:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdea00 00000100:00100000:0.0:1746065125.699109:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5055 00000100:00100000:0.0:1746065125.699115:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881261132416:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.710929:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261132160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13696us (14140us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.710939:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5052 00002000:00100000:2.0:1746065125.710949:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880094ad4e00 x1830881261132160/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.710958:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ad4e00 with x1830881261132160 ext(2097152->3145727) 00002000:00010000:2.0:1746065125.710962:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ad4e00 00000100:00100000:0.0:1746065125.715224:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261132800:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16966us (18303us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065125.715235:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5054 00002000:00100000:0.0:1746065125.715246:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880135cde300 x1830881261132800/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.715254:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde300 with x1830881261132800 ext(3145728->4194303) 00002000:00010000:0.0:1746065125.715259:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cde300 00000100:00100000:3.0:1746065125.718928:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261132672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21499us (22028us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.718939:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5053 00002000:00100000:3.0:1746065125.718947:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880135cddf80 x1830881261132672/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065125.720151:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261132416:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21033us (23287us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065125.720158:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5055 00002000:00100000:1.0:1746065125.720165:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880135cdea00 x1830881261132416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.720173:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdea00 with x1830881261132416 ext(3145728->4194303) 00002000:00010000:1.0:1746065125.720178:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdea00 00002000:00100000:3.0:1746065125.720246:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cddf80 with x1830881261132672 ext(2097152->3145727) 00002000:00010000:3.0:1746065125.720249:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cddf80 00000100:00100000:0.0:1746065125.726627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.727021:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261133056 00000100:00100000:1.0:1746065125.727028:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261133056 00000100:00100000:1.0:1746065125.727081:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11020 00000100:00100000:1.0:1746065125.727089:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261133056:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.727103:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.727118:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a27000/0x14b4f8542d4f3b42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5ea expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.727161:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259768448:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065125.727238:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1b40 going to sleep for 11 seconds 00002000:00010000:1.0:1746065125.730105:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime: 1746065125 -> 1746065126 00002000:00010000:1.0:1746065125.730112:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime: 1746065125 -> 1746065126 00002000:00010000:1.0:1746065125.730114:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime: 1746065125 -> 1746065126 00000100:00100000:1.0:1746065125.730134:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259768448:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065125.730162:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a27000/0x14b4f8542d4f3b42 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ea expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.730173:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a27000/0x14b4f8542d4f3b42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ea expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.731139:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a27000, rc 0) 00000100:00100000:1.0:1746065125.731191:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261133056:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4102us (4570us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065125.731200:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11020 00000100:00100000:0.0:1746065125.736779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.737337:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261133312 00000100:00100000:3.0:1746065125.737345:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261133312 00002000:00100000:3.0:1746065125.737380:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880135cdca80 x1830881261133312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.737388:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdca80 with x1830881261133312 ext(4194304->5029887) 00002000:00010000:3.0:1746065125.737393:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdca80 00000100:00100000:3.0:1746065125.738001:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5056 00000100:00100000:3.0:1746065125.738009:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261133312:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.747225:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261133312:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9208us (10443us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065125.747235:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5056 00002000:00100000:3.0:1746065125.747245:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880135cdca80 x1830881261133312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.747253:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdca80 with x1830881261133312 ext(4194304->5029887) 00002000:00010000:3.0:1746065125.747258:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdca80 00000100:00100000:0.0:1746065125.749223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.749290:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261133440 00000100:00100000:1.0:1746065125.749298:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261133440 00000100:00100000:1.0:1746065125.749349:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11021 00000100:00100000:1.0:1746065125.749356:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261133440:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.749371:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.749386:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a26200/0x14b4f8542d4f3b49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5f1 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.749431:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259768576:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065125.749561:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065125.750799:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259768576:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065125.750861:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a26200/0x14b4f8542d4f3b49 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5f1 expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.750874:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a26200/0x14b4f8542d4f3b49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5f1 expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.750895:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a26200, rc 0) 00000100:00100000:1.0:1746065125.750926:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261133440:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1570us (1707us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065125.750933:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11021 00000100:00100000:0.0:1746065125.752953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.753048:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261133568 00000100:00100000:1.0:1746065125.753055:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261133568 00000100:00100000:1.0:1746065125.753095:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11022 00000100:00100000:1.0:1746065125.753102:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881261133568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.753118:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.753130:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a26c00/0x14b4f8542d4f3b50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5f8 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.753167:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259768704:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065125.753233:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065125.754633:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259768704:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065125.754656:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a26c00/0x14b4f8542d4f3b50 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5f8 expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.754667:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a26c00/0x14b4f8542d4f3b50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5f8 expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.754692:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a26c00, rc 0) 00000100:00100000:1.0:1746065125.754724:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881261133568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1622us (1775us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065125.754730:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11022 00000100:00100000:0.0:1746065125.782565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.783312:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261133824 00000100:00100000:1.0:1746065125.783321:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261133824 00000100:00100000:1.0:1746065125.783591:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9084 00000100:00100000:1.0:1746065125.783598:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:29096:x1830881261133824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.783615:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.783627:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5dc00/0x14b4f8542d4f3b57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b5ff expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.783704:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783714:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783723:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783732:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783737:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783741:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783834:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783841:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783846:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065125.783853:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065125.783914:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783920:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783925:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783933:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b917800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.783936:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783941:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783951:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.783953:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065125.783956:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783960:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917800/0x14b4f8542d4f3b6c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783990:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783994:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.783998:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784002:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b916000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.784004:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784008:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784014:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065125.784016:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.784019:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784023:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916000/0x14b4f8542d4f3b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784032:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784036:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784040:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784043:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b916600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.784045:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784049:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784054:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801331acd00) 00010000:00010000:1.0:1746065125.784056:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.784058:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784062:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3b65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.784089:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5dc00/0x14b4f8542d4f3b57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ff expref: 256 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.784095:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5dc00/0x14b4f8542d4f3b57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ff expref: 256 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.784102:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5dc00, rc 0) 00000100:00100000:1.0:1746065125.784149:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29096:x1830881261133824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 551us (1592us total) trans 8589943144 rc 301/301 00000100:00100000:1.0:1746065125.784155:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9084 00000100:00100000:0.0:1746065125.786835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.786857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.786878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.787534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.787718:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261133952 00000100:00100000:2.0:1746065125.787719:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134208 00000100:00100000:3.0:1746065125.787725:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261133952 00000100:00100000:2.0:1746065125.787725:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134208 00000100:00100000:3.0:1746065125.787752:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134080 00000100:00100000:3.0:1746065125.787754:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134080 00000100:00100000:2.0:1746065125.787763:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134336 00000100:00100000:2.0:1746065125.787765:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134336 00000100:00100000:3.0:1746065125.787767:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11023 00000100:00100000:3.0:1746065125.787773:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261133952:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065125.787780:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11024 00010000:00010000:3.0:1746065125.787785:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065125.787786:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881261134208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.787796:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009118ec00/0x14b4f8542d4f3b7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b606 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.787796:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.787804:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b614 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065125.787810:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11025 00000100:00100000:1.0:1746065125.787829:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261134336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065125.787830:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.787831:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.787835:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.787838:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b614 expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.787841:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b61b expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.787849:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065125.787851:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259768832:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065125.787851:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b614 expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.787851:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065125.787854:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b61b expref: 33 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.787859:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f3400, rc 0) 00010000:00010000:1.0:1746065125.787863:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b61b expref: 33 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065125.787868:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b917a00, rc 0) 00000100:00100000:3.0:1746065125.787911:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065125.787934:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261134336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 118us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.787935:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11026 00000100:00100000:3.0:1746065125.787940:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881261134080:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065125.787940:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11025 00010000:00010000:3.0:1746065125.787946:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.787953:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009118ea00/0x14b4f8542d4f3b8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b60d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.787973:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259768960:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065125.788005:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881261134208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 218us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.788007:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.788010:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11024 00002000:00010000:2.0:1746065125.790194:0:8427:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065124 -> 1746065126 00002000:00010000:2.0:1746065125.790198:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime: 1746065124 -> 1746065126 00002000:00010000:2.0:1746065125.790199:0:8427:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065124 -> 1746065126 00000100:00100000:2.0:1746065125.790210:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259768960:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065125.790233:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009118ea00/0x14b4f8542d4f3b8f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b60d expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.790243:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009118ea00/0x14b4f8542d4f3b8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b60d expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.790254:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009118ea00, rc 0) 00000100:00100000:2.0:1746065125.790293:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881261134080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2351us (3412us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065125.790298:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11026 00000100:00100000:3.0:1746065125.790348:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259768832:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065125.790364:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009118ec00/0x14b4f8542d4f3b7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b606 expref: 32 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.790373:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009118ec00/0x14b4f8542d4f3b7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b606 expref: 32 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.790382:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009118ec00, rc 0) 00000100:00100000:3.0:1746065125.790579:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261133952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2626us (3589us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065125.790584:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11023 00000100:00100000:0.0:1746065125.792100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.792186:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134464 00000100:00100000:3.0:1746065125.792193:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134464 00000100:00100000:3.0:1746065125.792229:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11027 00000100:00100000:3.0:1746065125.792243:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:29096:x1830881261134464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.792254:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.792265:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b622 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.792284:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.792296:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.792301:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065125.792303:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065125.792316:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 32 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.792341:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.792351:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 15 pid: 8851 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065125.792361:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259769088:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.792433:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.792441:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 32 pid: 21998 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065125.792447:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259769216:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.792464:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065125.794096:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259769088:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.794105:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259769216:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.794124:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 32 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.794135:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938fc800, rc 0) 00000100:00100000:3.0:1746065125.794157:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:29096:x1830881261134464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1922us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.794163:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11027 00000100:00100000:2.0:1746065125.794482:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.794513:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.794631:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134592 00000100:00100000:1.0:1746065125.794635:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134592 00002000:00100000:1.0:1746065125.794663:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (970752->1048575) req@ffff88012f540380 x1830881261134592/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.794676:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f540380 with x1830881261134592 ext(970752->1048575) 00010000:00010000:1.0:1746065125.794682:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 16 pid: 8851 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065125.794691:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 16 pid: 8851 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746065125.794696:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f540380 00000100:00100000:1.0:1746065125.794719:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134720 00000100:00100000:1.0:1746065125.794722:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134720 00002000:00100000:1.0:1746065125.794733:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (393216->892927) req@ffff88012f542300 x1830881261134720/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.794739:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f542300 with x1830881261134720 ext(393216->892927) 00010000:00010000:1.0:1746065125.794744:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 32 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065125.794750:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 32 pid: 21998 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746065125.794755:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f542300 00000100:00100000:1.0:1746065125.794774:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1541 00000100:00100000:1.0:1746065125.794779:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261134592:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065125.794978:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1542 00000100:00100000:3.0:1746065125.794985:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261134720:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065125.799241:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:1958:x1830881261134592:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4454us (4752us total) trans 17179872876 rc 0/0 00000100:00100000:1.0:1746065125.799251:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1541 00002000:00100000:1.0:1746065125.799261:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (970752->1048575) req@ffff88012f540380 x1830881261134592/t17179872876(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.799270:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f540380 with x1830881261134592 ext(970752->1048575) 00010000:00010000:1.0:1746065125.799278:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 18 pid: 8851 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065125.799294:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 18 pid: 8851 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746065125.799300:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f540380 00000100:00100000:0.0:1746065125.801793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.802002:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134848 00000100:00100000:2.0:1746065125.802010:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134848 00010000:00010000:2.0:1746065125.802038:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 18 pid: 8851 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065125.802156:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5492 00000100:00100000:2.0:1746065125.802166:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881261134848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.802177:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.802192:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 18 pid: 8851 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.802202:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 18 pid: 8851 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.802324:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c25d400/0x14b4f8542d4f3b26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [970752->18446744073709551615] (req 970752->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ce expref: 18 pid: 8851 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.802341:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.802389:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881261134848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 225us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.802396:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5492 00000100:00100000:3.0:1746065125.804436:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261134720:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9445us (9916us total) trans 17179872877 rc 0/0 00000100:00100000:3.0:1746065125.804445:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1542 00002000:00100000:3.0:1746065125.804454:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (393216->892927) req@ffff88012f542300 x1830881261134720/t17179872877(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.804462:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f542300 with x1830881261134720 ext(393216->892927) 00010000:00010000:3.0:1746065125.804469:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 34 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065125.804480:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 34 pid: 21998 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065125.804486:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f542300 00000100:00100000:0.0:1746065125.806989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.807451:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134976 00000100:00100000:2.0:1746065125.807458:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134976 00010000:00010000:2.0:1746065125.807482:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 34 pid: 21998 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065125.807502:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5493 00000100:00100000:2.0:1746065125.807508:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261134976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.807520:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.807534:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 34 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.807543:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 34 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.807560:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a505d600/0x14b4f8542d4f3b1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->966655] (req 393216->892927) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c7 expref: 34 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.807588:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.807590:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.807596:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 33 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.807603:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 33 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.808175:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 33 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.808187:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259769344:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065125.808843:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.811367:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259769344:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065125.811385:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.811426:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261134976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3916us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.811436:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5493 00000100:00100000:0.0:1746065125.812584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.812677:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261135232 00000100:00100000:3.0:1746065125.812684:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261135232 00002000:00100000:3.0:1746065125.812717:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880135cdf800 x1830881261135232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.812730:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf800 with x1830881261135232 ext(0->1048575) 00002000:00010000:3.0:1746065125.812733:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdf800 00000100:00100000:3.0:1746065125.813026:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5057 00000100:00100000:3.0:1746065125.813032:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261135232:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065125.819236:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261135232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6195us (6647us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.819248:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5057 00002000:00100000:3.0:1746065125.819257:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880135cdf800 x1830881261135232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.819267:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf800 with x1830881261135232 ext(0->1048575) 00002000:00010000:3.0:1746065125.819271:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdf800 00000100:00100000:0.0:1746065125.825359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.825867:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261135360 00000100:00100000:3.0:1746065125.825874:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261135360 00000100:00100000:3.0:1746065125.825919:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11028 00000100:00100000:3.0:1746065125.825926:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:29096:x1830881261135360:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.825940:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.825953:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b629 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.826653:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 9 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.826661:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065125.826663:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065125.826666:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.826691:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 9 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.826701:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 9 pid: 21998 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065125.826712:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259769472:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.826802:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065125.830015:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065125.830354:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259769472:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.830382:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.830395:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e8f800, rc 0) 00000100:00100000:3.0:1746065125.830560:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:29096:x1830881261135360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4633us (5206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.830568:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11028 00000100:00100000:0.0:1746065125.831009:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.831160:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261135488 00000100:00100000:3.0:1746065125.831166:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261135488 00002000:00100000:3.0:1746065125.831195:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1507327) req@ffff880135cdd880 x1830881261135488/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.831204:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd880 with x1830881261135488 ext(1048576->1507327) 00010000:00010000:3.0:1746065125.831210:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 10 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065125.831227:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 10 pid: 21998 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065125.831234:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135cdd880 00000100:00100000:3.0:1746065125.831345:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1543 00000100:00100000:3.0:1746065125.831352:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261135488:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065125.838898:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261135488:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7538us (7881us total) trans 21474840099 rc 0/0 00000100:00100000:3.0:1746065125.838908:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1543 00002000:00100000:3.0:1746065125.838918:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1507327) req@ffff880135cdd880 x1830881261135488/t21474840099(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.838926:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd880 with x1830881261135488 ext(1048576->1507327) 00010000:00010000:3.0:1746065125.838935:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065125.838947:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065125.838953:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135cdd880 00000100:00100000:0.0:1746065125.843855:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.844243:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261135616 00000100:00100000:2.0:1746065125.844252:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261135616 00010000:00010000:2.0:1746065125.844283:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065125.844323:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5494 00000100:00100000:2.0:1746065125.844330:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881261135616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.844342:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.844358:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.844369:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.844387:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134d57200/0x14b4f8542d4f3b34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5dc expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.844414:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.844416:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.844422:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 20 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.844430:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 20 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.844456:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 20 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.844467:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259769600:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065125.844538:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.847471:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259769600:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065125.847488:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.847519:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261135616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3189us (4160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.847528:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5494 00000100:00100000:0.0:1746065125.849847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.850144:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261135872 00000100:00100000:2.0:1746065125.850152:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261135872 00000100:00100000:2.0:1746065125.850538:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9085 00000100:00100000:2.0:1746065125.850546:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29098:x1830881261135872:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065125.850564:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065125.850579:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3ba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b630 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.850664:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850674:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850682:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850693:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850698:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850702:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850782:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850788:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850799:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065125.850805:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065125.850886:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850892:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850897:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850903:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944f3200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065125.850906:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850912:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850920:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065125.850922:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065125.850925:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850928:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4f3bb9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850955:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850960:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850964:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850968:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944f3c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065125.850970:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850974:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850979:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065125.850981:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065125.850983:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850986:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.850998:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.851002:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.851006:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.851010:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944f2800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065125.851012:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.851015:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.851020:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205f00) 00010000:00010000:2.0:1746065125.851022:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065125.851024:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.851028:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4f3bb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065125.851056:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3ba4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b630 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.851062:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3ba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b630 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.851070:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f2a00, rc 0) 00000100:00100000:2.0:1746065125.851124:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:29098:x1830881261135872:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 578us (1310us total) trans 8589943145 rc 301/301 00000100:00100000:2.0:1746065125.851129:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9085 00000100:00100000:0.0:1746065125.854142:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.854176:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261136128 00000100:00100000:0.0:1746065125.854180:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.854184:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261136128 00000100:00100000:0.0:1746065125.854212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.854222:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9086 00000100:00100000:1.0:1746065125.854228:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:29100:x1830881261136128:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:0.0:1746065125.854232:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065125.854248:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.854263:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b637 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.854303:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261136512 00000100:00100000:2.0:1746065125.854304:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261136640 00000100:00100000:2.0:1746065125.854317:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261136640 00000100:00100000:3.0:1746065125.854319:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261136512 00002000:00100000:3.0:1746065125.854340:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f9b8000 x1830881261136512/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.854340:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f9bbb80 x1830881261136640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.854348:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8000 with x1830881261136512 ext(1048576->2097151) 00002000:00100000:2.0:1746065125.854348:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bbb80 with x1830881261136640 ext(1048576->2097151) 00002000:00010000:3.0:1746065125.854352:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9b8000 00002000:00010000:2.0:1746065125.854352:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9bbb80 00000100:00100000:2.0:1746065125.854361:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261136896 00010000:00010000:1.0:1746065125.854362:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065125.854363:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261136896 00002000:00100000:2.0:1746065125.854371:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f9bb100 x1830881261136896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065125.854372:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00002000:00100000:2.0:1746065125.854376:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb100 with x1830881261136896 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.854379:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb100 00000100:00100000:3.0:1746065125.854381:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5058 00010000:00010000:1.0:1746065125.854381:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:3.0:1746065125.854386:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881261136640:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:1.0:1746065125.854392:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854400:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854404:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854485:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854492:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854497:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065125.854505:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065125.854565:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854571:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854576:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854580:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b916600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.854584:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854589:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854598:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.854601:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065125.854604:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854608:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bdc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854624:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854629:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854632:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854636:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b916400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.854638:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854642:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854646:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065125.854648:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.854650:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854654:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854659:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854663:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854668:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854671:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b916800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.854673:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854676:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854693:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801331ac300) 00010000:00010000:1.0:1746065125.854695:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.854697:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854700:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3bd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.854729:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bc7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b637 expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.854735:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b637 expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.854741:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418bc00, rc 0) 00000100:00100000:1.0:1746065125.854774:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:29100:x1830881261136128:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 546us (639us total) trans 8589943146 rc 301/301 00000100:00100000:1.0:1746065125.854779:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9086 00000100:00100000:0.0:1746065125.855279:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5059 00000100:00100000:0.0:1746065125.855299:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881261136512:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.855536:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5060 00000100:00100000:1.0:1746065125.855543:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261136896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.876693:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261136896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21144us (22453us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065125.876693:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881261136640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22299us (22473us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065125.876703:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5060 00000100:00100000:0.0:1746065125.876707:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5058 00002000:00100000:1.0:1746065125.876712:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f9bb100 x1830881261136896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.876713:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f9bbb80 x1830881261136640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065125.876720:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb100 with x1830881261136896 ext(1048576->2097151) 00002000:00100000:0.0:1746065125.876720:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bbb80 with x1830881261136640 ext(1048576->2097151) 00002000:00010000:1.0:1746065125.876724:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb100 00002000:00010000:0.0:1746065125.876724:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9bbb80 00000100:00100000:2.0:1746065125.880620:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881261136512:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25317us (26432us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.880630:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5059 00002000:00100000:2.0:1746065125.880640:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f9b8000 x1830881261136512/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.880648:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b8000 with x1830881261136512 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.880652:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9b8000 00000100:00100000:0.0:1746065125.896605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.896768:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261137152 00000100:00100000:2.0:1746065125.896777:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261137152 00000100:00100000:2.0:1746065125.897159:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3718 00000100:00100000:2.0:1746065125.897168:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:29096:x1830881261137152:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065125.897386:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:29096:x1830881261137152:12345-192.168.202.46@tcp:35:cat.0 Request processed in 219us (787us total) trans 8589943147 rc 0/0 00000100:00100000:2.0:1746065125.897393:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3718 00000100:00100000:0.0:1746065125.909240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.909287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.909451:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261137408 00000100:00100000:1.0:1746065125.909459:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261137408 00000100:00100000:1.0:1746065125.909494:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9087 00000100:00100000:1.0:1746065125.909501:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:29103:x1830881261137408:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065125.909521:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065125.909535:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b63e expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.909692:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261137536 00000100:00100000:3.0:1746065125.909697:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261137536 00000100:00100000:3.0:1746065125.909721:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11029 00000100:00100000:3.0:1746065125.909727:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:29098:x1830881261137536:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065125.909735:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.909744:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b645 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.909767:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.909775:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b61b expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.909781:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.909782:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.909785:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 34 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.909808:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b61b expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.909836:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b61b expref: 34 pid: 21998 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746065125.909852:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259769728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.909917:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.909925:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 16 pid: 21998 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065125.909932:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259769856:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.909947:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746065125.910566:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910697:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910707:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910721:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910727:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910736:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910837:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910846:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910851:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065125.910859:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065125.910917:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910923:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910927:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910932:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009418be00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.910935:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910941:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910950:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065125.910953:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065125.910956:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910965:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009418be00/0x14b4f8542d4f3c06 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910993:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.910999:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911003:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911006:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b916600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.911009:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911013:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911019:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065125.911021:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.911023:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911027:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916600/0x14b4f8542d4f3bf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911035:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911039:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911043:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911048:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009418bc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065125.911050:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911055:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911060:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801331acd00) 00010000:00010000:1.0:1746065125.911061:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065125.911063:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911067:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009418bc00/0x14b4f8542d4f3bff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065125.911095:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b63e expref: 17 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.911102:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3bea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b63e expref: 17 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065125.911110:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b916400, rc 0) 00000100:00100000:1.0:1746065125.911139:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:29103:x1830881261137408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1638us (1906us total) trans 8589943148 rc 301/301 00000100:00100000:1.0:1746065125.911146:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9087 00000100:00100000:3.0:1746065125.911509:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259769856:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.912324:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259769728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.912350:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 34 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.912364:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094759400, rc 0) 00000100:00100000:3.0:1746065125.912390:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:29098:x1830881261137536:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2664us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.912397:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11029 00000100:00100000:0.0:1746065125.914013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.914127:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261137664 00000100:00100000:2.0:1746065125.914133:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261137664 00010000:00010000:2.0:1746065125.914158:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b61b expref: 34 pid: 21998 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746065125.914179:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5495 00000100:00100000:2.0:1746065125.914186:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261137664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.914195:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.914211:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b61b expref: 34 pid: 21998 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746065125.914221:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b61b expref: 34 pid: 21998 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746065125.914240:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b917a00/0x14b4f8542d4f3b88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b61b expref: 34 pid: 21998 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746065125.914262:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065125.914927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065125.914985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.915037:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261137920 00000100:00100000:3.0:1746065125.915041:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261137920 00000100:00100000:3.0:1746065125.915059:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3719 00000100:00100000:3.0:1746065125.915063:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+16:29103:x1830881261137920:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065125.915082:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261138048 00000100:00100000:0.0:1746065125.915086:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261138048 00010000:00010000:0.0:1746065125.915100:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 17 pid: 21998 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065125.915184:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+17:29103:x1830881261137920:12345-192.168.202.46@tcp:35:cat.0 Request processed in 121us (258us total) trans 8589943149 rc 0/0 00000100:00100000:3.0:1746065125.915189:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3719 00000100:00100000:0.0:1746065125.915207:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5496 00000100:00100000:0.0:1746065125.915213:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881261138048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065125.915220:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065125.915229:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 17 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065125.915239:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 17 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065125.915250:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094a28400/0x14b4f8542d4f3b3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5e3 expref: 17 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746065125.915262:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.915264:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.915268:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 33 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.915275:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 33 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065125.915296:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 33 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.915314:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9b9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259769984:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065125.915360:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065125.915402:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261137664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 117us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.915408:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5495 00000100:00100000:2.0:1746065125.916355:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9b9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259769984:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065125.916367:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.916484:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881261138048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1270us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.916491:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5496 00000100:00100000:0.0:1746065125.917612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.917632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.917660:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261138304 00000100:00100000:3.0:1746065125.917666:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261138304 00000100:00100000:0.0:1746065125.917686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.917692:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261138176 00000100:00100000:3.0:1746065125.917694:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261138176 00000100:00100000:3.0:1746065125.917705:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261138432 00000100:00100000:3.0:1746065125.917707:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261138432 00000100:00100000:3.0:1746065125.917735:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11030 00000100:00100000:3.0:1746065125.917742:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:29098:x1830881261138304:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065125.917756:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.917770:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b653 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.917793:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.917802:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c0 expref: 16 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.917809:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.917811:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.917835:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->2559999] (req 2097152->2559999) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 34 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.917855:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11031 00010000:00010000:3.0:1746065125.917860:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c0 expref: 16 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065125.917862:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881261138176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065125.917869:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.917870:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c0 expref: 16 pid: 4544 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746065125.917876:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b64c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.917882:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259770112:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065125.917888:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.917931:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.917938:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 34 pid: 8851 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065125.917944:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259770240:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065125.917949:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065125.917956:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b64c expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065125.917961:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746065125.917968:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b64c expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065125.917976:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25c200, rc 0) 00000100:00100000:3.0:1746065125.917977:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11032 00000100:00100000:3.0:1746065125.917983:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+11:1959:x1830881261138432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.917990:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065125.917995:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881261138176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 134us (361us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065125.917999:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b65a expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065125.918000:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11031 00010000:00010000:3.0:1746065125.918010:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.918011:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065125.918016:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b65a expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.918025:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b65a expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065125.918031:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094758a00, rc 0) 00000100:00100000:0.0:1746065125.918033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.918045:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261138560 00000100:00100000:3.0:1746065125.918048:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881261138432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 66us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065125.918048:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261138560 00000100:00100000:3.0:1746065125.918053:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11032 00000100:00100000:3.0:1746065125.918062:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11033 00000100:00100000:3.0:1746065125.918066:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881261138560:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.918071:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.918076:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094758e00/0x14b4f8542d4f3c29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b661 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065125.918096:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259770368:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065125.918113:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065125.928887:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.928965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.929067:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259770368:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065125.929094:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094758e00/0x14b4f8542d4f3c29 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b661 expref: 18 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.929106:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094758e00/0x14b4f8542d4f3c29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b661 expref: 18 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065125.929119:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094758e00, rc 0) 00000100:00100000:2.0:1746065125.929152:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881261138560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11085us (11119us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065125.929159:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11033 00000100:00100000:2.0:1746065125.929193:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261138688 00000100:00100000:2.0:1746065125.929197:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261138688 00010000:00010000:2.0:1746065125.929221:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 35 pid: 8851 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065125.929238:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261138816 00000100:00100000:2.0:1746065125.929240:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261138816 00010000:00010000:2.0:1746065125.929249:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c0 expref: 17 pid: 4544 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746065125.929268:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5497 00000100:00100000:2.0:1746065125.929274:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261138688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.929284:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.929293:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 35 pid: 8851 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.929301:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 35 pid: 8851 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.929329:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.929344:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261138688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.929348:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5497 00000100:00100000:2.0:1746065125.929360:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5498 00000100:00100000:2.0:1746065125.929364:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261138816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065125.929370:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065125.929376:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c0 expref: 17 pid: 4544 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746065125.929385:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c0 expref: 17 pid: 4544 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746065125.929395:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.929397:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065125.929403:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 34 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.929410:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 34 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065125.929435:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 34 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065125.929445:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259770496:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065125.929493:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9300 going to sleep for 11 seconds 00010000:00010000:3.0:1746065125.929702:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093486800/0x14b4f8542d4f3b11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5c0 expref: 17 pid: 4544 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746065125.929715:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259770112:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.929723:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b97aa00/0x14b4f8542d4f3a8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b58f expref: 34 pid: 8851 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065125.929729:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259770240:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.929744:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 33 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.929751:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094759c00, rc 0) 00000100:00100000:3.0:1746065125.929771:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:29098:x1830881261138304:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 12030us (12161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.929779:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11030 00000100:00100000:2.0:1746065125.937610:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259770496:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065125.937629:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065125.937665:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261138816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8299us (8698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065125.937673:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5498 00000100:00100000:3.0:1746065125.937919:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.938200:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261139072 00000100:00100000:2.0:1746065125.938207:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261139072 00002000:00100000:2.0:1746065125.938246:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2555904->2559999) req@ffff88013667c700 x1830881261139072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.938256:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667c700 with x1830881261139072 ext(2555904->2559999) 00002000:00010000:2.0:1746065125.938260:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013667c700 00000100:00100000:2.0:1746065125.938896:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5061 00000100:00100000:2.0:1746065125.938905:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261139072:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065125.940331:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881261139072:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1423us (2408us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065125.940340:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5061 00002000:00100000:2.0:1746065125.940348:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2555904->2559999) req@ffff88013667c700 x1830881261139072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.940356:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667c700 with x1830881261139072 ext(2555904->2559999) 00002000:00010000:2.0:1746065125.940360:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013667c700 00000100:00100000:1.0:1746065125.940494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.940633:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261139328 00000100:00100000:3.0:1746065125.940639:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261139328 00002000:00100000:3.0:1746065125.940663:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009baa1180 x1830881261139328/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.940669:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1180 with x1830881261139328 ext(0->1048575) 00002000:00010000:3.0:1746065125.940673:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa1180 00000100:00100000:3.0:1746065125.940695:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5062 00000100:00100000:3.0:1746065125.940701:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261139328:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065125.943656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065125.944303:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261139584 00000100:00100000:0.0:1746065125.944322:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261139584 00002000:00100000:0.0:1746065125.944354:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012f541500 x1830881261139584/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065125.944363:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f541500 with x1830881261139584 ext(1048576->2097151) 00002000:00010000:0.0:1746065125.944367:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f541500 00000100:00100000:0.0:1746065125.944391:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5063 00000100:00100000:0.0:1746065125.944398:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881261139584:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065125.953900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.953981:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261139840 00000100:00100000:2.0:1746065125.953990:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261139840 00000100:00100000:2.0:1746065125.954038:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3720 00000100:00100000:2.0:1746065125.954046:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:29098:x1830881261139840:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065125.954260:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:29098:x1830881261139840:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 214us (366us total) trans 8589943150 rc 0/0 00000100:00100000:2.0:1746065125.954267:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3720 00000100:00100000:3.0:1746065125.957677:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261139328:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16967us (17175us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065125.957688:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5062 00002000:00100000:3.0:1746065125.957736:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009baa1180 x1830881261139328/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065125.957746:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1180 with x1830881261139328 ext(0->1048575) 00002000:00010000:3.0:1746065125.957751:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa1180 00000100:00100000:2.0:1746065125.960258:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881261139584:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15854us (16603us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065125.960267:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5063 00002000:00100000:2.0:1746065125.960275:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012f541500 x1830881261139584/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:41/0 lens 488/440 e 0 to 0 dl 1746065136 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.960283:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f541500 with x1830881261139584 ext(1048576->2097151) 00002000:00010000:2.0:1746065125.960287:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f541500 00000100:00100000:0.0:1746065125.982709:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065125.982848:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261139968 00000100:00100000:3.0:1746065125.982857:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261139968 00000100:00100000:3.0:1746065125.982905:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11034 00000100:00100000:3.0:1746065125.982913:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+16:29103:x1830881261139968:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065125.982928:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065125.982943:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b668 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.982973:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 32 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.982980:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065125.982981:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065125.982984:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 17 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.983009:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 32 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.983019:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 32 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065125.983029:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259770624:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065125.983353:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065125.987284:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259770624:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065125.987324:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 17 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065125.987341:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f3c00, rc 0) 00000100:00100000:3.0:1746065125.987408:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+17:29103:x1830881261139968:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4495us (4704us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065125.987416:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11034 00000100:00100000:0.0:1746065125.988018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065125.988083:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140096 00000100:00100000:2.0:1746065125.988088:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140096 00002000:00100000:2.0:1746065125.988118:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1949696->2097151) req@ffff88009fb12300 x1830881261140096/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/0 e 0 to 0 dl 1746065136 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065125.988126:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830881261140096 ext(1949696->2097151) 00010000:00010000:2.0:1746065125.988132:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 33 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065125.988142:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 33 pid: 4545 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065125.988152:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb12300 00000100:00100000:2.0:1746065125.988682:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1544 00000100:00100000:2.0:1746065125.988693:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881261140096:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065126.000742:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261140096:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 12044us (12716us total) trans 17179872878 rc 0/0 00000100:00100000:2.0:1746065126.000753:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1544 00002000:00100000:2.0:1746065126.000762:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1949696->2097151) req@ffff88009fb12300 x1830881261140096/t17179872878(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:41/0 lens 488/448 e 0 to 0 dl 1746065136 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.000771:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830881261140096 ext(1949696->2097151) 00010000:00010000:2.0:1746065126.000780:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 35 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.000795:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 35 pid: 4545 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.000801:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb12300 00000100:00100000:0.0:1746065126.004638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.004731:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140224 00000100:00100000:2.0:1746065126.004739:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140224 00010000:00010000:2.0:1746065126.004779:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 35 pid: 4545 timeout: 825 lvb_type: 0 00000100:00080000:0.0:1746065126.004883:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065126.005099:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5499 00000100:00100000:2.0:1746065126.005107:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881261140224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065126.005120:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065126.005136:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 35 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.005146:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 35 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.005163:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094759400/0x14b4f8542d4f3bf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b645 expref: 35 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.005179:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.005181:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.005186:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 16 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.005193:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 16 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.005218:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 16 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.005227:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259770752:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065126.006065:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065126.008459:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259770752:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065126.008481:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065126.008517:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881261140224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3410us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.008527:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5499 00000100:00100000:0.0:1746065126.012217:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.012331:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140480 00000100:00100000:2.0:1746065126.012339:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140480 00002000:00100000:2.0:1746065126.012376:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009fb11880 x1830881261140480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.012386:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11880 with x1830881261140480 ext(1048576->2097151) 00002000:00010000:2.0:1746065126.012391:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11880 00000100:00100000:2.0:1746065126.012451:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5064 00000100:00100000:2.0:1746065126.012459:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881261140480:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065126.025048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.025709:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140736 00000100:00100000:1.0:1746065126.025716:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140736 00000100:00100000:1.0:1746065126.026054:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9088 00000100:00100000:1.0:1746065126.026062:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:29108:x1830881261140736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065126.026083:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.026097:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3c37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b66f expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.026211:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026225:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026236:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026251:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026258:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026263:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026395:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026406:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026412:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065126.026422:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065126.026500:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026508:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026513:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026518:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e8c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.026522:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026527:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026537:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065126.026540:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065126.026544:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.026549:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4f3c4c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027773:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027782:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027786:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027794:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b917a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.027797:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027802:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027812:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065126.027838:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.027843:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027847:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b917a00/0x14b4f8542d4f3c3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027859:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027864:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027868:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027871:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b916400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.027874:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027878:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027885:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801331ac300) 00010000:00010000:1.0:1746065126.027887:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.027890:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027895:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916400/0x14b4f8542d4f3c45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.027938:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3c37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b66f expref: 260 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.027946:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b916800/0x14b4f8542d4f3c37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b66f expref: 260 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.027954:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b916800, rc 0) 00000100:00100000:1.0:1746065126.028588:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:29108:x1830881261140736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2522us (3542us total) trans 8589943151 rc 301/301 00000100:00100000:1.0:1746065126.028596:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9088 00000100:00100000:3.0:1746065126.030190:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881261140480:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17727us (17975us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.030200:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5064 00002000:00100000:3.0:1746065126.030209:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009fb11880 x1830881261140480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.030218:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11880 with x1830881261140480 ext(1048576->2097151) 00002000:00010000:3.0:1746065126.030222:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11880 00000100:00100000:0.0:1746065126.035809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.035964:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140864 00000100:00100000:3.0:1746065126.035972:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140864 00000100:00100000:3.0:1746065126.036005:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11035 00000100:00100000:3.0:1746065126.036012:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881261140864:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.036027:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.036041:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b676 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.036058:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.036060:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.036066:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b676 expref: 35 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.036078:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b676 expref: 35 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.036086:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f2a00, rc 0) 00000100:00100000:3.0:1746065126.036123:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881261140864:12345-192.168.202.46@tcp:101:cat.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.036128:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11035 00000100:00100000:0.0:1746065126.036673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.036712:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140992 00000100:00100000:2.0:1746065126.036715:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140992 00000100:00100000:2.0:1746065126.036742:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11036 00000100:00100000:2.0:1746065126.036747:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:29103:x1830881261140992:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.036754:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.036761:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b67d expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.036776:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 34 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.036781:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065126.036782:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065126.036785:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.036807:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 34 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.036833:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 34 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.036844:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259770880:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.036897:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.038383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.038491:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261141120 00000100:00100000:3.0:1746065126.038500:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261141120 00002000:00100000:3.0:1746065126.038537:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2559999) req@ffff8800913fad80 x1830881261141120/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.038545:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fad80 with x1830881261141120 ext(2097152->2559999) 00010000:00010000:3.0:1746065126.038554:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 35 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.038567:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 35 pid: 4545 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065126.038574:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913fad80 00000100:00100000:3.0:1746065126.038597:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1545 00000100:00100000:3.0:1746065126.038605:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261141120:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065126.040129:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881259770880:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.040151:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.040166:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d1e00, rc 0) 00000100:00100000:2.0:1746065126.043441:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+18:29103:x1830881261140992:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6680us (6755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.043452:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11036 00000100:00100000:1.0:1746065126.057051:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.057429:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881261141120:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 18822us (19050us total) trans 17179872879 rc 0/0 00000100:00100000:3.0:1746065126.057441:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1545 00002000:00100000:3.0:1746065126.057452:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2559999) req@ffff8800913fad80 x1830881261141120/t17179872879(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.057460:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fad80 with x1830881261141120 ext(2097152->2559999) 00010000:00010000:3.0:1746065126.057470:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 37 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.057482:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 37 pid: 4545 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065126.057491:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913fad80 00000100:00100000:3.0:1746065126.058185:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261141376 00000100:00100000:3.0:1746065126.058193:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261141376 00002000:00100000:3.0:1746065126.058221:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009baa0e00 x1830881261141376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.058228:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0e00 with x1830881261141376 ext(1048576->2097151) 00002000:00010000:3.0:1746065126.058231:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0e00 00000100:00100000:2.0:1746065126.058454:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5065 00000100:00100000:2.0:1746065126.058463:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261141376:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065126.063203:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.063259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.063323:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261141504 00000100:00100000:3.0:1746065126.063330:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261141504 00010000:00010000:3.0:1746065126.063358:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 39 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.063380:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5500 00000100:00100000:3.0:1746065126.063386:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881261141504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.063397:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.063413:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 39 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.063424:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 39 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.063442:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094759c00/0x14b4f8542d4f3c14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2559999) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b653 expref: 39 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.063457:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.063459:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.063465:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.063471:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.063497:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.063508:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259771008:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065126.063576:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261141632 00000100:00100000:3.0:1746065126.063579:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261141632 00000100:00100000:3.0:1746065126.063596:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11037 00000100:00100000:3.0:1746065126.063600:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:29100:x1830881261141632:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065126.063611:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.063629:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b684 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.063643:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d2 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.063649:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b549 expref: 20 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.063654:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b511 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.063663:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.063665:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.063667:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3825664->4194303] (req 3825664->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.063681:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b511 expref: 13 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.063690:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b511 expref: 13 pid: 21235 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746065126.063699:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259771136:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065126.066934:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746065126.067012:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b549 expref: 20 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065126.067027:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b549 expref: 20 pid: 8427 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746065126.067039:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259771264:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065126.067494:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d2 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065126.067508:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d2 expref: 6 pid: 8851 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746065126.067516:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259771392:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065126.067535:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.071043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.077708:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261141376:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19239us (20656us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.077718:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5065 00002000:00100000:2.0:1746065126.077728:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009baa0e00 x1830881261141376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.077737:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0e00 with x1830881261141376 ext(1048576->2097151) 00002000:00010000:2.0:1746065126.077742:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0e00 00000100:00100000:0.0:1746065126.078375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.078433:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259771008:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065126.078449:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.078466:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881261141504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 15080us (15271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.078473:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5500 00000100:00100000:1.0:1746065126.078631:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261141888 00000100:00100000:1.0:1746065126.078637:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261141888 00000100:00100000:1.0:1746065126.078673:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9089 00000100:00100000:1.0:1746065126.078679:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:29110:x1830881261141888:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065126.078698:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.078713:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3c6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b68b expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.078790:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.078800:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.078830:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.078843:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.078848:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.078853:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.078933:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.078939:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.078944:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065126.078950:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065126.079003:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079008:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079012:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079017:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e9e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.079019:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079024:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079031:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065126.079033:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065126.079036:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079039:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f3c84 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079052:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079056:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079060:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079063:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e9400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.079065:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079069:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079073:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065126.079075:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.079076:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079080:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9400/0x14b4f8542d4f3c76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079086:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079089:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079093:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079096:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e9600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.079097:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079101:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079105:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801331ac200) 00010000:00010000:1.0:1746065126.079106:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.079108:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079111:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4f3c7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.079133:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3c6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b68b expref: 261 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.079139:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3c6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b68b expref: 261 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.079144:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e9000, rc 0) 00000100:00100000:1.0:1746065126.079164:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:29110:x1830881261141888:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 485us (8130us total) trans 8589943152 rc 301/301 00000100:00100000:1.0:1746065126.079168:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9089 00000100:00100000:2.0:1746065126.079933:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142144 00000100:00100000:2.0:1746065126.079938:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142144 00002000:00100000:2.0:1746065126.079961:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a6d90700 x1830881261142144/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.079970:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90700 with x1830881261142144 ext(2097152->3145727) 00002000:00010000:2.0:1746065126.079973:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6d90700 00000100:00100000:2.0:1746065126.079995:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5066 00000100:00100000:2.0:1746065126.080001:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881261142144:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065126.081657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.084629:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142400 00000100:00100000:2.0:1746065126.084640:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142400 00002000:00100000:2.0:1746065126.084680:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800a6d90e00 x1830881261142400/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.084689:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90e00 with x1830881261142400 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.084693:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6d90e00 00000100:00100000:2.0:1746065126.084712:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5067 00000100:00100000:2.0:1746065126.084718:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261142400:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065126.086472:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259771136:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.086485:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259771264:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.086494:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259771392:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.086522:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3825664->4194303] (req 3825664->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.086536:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391da000, rc 0) 00000100:00100000:1.0:1746065126.088986:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:29100:x1830881261141632:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 25376us (25717us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.088996:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11037 00000100:00100000:0.0:1746065126.095439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.097439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.099087:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142528 00000100:00100000:1.0:1746065126.099100:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142528 00010000:00010000:1.0:1746065126.099144:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b511 expref: 13 pid: 21235 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.099192:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142784 00000100:00100000:1.0:1746065126.099196:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142784 00010000:00010000:1.0:1746065126.099221:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d2 expref: 7 pid: 8851 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.099242:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5501 00000100:00100000:1.0:1746065126.099252:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881261142528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.099270:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.099295:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b511 expref: 13 pid: 21235 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.099317:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b511 expref: 13 pid: 21235 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.099339:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133084400/0x14b4f8542d4f39a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b511 expref: 13 pid: 21235 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.099359:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.099412:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881261142528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 160us (3980us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.099419:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5501 00000100:00100000:1.0:1746065126.099441:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5502 00000100:00100000:1.0:1746065126.099448:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261142784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.099456:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.099467:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d2 expref: 7 pid: 8851 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.099475:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d2 expref: 7 pid: 8851 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.099487:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b7ce00/0x14b4f8542d4f3912 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b4d2 expref: 7 pid: 8851 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.099501:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.099522:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261142784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 75us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.099528:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5502 00000100:00100000:1.0:1746065126.099600:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.099625:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142656 00000100:00100000:1.0:1746065126.099629:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142656 00010000:00010000:1.0:1746065126.099648:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b549 expref: 21 pid: 8427 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.099671:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5503 00000100:00100000:1.0:1746065126.099677:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881261142656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.099684:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.099691:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b549 expref: 21 pid: 8427 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.099699:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b549 expref: 21 pid: 8427 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.099709:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15ca00/0x14b4f8542d4f3a00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b549 expref: 21 pid: 8427 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.099717:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.099719:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.099725:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.099735:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.099763:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.099774:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259771520:192.168.202.46@tcp:105: 00000100:00080000:0.0:1746065126.100386:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065126.100555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.100572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.100793:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142912 00000100:00100000:3.0:1746065126.100797:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142912 00000100:00100000:3.0:1746065126.100831:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261143040 00000100:00100000:3.0:1746065126.100833:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261143040 00000100:00100000:3.0:1746065126.100852:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11038 00000100:00100000:3.0:1746065126.100856:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261142912:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.100868:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065126.100872:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1780 going to sleep for 11 seconds 00010000:00010000:3.0:1746065126.100879:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b692 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.100892:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.100893:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.100897:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.100908:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.100914:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391dae00, rc 0) 00000100:00100000:3.0:1746065126.100933:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261142912:12345-192.168.202.46@tcp:101:cat.0 Request processed in 77us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.100938:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11038 00000100:00100000:3.0:1746065126.100951:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11039 00000100:00100000:3.0:1746065126.100955:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881261143040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.100962:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.100968:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801391daa00/0x14b4f8542d4f3c99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b699 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.100990:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259771648:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065126.101009:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065126.101153:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261142144:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 21151us (22778us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.101160:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5066 00002000:00100000:2.0:1746065126.101168:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a6d90700 x1830881261142144/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.101176:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90700 with x1830881261142144 ext(2097152->3145727) 00002000:00010000:2.0:1746065126.101180:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6d90700 00000100:00100000:2.0:1746065126.103870:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261142400:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 19144us (22208us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.103879:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5067 00002000:00100000:2.0:1746065126.103889:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800a6d90e00 x1830881261142400/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.103897:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6d90e00 with x1830881261142400 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.103902:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6d90e00 00000100:00100000:3.0:1746065126.104617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:2.0:1746065126.104940:0:4545:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065125 -> 1746065126 00002000:00010000:2.0:1746065126.104943:0:4545:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065125 -> 1746065127 00002000:00010000:2.0:1746065126.104945:0:4545:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065125 -> 1746065126 00000100:00100000:2.0:1746065126.104959:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259771648:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065126.104984:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801391daa00/0x14b4f8542d4f3c99 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b699 expref: 22 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.104995:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801391daa00/0x14b4f8542d4f3c99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b699 expref: 22 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065126.105128:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259771520:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065126.105141:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065126.105537:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391daa00, rc 0) 00000100:00100000:1.0:1746065126.105850:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881261142656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6171us (6250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.105859:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5503 00000100:00100000:3.0:1746065126.106142:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261143296 00000100:00100000:3.0:1746065126.106149:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261143296 00002000:00100000:3.0:1746065126.106177:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3825664->3829759) req@ffff88013667f480 x1830881261143296/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.106189:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667f480 with x1830881261143296 ext(3825664->3829759) 00002000:00010000:3.0:1746065126.106193:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013667f480 00000100:00100000:3.0:1746065126.106205:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5068 00000100:00100000:3.0:1746065126.106209:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261143296:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065126.106892:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881261143040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5934us (6317us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065126.106898:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11039 00000100:00100000:3.0:1746065126.106958:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261143296:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 748us (2343us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065126.106963:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5068 00002000:00100000:3.0:1746065126.106967:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (3825664->3829759) req@ffff88013667f480 x1830881261143296/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.106974:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667f480 with x1830881261143296 ext(3825664->3829759) 00002000:00010000:3.0:1746065126.106977:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013667f480 00000100:00100000:0.0:1746065126.113078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.113153:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.113588:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261143680 00000100:00100000:2.0:1746065126.113598:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261143680 00000100:00100000:2.0:1746065126.113649:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11040 00000100:00100000:2.0:1746065126.113659:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+18:29100:x1830881261143680:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065126.113679:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.113694:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6a0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.113721:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.113729:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 36 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.113735:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.113736:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.113740:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4833279] (req 4194304->4833279) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.113770:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 36 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.113782:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 36 pid: 4545 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746065126.113795:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259771776:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.113923:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 19 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.113933:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 19 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.113947:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259771904:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.113974:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065126.114338:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261143552 00000100:00100000:3.0:1746065126.114344:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261143552 00002000:00100000:3.0:1746065126.114376:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009a4e8380 x1830881261143552/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.114385:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8380 with x1830881261143552 ext(2097152->3145727) 00002000:00010000:3.0:1746065126.114389:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8380 00000100:00100000:3.0:1746065126.114411:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5069 00000100:00100000:3.0:1746065126.114418:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261143552:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065126.126148:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259771776:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.126159:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259771904:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.126182:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4833279] (req 4194304->4833279) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.126197:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2a00, rc 0) 00000100:00100000:2.0:1746065126.126231:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+19:29100:x1830881261143680:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 12573us (13079us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.126238:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11040 00000100:00100000:0.0:1746065126.128376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.128445:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261143808 00000100:00100000:1.0:1746065126.128453:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261143808 00010000:00010000:1.0:1746065126.128480:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 19 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.128517:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5504 00000100:00100000:1.0:1746065126.128525:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261143808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.128535:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.128552:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 19 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.128566:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 19 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.128586:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4d1e00/0x14b4f8542d4f3c61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b67d expref: 19 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.128614:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.128652:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881261143808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 128us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.128658:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5504 00000100:00100000:0.0:1746065126.131168:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.131567:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261143552:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 17149us (18500us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.131576:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5069 00002000:00100000:3.0:1746065126.131586:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009a4e8380 x1830881261143552/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.131594:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8380 with x1830881261143552 ext(2097152->3145727) 00002000:00010000:3.0:1746065126.131599:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8380 00000100:00100000:3.0:1746065126.131612:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261144064 00000100:00100000:3.0:1746065126.131618:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261144064 00002000:00100000:3.0:1746065126.131639:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009a4e9180 x1830881261144064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.131646:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9180 with x1830881261144064 ext(2097152->3145727) 00010000:00010000:3.0:1746065126.131652:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.131664:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 825 lvb_type: 1 00002000:00010000:3.0:1746065126.131670:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a4e9180 00000100:00100000:3.0:1746065126.132278:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1546 00000100:00100000:3.0:1746065126.132286:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881261144064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065126.141917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.141968:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261144192 00000100:00100000:2.0:1746065126.141975:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261144192 00000100:00100000:2.0:1746065126.142195:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11041 00000100:00100000:2.0:1746065126.142206:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+18:29103:x1830881261144192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.142224:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.142241:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6a7 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.142267:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.142269:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.142278:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a7 expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.142296:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a7 expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.142317:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbcec00, rc 0) 00000100:00100000:2.0:1746065126.142385:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+19:29103:x1830881261144192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 181us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.142390:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11041 00000100:00100000:0.0:1746065126.154074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.154173:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.154208:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.154285:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261144704 00000100:00100000:1.0:1746065126.154294:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261144704 00002000:00100000:1.0:1746065126.154333:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880133298380 x1830881261144704/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.154342:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133298380 with x1830881261144704 ext(3145728->4194303) 00002000:00010000:1.0:1746065126.154347:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133298380 00000100:00100000:1.0:1746065126.154370:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261144960 00000100:00100000:1.0:1746065126.154373:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261144960 00002000:00100000:1.0:1746065126.154386:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3825663) req@ffff880133299880 x1830881261144960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.154393:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133299880 with x1830881261144960 ext(3145728->3825663) 00002000:00010000:1.0:1746065126.154397:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133299880 00000100:00100000:1.0:1746065126.154436:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5070 00000100:00100000:1.0:1746065126.154445:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881261144704:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065126.154885:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5071 00000100:00100000:3.0:1746065126.154892:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881261144960:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065126.155095:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261144448 00000100:00100000:2.0:1746065126.155099:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261144448 00000100:00100000:2.0:1746065126.155122:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3721 00000100:00100000:2.0:1746065126.155127:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:29061:x1830881261144448:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065126.155679:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881261144064:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23393us (24514us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.155686:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1546 00002000:00100000:3.0:1746065126.155691:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009a4e9180 x1830881261144064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.155703:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9180 with x1830881261144064 ext(2097152->3145727) 00010000:00010000:3.0:1746065126.155710:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.155721:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 825 lvb_type: 1 00002000:00010000:3.0:1746065126.155726:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a4e9180 00000100:00100000:2.0:1746065126.159638:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29061:x1830881261144448:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 4502us (5567us total) trans 8589943153 rc 0/0 00000100:00100000:2.0:1746065126.159647:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3721 00000100:00100000:0.0:1746065126.177325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.177391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.177461:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261145344 00000100:00100000:2.0:1746065126.177468:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261145344 00000100:00100000:2.0:1746065126.177500:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3722 00000100:00100000:2.0:1746065126.177506:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29061:x1830881261145344:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065126.177666:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29061:x1830881261145344:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 160us (274us total) trans 8589943154 rc 0/0 00000100:00100000:2.0:1746065126.177672:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3722 00000100:00100000:1.0:1746065126.177856:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261145088 00000100:00100000:1.0:1746065126.177859:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261145088 00000100:00100000:1.0:1746065126.177887:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11042 00000100:00100000:1.0:1746065126.177891:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:29108:x1830881261145088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065126.177900:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.177911:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6ae expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.177929:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.177935:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065126.177936:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065126.177939:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.177959:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.177967:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 13 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.177976:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259772032:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.178024:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065126.178374:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881261144960:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 23482us (24164us total) trans 0 rc 679936/679936 00000100:00100000:3.0:1746065126.178382:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5071 00002000:00100000:3.0:1746065126.178391:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3825663) req@ffff880133299880 x1830881261144960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 679936/679936 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.178398:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133299880 with x1830881261144960 ext(3145728->3825663) 00010000:00010000:3.0:1746065126.178404:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 12 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.178412:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 12 pid: 9716 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065126.178417:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880133299880 00000100:00100000:0.0:1746065126.182156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.182689:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881261144704:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 28245us (28514us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065126.182701:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5070 00002000:00100000:1.0:1746065126.182710:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880133298380 x1830881261144704/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.182719:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133298380 with x1830881261144704 ext(3145728->4194303) 00002000:00010000:1.0:1746065126.182724:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133298380 00000100:00100000:2.0:1746065126.182782:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261145472 00000100:00100000:2.0:1746065126.182788:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261145472 00010000:00010000:2.0:1746065126.182811:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746065126.182848:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5505 00000100:00100000:2.0:1746065126.182853:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261145472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065126.182863:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065126.182876:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746065126.182884:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746065126.182901:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801391dae00/0x14b4f8542d4f3c92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b692 expref: 37 pid: 4545 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746065126.182926:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.182928:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.182933:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.182940:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.182963:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.182972:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259772160:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065126.183009:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.189007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.189105:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259772160:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065126.189121:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.189154:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881261145472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6300us (7002us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.189164:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5505 00000100:00100000:1.0:1746065126.192410:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259772032:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.192437:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.192450:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094758600, rc 0) 00000100:00100000:1.0:1746065126.192489:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:29108:x1830881261145088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 14596us (15169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.192495:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11042 00000100:00100000:2.0:1746065126.192585:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261145600 00000100:00100000:2.0:1746065126.192591:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261145600 00002000:00100000:2.0:1746065126.192625:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3825664->4194303) req@ffff880133299500 x1830881261145600/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.192633:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133299500 with x1830881261145600 ext(3825664->4194303) 00010000:00010000:2.0:1746065126.192639:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 12 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.192648:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 12 pid: 9716 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.192653:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880133299500 00000100:00100000:2.0:1746065126.192688:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1547 00000100:00100000:2.0:1746065126.192695:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:1959:x1830881261145600:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065126.197349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.197413:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.197421:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261145856 00000100:00100000:3.0:1746065126.197428:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261145856 00002000:00100000:3.0:1746065126.197460:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4829184->4833279) req@ffff88013329bb80 x1830881261145856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.197468:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329bb80 with x1830881261145856 ext(4829184->4833279) 00002000:00010000:3.0:1746065126.197472:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013329bb80 00000100:00100000:1.0:1746065126.197488:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261145984 00000100:00100000:1.0:1746065126.197491:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261145984 00000100:00100000:3.0:1746065126.197504:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5072 00000100:00100000:3.0:1746065126.197511:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881261145856:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065126.197512:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11043 00000100:00100000:1.0:1746065126.197516:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:29103:x1830881261145984:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065126.197522:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.197536:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6b5 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.197552:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065126.197554:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065126.197558:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.197570:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.197577:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094759600, rc 0) 00000100:00100000:1.0:1746065126.197609:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:29103:x1830881261145984:12345-192.168.202.46@tcp:101:cat.0 Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.197614:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11043 00000100:00100000:3.0:1746065126.197624:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881261145856:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 114us (285us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065126.197629:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5072 00002000:00100000:3.0:1746065126.197633:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4829184->4833279) req@ffff88013329bb80 x1830881261145856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.197639:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329bb80 with x1830881261145856 ext(4829184->4833279) 00002000:00010000:3.0:1746065126.197642:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013329bb80 00000100:00100000:2.0:1746065126.203015:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881261145600:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 10311us (14005us total) trans 21474840100 rc 0/0 00000100:00100000:2.0:1746065126.203027:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1547 00002000:00100000:2.0:1746065126.203039:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3825664->4194303) req@ffff880133299500 x1830881261145600/t21474840100(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.203048:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133299500 with x1830881261145600 ext(3825664->4194303) 00010000:00010000:2.0:1746065126.203057:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 15 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.203072:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 15 pid: 9716 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.203083:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880133299500 00000100:00100000:0.0:1746065126.204371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.204437:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261146240 00000100:00100000:2.0:1746065126.204443:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261146240 00000100:00100000:3.0:1746065126.205581:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3723 00000100:00100000:3.0:1746065126.205592:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:29100:x1830881261146240:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065126.205856:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:29100:x1830881261146240:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 266us (1486us total) trans 8589943155 rc 0/0 00000100:00100000:3.0:1746065126.205861:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3723 00000100:00080000:0.0:1746065126.205937:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065126.209992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.210059:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261146368 00000100:00100000:3.0:1746065126.210070:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261146368 00010000:00010000:3.0:1746065126.210104:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 15 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.210217:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5506 00000100:00100000:3.0:1746065126.210227:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881261146368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.210242:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065126.210259:0:7079:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065126 -> 1746065127 00002000:00010000:3.0:1746065126.210261:0:7079:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065126 -> 1746065127 00010000:00010000:3.0:1746065126.210267:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 15 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.210279:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 15 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.210298:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801391da000/0x14b4f8542d4f3c68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3825664->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b684 expref: 15 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.210836:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.210839:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.210847:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.210856:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.210864:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.210865:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.210868:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.210874:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.210902:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.210913:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259772288:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065126.211404:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.211412:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259772416:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065126.211430:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.216367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.216418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.216507:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261146624 00000100:00100000:2.0:1746065126.216515:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261146624 00002000:00100000:2.0:1746065126.216554:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88013329ad80 x1830881261146624/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.216562:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329ad80 with x1830881261146624 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.216566:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013329ad80 00000100:00100000:2.0:1746065126.216581:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261146880 00000100:00100000:2.0:1746065126.216584:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261146880 00002000:00100000:2.0:1746065126.216596:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88013329b100 x1830881261146880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.216602:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329b100 with x1830881261146880 ext(2097152->3145727) 00002000:00010000:2.0:1746065126.216604:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013329b100 00000100:00100000:2.0:1746065126.216616:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5073 00000100:00100000:2.0:1746065126.216622:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1959:x1830881261146624:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065126.217686:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5074 00000100:00100000:2.0:1746065126.217692:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881261146880:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065126.217744:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259772288:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065126.217752:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259772416:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065126.217767:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.217788:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261146368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7564us (7802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.217795:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5506 00000100:00100000:2.0:1746065126.228119:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+14:1959:x1830881261146624:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11487us (11750us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.228130:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5073 00002000:00100000:2.0:1746065126.228139:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88013329ad80 x1830881261146624/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.228149:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329ad80 with x1830881261146624 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.228154:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013329ad80 00000100:00100000:2.0:1746065126.229919:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881261146880:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12221us (13496us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.229927:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5074 00002000:00100000:2.0:1746065126.229934:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88013329b100 x1830881261146880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.229942:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013329b100 with x1830881261146880 ext(2097152->3145727) 00002000:00010000:2.0:1746065126.229946:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013329b100 00000100:00100000:0.0:1746065126.231546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.231605:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261147008 00000100:00100000:3.0:1746065126.231615:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261147008 00000100:00100000:3.0:1746065126.231659:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11044 00000100:00100000:3.0:1746065126.231666:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881261147008:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.231679:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.231693:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391db800/0x14b4f8542d4f3cbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6bc expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.231732:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259772544:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065126.231804:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87c00 going to sleep for 11 seconds 00002000:00010000:3.0:1746065126.233355:0:4545:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065126 -> 1746065127 00002000:00010000:3.0:1746065126.233359:0:4545:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065125 -> 1746065127 00002000:00010000:3.0:1746065126.233361:0:4545:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065126 -> 1746065127 00000100:00100000:3.0:1746065126.233375:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259772544:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065126.233396:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391db800/0x14b4f8542d4f3cbc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6bc expref: 20 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.233407:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801391db800/0x14b4f8542d4f3cbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6bc expref: 20 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.233427:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391db800, rc 0) 00000100:00100000:3.0:1746065126.233458:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881261147008:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1792us (1918us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065126.233464:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11044 00000100:00100000:0.0:1746065126.236624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.238149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.238593:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261147136 00000100:00100000:3.0:1746065126.238600:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261147136 00000100:00100000:3.0:1746065126.238638:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261147392 00000100:00100000:3.0:1746065126.238641:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261147392 00000100:00100000:3.0:1746065126.238655:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11045 00000100:00100000:3.0:1746065126.238661:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:29108:x1830881261147136:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065126.238662:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11046 00000100:00100000:2.0:1746065126.238668:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:29110:x1830881261147392:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065126.238675:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.238675:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.238689:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6ca expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.238712:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.238720:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.238725:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.238727:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.238729:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.238772:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6c3 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.238784:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.238786:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.238792:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6c3 expref: 37 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.238808:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6c3 expref: 37 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.238828:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391dba00, rc 0) 00000100:00100000:3.0:1746065126.238860:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:29108:x1830881261147136:12345-192.168.202.46@tcp:101:cat.0 Request processed in 199us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.238866:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11045 00000100:00100000:0.0:1746065126.238945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065126.238999:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.239010:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 13 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.239020:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259772672:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065126.239033:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261147520 00000100:00100000:3.0:1746065126.239035:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261147520 00002000:00100000:3.0:1746065126.239056:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4833280->5029887) req@ffff88012b4b0380 x1830881261147520/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.239063:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0380 with x1830881261147520 ext(4833280->5029887) 00002000:00010000:3.0:1746065126.239067:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4b0380 00010000:00010000:2.0:1746065126.239068:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.239075:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.239077:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5075 00000100:00100000:3.0:1746065126.239082:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261147520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.239083:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259772800:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.239097:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065126.242727:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259772672:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.242737:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259772800:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.242758:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2646016->3145727] (req 2646016->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.242770:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbcf000, rc 0) 00000100:00100000:2.0:1746065126.242829:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:29110:x1830881261147392:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4145us (4666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.242839:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11046 00000100:00100000:3.0:1746065126.243632:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261147520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 4547us (4685us total) trans 0 rc 196608/196608 00000100:00100000:3.0:1746065126.243639:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5075 00002000:00100000:3.0:1746065126.243648:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4833280->5029887) req@ffff88012b4b0380 x1830881261147520/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 196608/196608 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.243661:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0380 with x1830881261147520 ext(4833280->5029887) 00002000:00010000:3.0:1746065126.243666:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4b0380 00000100:00100000:0.0:1746065126.245552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.245582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.245638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.247892:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261147776 00000100:00100000:2.0:1746065126.247902:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261147776 00000100:00100000:2.0:1746065126.247937:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261147904 00000100:00100000:2.0:1746065126.247939:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261147904 00000100:00100000:2.0:1746065126.247958:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11047 00000100:00100000:2.0:1746065126.247965:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261147776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.247981:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.247996:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3cd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6d1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.248042:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259772928:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065126.248120:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065126.248138:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11048 00000100:00100000:2.0:1746065126.248143:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261147904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.248150:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.248158:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3cd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6d8 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.248169:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.248176:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3cd8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6d8 expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.248184:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3cd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6d8 expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.248199:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbce800, rc 0) 00000100:00100000:2.0:1746065126.248216:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261147904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 73us (2578us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065126.248221:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11048 00000100:00100000:3.0:1746065126.248373:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261147648 00000100:00100000:3.0:1746065126.248377:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261147648 00010000:00010000:3.0:1746065126.248392:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 14 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.248408:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5507 00000100:00100000:3.0:1746065126.248413:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881261147648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.248421:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.248437:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 14 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.248445:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 14 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.248458:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094759600/0x14b4f8542d4f3cb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6b5 expref: 14 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.248470:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.248486:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261147648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.248491:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5507 00000100:00100000:2.0:1746065126.248707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.248812:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261148416 00000100:00100000:3.0:1746065126.248834:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261148416 00002000:00100000:3.0:1746065126.248854:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012f540a80 x1830881261148416/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.248863:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f540a80 with x1830881261148416 ext(3145728->4194303) 00010000:00010000:3.0:1746065126.248868:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.248877:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065126.248883:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f540a80 00000100:00100000:3.0:1746065126.248906:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1548 00000100:00100000:3.0:1746065126.248912:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881261148416:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065126.249257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.249367:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261148288 00000100:00100000:0.0:1746065126.249371:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261148288 00002000:00100000:0.0:1746065126.249386:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012f543100 x1830881261148288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065126.249393:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f543100 with x1830881261148288 ext(3145728->4194303) 00002000:00010000:0.0:1746065126.249396:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f543100 00000100:00100000:0.0:1746065126.249784:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5076 00000100:00100000:0.0:1746065126.249790:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261148288:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065126.250812:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259772928:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065126.250856:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3cd1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6d1 expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.250866:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3cd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6d1 expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.250875:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbcfa00, rc 0) 00000100:00100000:3.0:1746065126.250899:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261147776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2933us (5315us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065126.250905:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11047 00000100:00100000:0.0:1746065126.257013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.257265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.258495:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881261148416:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 9581us (9786us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.258505:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1548 00002000:00100000:2.0:1746065126.258514:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012f540a80 x1830881261148416/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.258522:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f540a80 with x1830881261148416 ext(3145728->4194303) 00010000:00010000:2.0:1746065126.258531:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.258543:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.258549:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f540a80 00000100:00100000:3.0:1746065126.258657:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261148672 00000100:00100000:3.0:1746065126.258664:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261148672 00000100:00100000:3.0:1746065126.258687:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261148544 00000100:00100000:3.0:1746065126.258689:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261148544 00000100:00100000:3.0:1746065126.258701:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11049 00000100:00100000:3.0:1746065126.258707:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261148672:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.258720:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.258730:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801391db600/0x14b4f8542d4f3cdf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6e6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.258746:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.258755:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801391db600/0x14b4f8542d4f3cdf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6e6 expref: 14 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.258764:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801391db600/0x14b4f8542d4f3cdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6e6 expref: 14 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.258773:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391db600, rc 0) 00000100:00100000:3.0:1746065126.258789:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261148672:12345-192.168.202.46@tcp:101:cat.0 Request processed in 82us (1785us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065126.258794:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11049 00000100:00100000:3.0:1746065126.258804:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11050 00000100:00100000:3.0:1746065126.258809:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261148544:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.258832:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.258840:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3ce6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6df expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.258872:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259773056:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065126.258909:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065126.260953:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261148288:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11158us (11692us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.260961:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5076 00002000:00100000:2.0:1746065126.260968:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012f543100 x1830881261148288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.260980:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f543100 with x1830881261148288 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.260984:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f543100 00000100:00100000:2.0:1746065126.261545:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259773056:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065126.261568:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3ce6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6df expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.261579:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3ce6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6df expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.261949:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391db000, rc 0) 00000100:00100000:2.0:1746065126.262078:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261148544:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3268us (4812us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065126.262083:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11050 00000100:00100000:2.0:1746065126.262843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.262903:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261148800 00000100:00100000:1.0:1746065126.262908:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261148800 00010000:00010000:1.0:1746065126.262929:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.263135:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5508 00000100:00100000:1.0:1746065126.263141:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f543480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881261148800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.263150:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.263163:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.263172:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.263186:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094758600/0x14b4f8542d4f3cae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ae expref: 22 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.263293:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.263295:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.263301:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.263316:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.263340:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.263348:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259773184:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065126.263514:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.265681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.265783:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261148928 00000100:00100000:2.0:1746065126.265788:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261148928 00000100:00100000:2.0:1746065126.265848:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11051 00000100:00100000:2.0:1746065126.265855:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:29108:x1830881261148928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.265867:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.265878:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6ed expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.265895:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.265905:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065126.265906:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065126.265908:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.265925:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.265934:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 23 pid: 8429 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.265942:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259773312:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.265991:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065126.266161:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259773184:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065126.266174:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.266194:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f543480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881261148800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3053us (3352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.266201:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5508 00000100:00100000:0.0:1746065126.267519:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.267651:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261149184 00000100:00100000:2.0:1746065126.267655:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261149184 00002000:00100000:2.0:1746065126.267677:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2646016->2650111) req@ffff88009f046a00 x1830881261149184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.267685:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046a00 with x1830881261149184 ext(2646016->2650111) 00010000:00010000:2.0:1746065126.267692:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 23 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.267702:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 23 pid: 8429 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.267708:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f046a00 00000100:00100000:2.0:1746065126.267726:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1549 00000100:00100000:2.0:1746065126.267732:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881261149184:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065126.267870:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881261149184:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 138us (352us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065126.267875:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1549 00002000:00100000:2.0:1746065126.267880:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (2646016->2650111) req@ffff88009f046a00 x1830881261149184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.267886:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f046a00 with x1830881261149184 ext(2646016->2650111) 00010000:00010000:2.0:1746065126.267890:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 23 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.267897:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 23 pid: 8429 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.267903:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f046a00 00000100:00100000:3.0:1746065126.268227:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259773312:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065126.268243:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.268253:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7c800, rc 0) 00000100:00100000:3.0:1746065126.268281:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:29108:x1830881261148928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2427us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.268287:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11051 00000100:00100000:0.0:1746065126.272989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.273354:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261149568 00000100:00100000:3.0:1746065126.273361:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261149568 00000100:00100000:0.0:1746065126.273413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.273490:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11052 00000100:00100000:3.0:1746065126.273498:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:29110:x1830881261149568:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065126.273514:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.273528:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6f4 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.273598:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261149440 00000100:00100000:2.0:1746065126.273602:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261149440 00002000:00100000:2.0:1746065126.273625:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2646016->3145727) req@ffff88009f044000 x1830881261149440/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.273633:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044000 with x1830881261149440 ext(2646016->3145727) 00010000:00010000:2.0:1746065126.273639:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 22 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.273651:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 22 pid: 8429 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.273661:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f044000 00010000:00010000:3.0:1746065126.273673:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a7 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.273680:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6c3 expref: 38 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.273683:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1550 00010000:00010000:3.0:1746065126.273686:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065126.273687:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:2.0:1746065126.273688:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881261149440:12345-192.168.202.46@tcp:4:multiop.0 00010000:00010000:3.0:1746065126.273690:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->3452927] (req 3145728->3452927) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 38 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.273712:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6c3 expref: 38 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.273721:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6c3 expref: 38 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.273731:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259773440:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065126.273934:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a7 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.273941:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a7 expref: 18 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.273948:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259773568:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065126.273963:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065126.276506:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259773440:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065126.277612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.278386:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259773568:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065126.278412:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->3452927] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 38 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.278426:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801391db000, rc 0) 00000100:00100000:3.0:1746065126.278461:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:29110:x1830881261149568:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4964us (5477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.278469:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11052 00000100:00100000:0.0:1746065126.279023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.279176:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261149696 00000100:00100000:1.0:1746065126.279182:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261149696 00010000:00010000:1.0:1746065126.279203:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6c3 expref: 38 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.279236:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261149824 00000100:00100000:2.0:1746065126.279240:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261149824 00010000:00010000:2.0:1746065126.279252:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a7 expref: 19 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.279268:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5509 00000100:00100000:2.0:1746065126.279274:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881261149696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065126.279285:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065126.279300:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6c3 expref: 38 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.279319:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6c3 expref: 38 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.279336:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801391dba00/0x14b4f8542d4f3cca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6c3 expref: 38 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.279349:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065126.279367:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881261149696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.279373:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5509 00000100:00100000:2.0:1746065126.279384:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5510 00000100:00100000:2.0:1746065126.279389:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261149824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065126.279395:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065126.279402:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a7 expref: 19 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.279409:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a7 expref: 19 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.279418:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3ca7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a7 expref: 19 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.279426:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.279427:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.279433:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 36 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.279441:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 36 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.279464:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 36 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.279475:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259773696:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065126.279553:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.281459:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259773696:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065126.281472:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065126.281497:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261149824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2107us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.281503:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5510 00000100:00100000:3.0:1746065126.283528:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881261149440:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 9832us (10111us total) trans 21474840101 rc 0/0 00000100:00100000:3.0:1746065126.283541:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1550 00002000:00100000:3.0:1746065126.283550:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2646016->3145727) req@ffff88009f044000 x1830881261149440/t21474840101(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.283559:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f044000 with x1830881261149440 ext(2646016->3145727) 00010000:00010000:3.0:1746065126.283567:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 24 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.283580:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 24 pid: 8429 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065126.283586:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f044000 00000100:00100000:0.0:1746065126.284949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.285158:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261150080 00000100:00100000:3.0:1746065126.285165:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261150080 00002000:00100000:3.0:1746065126.285192:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3448832->3452927) req@ffff88012f3d1f80 x1830881261150080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.285200:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1f80 with x1830881261150080 ext(3448832->3452927) 00002000:00010000:3.0:1746065126.285204:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d1f80 00000100:00100000:0.0:1746065126.285206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.285225:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5077 00000100:00100000:3.0:1746065126.285232:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881261150080:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065126.285260:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261150208 00000100:00100000:1.0:1746065126.285264:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261150208 00010000:00010000:1.0:1746065126.285280:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 24 pid: 8429 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.285317:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5511 00000100:00100000:1.0:1746065126.285322:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881261150208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.285331:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.285342:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 24 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.285351:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 24 pid: 8429 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.285359:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881261150080:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 128us (413us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065126.285364:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5077 00010000:00010000:1.0:1746065126.285367:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3cc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ca expref: 24 pid: 8429 timeout: 825 lvb_type: 0 00002000:00100000:3.0:1746065126.285368:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3448832->3452927) req@ffff88012f3d1f80 x1830881261150080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.285380:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1f80 with x1830881261150080 ext(3448832->3452927) 00010000:00010000:1.0:1746065126.285381:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746065126.285383:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d1f80 00010000:00010000:1.0:1746065126.285383:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.285389:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.285396:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.285420:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.285430:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259773824:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065126.285473:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.287107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.287155:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261150464 00000100:00100000:2.0:1746065126.287160:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261150464 00000100:00100000:2.0:1746065126.287200:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3724 00000100:00100000:2.0:1746065126.287208:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:29110:x1830881261150464:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065126.287363:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:29110:x1830881261150464:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 155us (260us total) trans 8589943156 rc 0/0 00000100:00100000:2.0:1746065126.287368:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3724 00000100:00100000:1.0:1746065126.287991:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259773824:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065126.288004:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.288024:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881261150208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2702us (2818us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.288031:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5511 00000100:00100000:0.0:1746065126.290610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.290662:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261150720 00000100:00100000:1.0:1746065126.290668:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261150720 00002000:00100000:1.0:1746065126.290698:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012f3d1c00 x1830881261150720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.290707:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1c00 with x1830881261150720 ext(3145728->4194303) 00002000:00010000:1.0:1746065126.290711:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d1c00 00000100:00100000:1.0:1746065126.290742:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5078 00000100:00100000:1.0:1746065126.290749:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881261150720:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065126.297438:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881261150720:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 6678us (6822us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065126.297448:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5078 00002000:00100000:1.0:1746065126.297457:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012f3d1c00 x1830881261150720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.297466:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1c00 with x1830881261150720 ext(3145728->4194303) 00002000:00010000:1.0:1746065126.297470:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d1c00 00000100:00100000:0.0:1746065126.300095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.300155:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261150848 00000100:00100000:3.0:1746065126.300162:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261150848 00000100:00100000:3.0:1746065126.300199:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11053 00000100:00100000:3.0:1746065126.300206:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261150848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.300221:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.300234:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a010a600/0x14b4f8542d4f3cfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b6fb expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.300284:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259773952:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065126.300375:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065126.301868:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259773952:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065126.302084:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a010a600/0x14b4f8542d4f3cfb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6fb expref: 38 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.302097:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a010a600/0x14b4f8542d4f3cfb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6fb expref: 38 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.302119:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a010a600, rc 0) 00000100:00100000:3.0:1746065126.302192:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261150848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1985us (2100us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065126.302198:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11053 00000100:00100000:0.0:1746065126.303926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.304059:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261150976 00000100:00100000:3.0:1746065126.304066:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261150976 00000100:00100000:3.0:1746065126.304107:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11054 00000100:00100000:3.0:1746065126.304114:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:29108:x1830881261150976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.304364:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.304378:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b702 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.304402:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 17 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.304409:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065126.304411:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065126.304414:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->5029887] (req 4194304->5029887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 38 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.304437:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 17 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.304448:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 17 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.304458:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259774080:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065126.304524:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.307869:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.307896:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261151104 00000100:00100000:1.0:1746065126.307903:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261151104 00000100:00100000:3.0:1746065126.307913:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259774080:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065126.307937:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->5029887] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 38 pid: 8429 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065126.307939:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4833279) req@ffff88012f3d1180 x1830881261151104/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.307948:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1180 with x1830881261151104 ext(4194304->4833279) 00010000:00010000:3.0:1746065126.307954:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a010a800, rc 0) 00010000:00010000:1.0:1746065126.307955:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 18 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.307972:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 18 pid: 4545 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746065126.307978:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3d1180 00000100:00100000:3.0:1746065126.307997:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:29108:x1830881261150976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3882us (4074us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.308004:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11054 00000100:00100000:1.0:1746065126.308006:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1551 00000100:00100000:1.0:1746065126.308013:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881261151104:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065126.319412:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.319583:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261151232 00000100:00100000:3.0:1746065126.319590:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261151232 00000100:00100000:3.0:1746065126.319623:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9090 00000100:00100000:3.0:1746065126.319630:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29115:x1830881261151232:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065126.319647:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.319659:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010aa00/0x14b4f8542d4f3d09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b709 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.319702:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319711:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319720:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319729:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319734:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319737:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319829:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319836:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319841:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065126.319863:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065126.319867:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065126.319878:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319886:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319892:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319897:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319902:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319906:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a010ac00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065126.319910:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319914:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319922:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065126.319925:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065126.319928:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319938:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ac00/0x14b4f8542d4f3d10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319949:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319953:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319957:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319961:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a010ae00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065126.319962:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319966:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319971:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008fd8ec00) 00010000:00010000:3.0:1746065126.319973:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065126.319974:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319978:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010ae00/0x14b4f8542d4f3d17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.319997:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010aa00/0x14b4f8542d4f3d09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b709 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.320010:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b709 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.320015:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.320017:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065126.320019:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a010b000, rc 0) 00000100:00100000:3.0:1746065126.320068:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29115:x1830881261151232:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 438us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.320073:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9090 00000100:00100000:0.0:1746065126.323791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.323979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.323999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.324015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.324346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.324431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.324469:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261151360 00000100:00100000:3.0:1746065126.324476:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261151360 00000100:00100000:3.0:1746065126.324512:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261151488 00000100:00100000:3.0:1746065126.324514:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261151488 00000100:00100000:3.0:1746065126.324525:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261151616 00000100:00100000:3.0:1746065126.324527:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261151616 00000100:00100000:2.0:1746065126.324569:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261151744 00000100:00100000:2.0:1746065126.324572:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261151744 00000100:00100000:3.0:1746065126.324884:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261151872 00000100:00100000:3.0:1746065126.324887:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261151872 00000100:00100000:1.0:1746065126.324893:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261152000 00000100:00100000:1.0:1746065126.324896:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261152000 00000100:00100000:3.0:1746065126.324901:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11055 00000100:00100000:3.0:1746065126.324907:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261151360:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065126.324915:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11056 00000100:00100000:1.0:1746065126.324918:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261151488:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065126.324921:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.324924:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.324933:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b710 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.324933:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b717 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.324951:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.324951:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.324953:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.324953:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.324959:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b710 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.324959:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b717 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.324971:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b710 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.324971:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b717 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.324979:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a010b800, rc 0) 00010000:00010000:1.0:1746065126.324979:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd8c200, rc 0) 00000100:00100000:1.0:1746065126.325012:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261151488:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 93us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.325021:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11056 00000100:00100000:1.0:1746065126.325033:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11057 00000100:00100000:1.0:1746065126.325037:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261151616:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065126.325042:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.325047:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b71e expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.325056:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.325058:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.325061:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b71e expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065126.325065:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11058 00010000:00010000:1.0:1746065126.325069:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b71e expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065126.325070:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261151744:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065126.325075:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.325075:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd8c400, rc 0) 00010000:00010000:2.0:1746065126.325081:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b725 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.325088:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.325089:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.325093:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b725 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.325100:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b725 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.325111:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8a9600, rc 0) 00000100:00100000:0.0:1746065126.325142:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11059 00000100:00100000:0.0:1746065126.325148:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261151872:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065126.325154:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.325160:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2800/0x14b4f8542d4f3d41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b72c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065126.325191:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259774208:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065126.325298:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261151360:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 390us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.325311:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11055 00000100:00100000:3.0:1746065126.325322:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11060 00000100:00100000:3.0:1746065126.325326:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261152000:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065126.325332:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.325337:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b733 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.325346:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.325347:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.325351:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b733 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.325359:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b733 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.325365:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a010a400, rc 0) 00000100:00100000:3.0:1746065126.325380:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261152000:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 53us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.325385:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11060 00000100:00100000:1.0:1746065126.325510:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261151616:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 471us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.325514:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11057 00000100:00100000:3.0:1746065126.325690:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261151104:12345-192.168.202.46@tcp:4:cat.0 Request processed in 17677us (17826us total) trans 17179872880 rc 0/0 00000100:00100000:3.0:1746065126.325696:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1551 00002000:00100000:3.0:1746065126.325704:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4833279) req@ffff88012f3d1180 x1830881261151104/t17179872880(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.325712:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1180 with x1830881261151104 ext(4194304->4833279) 00010000:00010000:3.0:1746065126.325718:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 20 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.325728:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 20 pid: 4545 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065126.325734:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3d1180 00000100:00100000:2.0:1746065126.325876:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261151744:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 805us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.325881:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11058 00000100:00100000:1.0:1746065126.326172:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065126.327759:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259774208:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065126.327788:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2800/0x14b4f8542d4f3d41 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b72c expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.327799:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2800/0x14b4f8542d4f3d41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b72c expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.327840:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2800, rc 0) 00000100:00100000:1.0:1746065126.327877:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261151872:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2728us (3530us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065126.327883:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11059 00000100:00100000:0.0:1746065126.328043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.329536:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261152128 00000100:00100000:1.0:1746065126.329544:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261152128 00010000:00010000:1.0:1746065126.329570:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 20 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746065126.329860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.330035:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5512 00000100:00100000:1.0:1746065126.330043:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261152128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.330055:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065126.330070:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261152384 00010000:00010000:1.0:1746065126.330071:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 20 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746065126.330073:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261152384 00010000:00010000:1.0:1746065126.330081:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 20 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.330097:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f3ca0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4833279) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6a0 expref: 20 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.330108:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.330110:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.330115:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065126.330286:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9091 00000100:00100000:0.0:1746065126.330292:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29115:x1830881261152384:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065126.330314:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.330326:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2200/0x14b4f8542d4f3d4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b73a expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.330359:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.330383:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.330389:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065126.330392:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259774336:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065126.330399:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b581 expref: 260 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.330404:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ab expref: 17 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.330409:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b709 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.330414:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.330429:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b709 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.330438:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b709 expref: 10 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746065126.330446:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130269500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259774464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.330525:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1900 going to sleep for 11 seconds 00010000:00010000:0.0:1746065126.331460:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ab expref: 17 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.331470:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ab expref: 17 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746065126.331478:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259774592:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065126.331507:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b581 expref: 260 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.331514:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b581 expref: 260 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746065126.331520:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259774720:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065126.331535:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065126.333145:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259774336:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065126.333160:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.333187:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261152128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3143us (5144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.333195:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5512 00000100:00100000:0.0:1746065126.334549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.334578:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.334608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.334661:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261152512 00000100:00100000:3.0:1746065126.334667:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261152512 00010000:00010000:3.0:1746065126.334693:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ab expref: 18 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.334712:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261152768 00000100:00100000:3.0:1746065126.334714:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261152768 00010000:00010000:3.0:1746065126.334722:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b709 expref: 11 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.334732:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261152640 00000100:00100000:3.0:1746065126.334734:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261152640 00010000:00010000:3.0:1746065126.334741:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b581 expref: 261 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.334751:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5513 00000100:00100000:3.0:1746065126.334757:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881261152512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.334767:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.334771:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ab expref: 18 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.334778:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ab expref: 18 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.334794:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.334798:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.334804:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.334809:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.334851:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:1959:x1830881261152512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.334857:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5513 00000100:00100000:3.0:1746065126.334867:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5514 00000100:00100000:3.0:1746065126.334871:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881261152768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.334878:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.334881:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b709 expref: 11 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.334887:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b709 expref: 11 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.334899:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.334902:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.334907:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.334910:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.334923:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881261152768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.334928:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5514 00000100:00100000:3.0:1746065126.334970:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5515 00000100:00100000:3.0:1746065126.334975:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:1958:x1830881261152640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.334980:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.334983:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b581 expref: 261 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.334991:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b581 expref: 261 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.335000:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.335002:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.335008:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.335013:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.335025:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.335039:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:1958:x1830881261152640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.335043:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5515 00010000:00010000:2.0:1746065126.335394:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010b000/0x14b4f8542d4f3d1e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b709 expref: 10 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.335410:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130269500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259774464:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.335420:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4f3b03 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5ab expref: 17 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.335428:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259774592:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.335435:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b600/0x14b4f8542d4f3a7e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b581 expref: 260 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.335442:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259774720:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.335457:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.335463:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.335467:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065126.335482:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000100:00100000:0.0:1746065126.335508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065126.335588:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2200/0x14b4f8542d4f3d4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b73a expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.335599:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b73a expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.335604:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.335606:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065126.335608:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2000, rc 0) 00000100:00100000:2.0:1746065126.335642:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29115:x1830881261152384:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 5350us (5784us total) trans 8589943157 rc 0/0 00000100:00100000:3.0:1746065126.335872:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153024 00000100:00100000:3.0:1746065126.335876:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153024 00002000:00100000:3.0:1746065126.335898:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880093ba0e00 x1830881261153024/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.335906:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0e00 with x1830881261153024 ext(4194304->5029887) 00002000:00010000:3.0:1746065126.335909:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba0e00 00000100:00100000:3.0:1746065126.335922:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5079 00000100:00100000:3.0:1746065126.335927:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261153024:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.336442:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9091 00000100:00100000:0.0:1746065126.341251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.341790:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153280 00000100:00100000:2.0:1746065126.341798:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153280 00000100:00100000:2.0:1746065126.341865:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9092 00000100:00100000:2.0:1746065126.341872:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29115:x1830881261153280:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065126.341891:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.341894:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065126.341915:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3d56 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b73a expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.341929:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.341933:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065126.341941:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9e00/0x14b4f8542d4f3d64 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b741 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.342008:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.342018:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.342025:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065126.342033:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065126.342120:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9e00/0x14b4f8542d4f3d64 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b741 expref: 12 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.342131:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b741 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.342137:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.342139:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065126.342141:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8a9a00, rc 0) 00000100:00100000:2.0:1746065126.342176:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:29115:x1830881261153280:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 305us (932us total) trans 8589943158 rc 0/0 00000100:00100000:2.0:1746065126.342182:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9092 00000100:00100000:3.0:1746065126.343397:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261153024:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7466us (7886us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065126.343405:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5079 00002000:00100000:3.0:1746065126.343414:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880093ba0e00 x1830881261153024/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.343422:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0e00 with x1830881261153024 ext(4194304->5029887) 00002000:00010000:3.0:1746065126.343426:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba0e00 00000100:00100000:0.0:1746065126.343641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.343848:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153408 00000100:00100000:3.0:1746065126.343854:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153408 00000100:00100000:3.0:1746065126.343875:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9093 00000100:00100000:3.0:1746065126.343881:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:29115:x1830881261153408:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065126.343893:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.343904:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010a600/0x14b4f8542d4f3d79 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b748 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.343935:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010a600/0x14b4f8542d4f3d79 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b748 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.343951:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010a600/0x14b4f8542d4f3d79 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b748 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.343965:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.343968:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065126.343970:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a010a600, rc 0) 00000100:00100000:3.0:1746065126.343990:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29115:x1830881261153408:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.343995:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9093 00000100:00100000:0.0:1746065126.346375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.346442:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153536 00000100:00100000:1.0:1746065126.346449:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153536 00000100:00100000:1.0:1746065126.346486:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11061 00000100:00100000:1.0:1746065126.346492:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881261153536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065126.346506:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.346519:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd8c800/0x14b4f8542d4f3d80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b74f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.346542:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd8c800/0x14b4f8542d4f3d80 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b74f expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.346554:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd8c800/0x14b4f8542d4f3d80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b74f expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.346571:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd8c800, rc 0) 00000100:00100000:1.0:1746065126.346616:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881261153536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 124us (247us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065126.346622:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11061 00000100:00100000:3.0:1746065126.347726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.347750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.347769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.347779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.347789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.347802:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153664 00000100:00100000:3.0:1746065126.347806:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153664 00000100:00100000:3.0:1746065126.347846:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153920 00000100:00100000:3.0:1746065126.347847:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153920 00000100:00100000:3.0:1746065126.347856:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154176 00000100:00100000:3.0:1746065126.347858:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154176 00000100:00100000:3.0:1746065126.347865:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153792 00000100:00100000:3.0:1746065126.347867:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153792 00000100:00100000:3.0:1746065126.347873:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154048 00000100:00100000:3.0:1746065126.347874:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154048 00000100:00100000:3.0:1746065126.347884:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11062 00000100:00100000:3.0:1746065126.347890:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261153664:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065126.347912:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.347924:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 37 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.347931:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b710 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.347937:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b64c expref: 18 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.347943:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.347945:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.347947:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.347970:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b64c expref: 18 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.347981:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b64c expref: 18 pid: 4544 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746065126.347991:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259774848:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.348058:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11063 00000100:00100000:1.0:1746065126.348065:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261153920:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065126.348082:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.348092:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 12 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.348099:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b71e expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.348106:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b614 expref: 22 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.348111:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.348112:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.348114:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.348133:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b614 expref: 22 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.348141:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b614 expref: 22 pid: 8429 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.348150:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259774976:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.348202:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11064 00000100:00100000:2.0:1746065126.348211:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261154176:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065126.348227:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.348235:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.348241:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.348245:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065126.348246:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065126.348248:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.348262:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.348269:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 37 pid: 8429 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.348277:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259775104:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065126.348857:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b710 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.348866:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b710 expref: 9 pid: 8429 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746065126.348873:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259775232:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.348929:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b71e expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.348936:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b71e expref: 10 pid: 9716 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.348943:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259775360:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.348967:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 12 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.348974:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.348980:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259775488:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.348995:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065126.349009:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11065 00000100:00100000:1.0:1746065126.349014:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261153792:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065126.349029:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.349038:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.349044:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b717 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.349051:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b65a expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.349056:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.349057:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.349059:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.349070:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b65a expref: 12 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.349077:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b65a expref: 12 pid: 9716 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.349084:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259775616:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.349105:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b717 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.349114:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b717 expref: 10 pid: 9716 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.349121:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259775744:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.349138:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.349145:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 22 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.349150:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259775872:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.349162:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1780 going to sleep for 11 seconds 00010000:00010000:2.0:1746065126.349243:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.349251:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 37 pid: 8429 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.349259:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259776000:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.349272:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065126.349285:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11066 00000100:00100000:2.0:1746065126.349291:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261154048:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065126.349314:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.349323:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.349329:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b725 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.349334:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b676 expref: 37 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.349339:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.349341:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.349342:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.349360:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b676 expref: 37 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.349366:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b676 expref: 37 pid: 4545 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746065126.349373:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259776128:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.349389:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b725 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.349395:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b725 expref: 9 pid: 8428 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746065126.349401:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259776256:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.349414:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 18 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.349419:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 18 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.349425:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259776384:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.349432:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065126.349463:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 37 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.349470:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 37 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.349476:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259776512:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065126.349487:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065126.349529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.350290:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154304 00000100:00100000:2.0:1746065126.350295:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154304 00000100:00100000:2.0:1746065126.350327:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11067 00000100:00100000:2.0:1746065126.350332:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261154304:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065126.350347:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.350356:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.350362:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b733 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.350367:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.350368:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.350370:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 5/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.350383:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b733 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.350389:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b733 expref: 11 pid: 8429 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746065126.350397:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259776640:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.350708:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.350721:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 22 pid: 8429 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.350728:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d87480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259776768:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.350745:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.356645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.356762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.356784:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154560 00000100:00100000:0.0:1746065126.356790:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154560 00010000:00010000:0.0:1746065126.356833:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b71e expref: 12 pid: 9716 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746065126.356857:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5516 00000100:00100000:0.0:1746065126.356863:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881261154560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065126.356873:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065126.356891:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b71e expref: 12 pid: 9716 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746065126.356901:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b71e expref: 12 pid: 9716 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746065126.356925:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065126.356956:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881261154560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.356961:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5516 00000100:00100000:0.0:1746065126.357111:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259776640:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065126.357133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.357142:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155200 00000100:00100000:0.0:1746065126.357144:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155200 00010000:00010000:0.0:1746065126.357154:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b65a expref: 13 pid: 9716 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746065126.357215:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259775104:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.357223:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259776000:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.357242:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.357265:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259774848:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.357271:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259775232:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.357278:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259776512:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.357293:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.357319:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259776128:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.357325:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259776256:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.357330:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259776384:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.357339:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.357406:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5517 00000100:00100000:1.0:1746065126.357413:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881261155200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.357422:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.357432:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b65a expref: 13 pid: 9716 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.357440:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b65a expref: 13 pid: 9716 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.357451:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.357470:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+13:1958:x1830881261155200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.357478:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5517 00010000:00010000:1.0:1746065126.357504:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094758a00/0x14b4f8542d4f3c22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b65a expref: 12 pid: 9716 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.357516:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259775616:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.357524:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259775744:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.357531:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259775872:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.357546:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.357565:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259774976:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.357571:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c400/0x14b4f8542d4f3d33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b71e expref: 11 pid: 9716 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.357579:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259775360:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.357585:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259775488:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.357596:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.357621:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.357634:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154688 00000100:00100000:1.0:1746065126.357636:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154688 00010000:00010000:1.0:1746065126.357647:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.357661:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5518 00000100:00100000:1.0:1746065126.357664:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881261154688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.357670:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.357676:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.357682:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.357692:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134d56600/0x14b4f8542d4f3b2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b5d5 expref: 12 pid: 21998 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.357700:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.357712:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261154688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.357717:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5518 00000100:00100000:3.0:1746065126.357762:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154432 00000100:00100000:3.0:1746065126.357765:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154432 00000100:00100000:3.0:1746065126.357784:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11068 00000100:00100000:3.0:1746065126.357789:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881261154432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.357800:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.357809:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b26ac00/0x14b4f8542d4f3db1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b756 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.357844:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b26ac00/0x14b4f8542d4f3db1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b756 expref: 39 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.357852:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b26ac00/0x14b4f8542d4f3db1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b756 expref: 39 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.357866:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b26ac00, rc 0) 00000100:00100000:3.0:1746065126.357881:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881261154432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 92us (1244us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065126.357886:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11068 00000100:00100000:3.0:1746065126.357936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.357949:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155328 00000100:00100000:3.0:1746065126.357952:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155328 00002000:00100000:3.0:1746065126.357968:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3452927) req@ffff88013667ea00 x1830881261155328/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.357975:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667ea00 with x1830881261155328 ext(3145728->3452927) 00010000:00010000:3.0:1746065126.357980:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 38 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.357988:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 38 pid: 8429 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746065126.357993:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013667ea00 00000100:00100000:3.0:1746065126.358002:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1552 00000100:00100000:3.0:1746065126.358005:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881261155328:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065126.359496:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d87480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259776768:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065126.359514:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065126.359576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.359588:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154944 00000100:00100000:0.0:1746065126.359591:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154944 00010000:00010000:0.0:1746065126.359607:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b717 expref: 11 pid: 9716 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746065126.359624:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5519 00000100:00100000:0.0:1746065126.359629:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261154944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065126.359637:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065126.359649:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b717 expref: 11 pid: 9716 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746065126.359657:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b717 expref: 11 pid: 9716 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746065126.359671:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c200/0x14b4f8542d4f3d2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b717 expref: 11 pid: 9716 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746065126.359684:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065126.359702:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261154944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.359708:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5519 00000100:00100000:0.0:1746065126.360352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.363266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.363357:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155456 00000100:00100000:2.0:1746065126.363365:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155456 00010000:00010000:2.0:1746065126.363392:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 23 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.363425:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5520 00000100:00100000:2.0:1746065126.363432:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881261155456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065126.363442:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065126.363458:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 23 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.363466:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 23 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.363484:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e8f800/0x14b4f8542d4f3b9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b629 expref: 23 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.363506:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.363508:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.363511:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.363518:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.363533:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065126.363561:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881261155456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 129us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.363566:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5520 00010000:00010000:1.0:1746065126.363903:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.363910:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.363926:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.363936:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.363941:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.363946:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd8d600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065126.363949:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.363955:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.363963:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.363968:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd8d600/0x14b4f8542d4f3d9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.364002:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261153792:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 14988us (16222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.364008:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11065 00000100:00100000:0.0:1746065126.364086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.364097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.364106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.364115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.364125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.364134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.364143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.364156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.364203:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155712 00000100:00100000:1.0:1746065126.364206:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155712 00010000:00010000:1.0:1746065126.364219:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b725 expref: 10 pid: 8428 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.364232:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155968 00000100:00100000:1.0:1746065126.364234:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155968 00010000:00010000:1.0:1746065126.364241:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 19 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.364247:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261156224 00000100:00100000:1.0:1746065126.364248:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261156224 00010000:00010000:1.0:1746065126.364255:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 40 pid: 4545 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.364261:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154816 00000100:00100000:1.0:1746065126.364263:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154816 00010000:00010000:1.0:1746065126.364268:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b64c expref: 20 pid: 4544 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.364274:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155072 00000100:00100000:1.0:1746065126.364275:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155072 00010000:00010000:1.0:1746065126.364280:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b710 expref: 11 pid: 8429 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.364286:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155584 00000100:00100000:1.0:1746065126.364287:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155584 00010000:00010000:1.0:1746065126.364293:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b614 expref: 22 pid: 8429 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.364298:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155840 00000100:00100000:1.0:1746065126.364299:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155840 00010000:00010000:1.0:1746065126.364316:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b676 expref: 41 pid: 4545 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.364323:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261156096 00000100:00100000:1.0:1746065126.364325:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261156096 00010000:00010000:1.0:1746065126.364331:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b733 expref: 9 pid: 8429 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.364337:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261156352 00000100:00100000:1.0:1746065126.364338:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261156352 00010000:00010000:1.0:1746065126.364344:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 23 pid: 8429 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.364351:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5521 00000100:00100000:1.0:1746065126.364355:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261155712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.364361:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.364371:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b725 expref: 11 pid: 8428 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.364378:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b725 expref: 11 pid: 8428 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.364388:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9600/0x14b4f8542d4f3d3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b725 expref: 11 pid: 8428 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.364396:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.364421:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261155712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.364425:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5521 00000100:00100000:1.0:1746065126.364454:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5522 00000100:00100000:1.0:1746065126.364458:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261155968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.364463:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.364468:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 20 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.364475:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 20 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.364483:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3c30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b668 expref: 20 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.364490:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.364499:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261155968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 42us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.364503:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5522 00000100:00100000:1.0:1746065126.364511:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5523 00000100:00100000:1.0:1746065126.364514:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881261156224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.364519:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.364526:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 41 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.364531:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 41 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.364540:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4f3b96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b622 expref: 41 pid: 4545 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.364547:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.364558:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1961:x1830881261156224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 43us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.364562:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5523 00000100:00100000:1.0:1746065126.364569:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5524 00000100:00100000:1.0:1746065126.364573:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261154816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.364577:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.364583:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b64c expref: 18 pid: 4544 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.364590:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b64c expref: 18 pid: 4544 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.364599:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c25c200/0x14b4f8542d4f3c1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b64c expref: 18 pid: 4544 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.364605:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.364615:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881261154816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 42us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.364619:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5524 00000100:00100000:1.0:1746065126.364626:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5525 00000100:00100000:1.0:1746065126.364630:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261155072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.364635:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.364641:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b710 expref: 9 pid: 8429 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.364647:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b710 expref: 9 pid: 8429 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.364656:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a010b800/0x14b4f8542d4f3d25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b710 expref: 9 pid: 8429 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.364661:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.364662:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.364665:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.364671:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.364685:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.364698:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261155072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.364702:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5525 00000100:00100000:1.0:1746065126.364711:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5526 00000100:00100000:1.0:1746065126.364715:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881261155584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065126.364933:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5527 00000100:00100000:3.0:1746065126.364939:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261155840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.364945:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.364953:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b676 expref: 39 pid: 4545 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.364964:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b676 expref: 39 pid: 4545 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.364973:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3c5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b676 expref: 39 pid: 4545 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.364981:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.364982:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.364984:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.364989:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.365000:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.365014:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881261155840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.365019:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5527 00000100:00100000:3.0:1746065126.365029:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5528 00000100:00100000:3.0:1746065126.365032:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261156096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.365038:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.365046:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b733 expref: 9 pid: 8429 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.365052:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b733 expref: 9 pid: 8429 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.365061:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a010a400/0x14b4f8542d4f3d48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b733 expref: 9 pid: 8429 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.365069:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.365080:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261156096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.365083:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5528 00000100:00100000:3.0:1746065126.365091:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5529 00000100:00100000:3.0:1746065126.365095:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881261156352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.365100:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.365106:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 23 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.365112:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 23 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.365121:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3ced lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6ed expref: 23 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.365128:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.365129:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.365131:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.365137:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.365148:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.365160:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881261156352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.365164:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5529 00010000:00010000:0.0:1746065126.365236:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.365243:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.365257:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.365262:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.365268:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.365273:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff54e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065126.365275:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.365282:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.365296:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.365311:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54e00/0x14b4f8542d4f3daa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065126.365345:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261154304:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 15013us (15815us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.365351:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11067 00010000:00010000:2.0:1746065126.365437:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365445:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365457:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365463:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365468:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365473:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a010be00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065126.365475:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365480:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365488:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365498:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a010be00/0x14b4f8542d4f3d87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.365531:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261153664:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 17641us (17807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.365536:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11062 00010000:00010000:2.0:1746065126.365551:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365558:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365568:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365573:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365579:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365584:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8a9c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065126.365586:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365591:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365600:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.365605:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9c00/0x14b4f8542d4f3da3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.365628:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261154048:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 16338us (17838us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.365633:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11066 00010000:00010000:1.0:1746065126.366115:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.366127:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b614 expref: 21 pid: 8429 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.366135:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b614 expref: 21 pid: 8429 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.366149:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3b81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b614 expref: 21 pid: 8429 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.366156:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.366157:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.366160:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.366165:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.366179:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.366195:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881261155584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1479us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.366200:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5526 00010000:00010000:0.0:1746065126.366366:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.366373:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.366386:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.366391:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.366397:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.366402:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd8c600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065126.366404:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.366410:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.366418:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.366423:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd8c600/0x14b4f8542d4f3d8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065126.366451:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261153920:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 18387us (18699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.366456:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11063 00000100:00100000:0.0:1746065126.366491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.366529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.366601:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261156736 00000100:00100000:1.0:1746065126.366606:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261156736 00010000:00010000:1.0:1746065126.366623:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 38 pid: 8429 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.366650:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5530 00000100:00100000:1.0:1746065126.366656:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261156736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.366663:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.366671:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 38 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.366683:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 38 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.366693:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a010a800/0x14b4f8542d4f3d02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b702 expref: 38 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.366701:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.366718:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881261156736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 62us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.366722:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5530 00000100:00100000:3.0:1746065126.366793:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261156608 00000100:00100000:3.0:1746065126.366796:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261156608 00000100:00100000:3.0:1746065126.366837:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3725 00000100:00100000:3.0:1746065126.366842:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:29108:x1830881261156608:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065126.366954:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:29108:x1830881261156608:12345-192.168.202.46@tcp:35:cat.0 Request processed in 112us (463us total) trans 8589943159 rc 0/0 00000100:00100000:3.0:1746065126.366959:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3725 00000100:00100000:2.0:1746065126.368687:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881261155328:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10676us (10746us total) trans 17179872881 rc 0/0 00000100:00100000:2.0:1746065126.368695:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1552 00002000:00100000:2.0:1746065126.368702:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x380:0x0] (3145728->3452927) req@ffff88013667ea00 x1830881261155328/t17179872881(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.368710:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667ea00 with x1830881261155328 ext(3145728->3452927) 00010000:00010000:2.0:1746065126.368716:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 37 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.368727:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 37 pid: 8429 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.368733:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013667ea00 00000100:00100000:0.0:1746065126.370070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.370135:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261156864 00000100:00100000:2.0:1746065126.370141:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261156864 00010000:00010000:2.0:1746065126.370166:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 37 pid: 8429 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.370252:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5531 00000100:00100000:2.0:1746065126.370259:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881261156864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065126.370269:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065126.370282:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 37 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.370291:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 37 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.370399:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801391db000/0x14b4f8542d4f3cf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->3452927) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b6f4 expref: 37 pid: 8429 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.370410:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.370412:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.370416:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.370423:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.370450:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065126.370483:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881261156864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 225us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.370489:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5531 00010000:00010000:0.0:1746065126.370545:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.370552:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.370567:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.370574:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.370584:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.370589:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8a9800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065126.370592:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.370599:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.370608:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.370613:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8a9800/0x14b4f8542d4f3d95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065126.370648:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1961:x1830881261154176:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 22439us (22878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.370655:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11064 00000100:00100000:0.0:1746065126.372063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.372112:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261157120 00000100:00100000:2.0:1746065126.372117:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261157120 00000100:00100000:2.0:1746065126.372154:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9094 00000100:00100000:2.0:1746065126.372160:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29115:x1830881261157120:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:2.0:1746065126.372190:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065126.372206:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a010a600/0x14b4f8542d4f3d79 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b748 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.372218:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.372221:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065126.372242:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.372251:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 260 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.372258:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b55e expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.372264:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.372284:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b55e expref: 16 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.372294:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b55e expref: 16 pid: 24350 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.372316:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d85880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259776896:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.372383:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 260 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.372394:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 260 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.372400:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259777024:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.372418:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.373946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.374077:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d85880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259776896:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.374086:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259777024:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.374109:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065126.374146:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.374319:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261157248 00000100:00100000:3.0:1746065126.374324:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261157248 00010000:00010000:3.0:1746065126.374342:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b55e expref: 17 pid: 24350 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.374368:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261157376 00000100:00100000:3.0:1746065126.374370:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261157376 00010000:00010000:3.0:1746065126.374380:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 261 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.374394:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5532 00000100:00100000:3.0:1746065126.374399:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1958:x1830881261157248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.374406:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.374411:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b55e expref: 17 pid: 24350 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.374423:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b55e expref: 17 pid: 24350 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.374437:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b464c00/0x14b4f8542d4f3a38 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b55e expref: 17 pid: 24350 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.374450:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.374453:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.374458:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.374495:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:1958:x1830881261157248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.374501:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5532 00000100:00100000:3.0:1746065126.374513:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5533 00000100:00100000:3.0:1746065126.374517:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:1961:x1830881261157376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.374525:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.374528:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 261 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.374535:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 261 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.374545:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3a31 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b557 expref: 261 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.374553:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.374556:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.374561:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.374566:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.374577:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.374590:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1961:x1830881261157376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.374595:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5533 00010000:00010000:2.0:1746065126.375313:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.375320:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000040:00080000:2.0:1746065126.375970:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2584, 88 off217216 00000004:00080000:2.0:1746065126.375977:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725667161202ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065126.376362:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2518, 88 off211224 00000004:00080000:2.0:1746065126.376367:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725667551501ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065126.376870:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2519, 88 off211312 00000004:00080000:2.0:1746065126.376873:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725668057508ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065126.376878:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2585, 88 off217304 00000004:00080000:2.0:1746065126.376880:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725668064830ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065126.376893:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2586, 88 off217392 00000004:00080000:2.0:1746065126.376895:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725668080164ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065126.376902:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2520, 88 off211400 00000004:00080000:2.0:1746065126.376904:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725668088821ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065126.376910:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2521, 88 off211488 00000004:00080000:2.0:1746065126.376913:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725668097414ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065126.376919:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2522, 88 off211576 00000004:00080000:2.0:1746065126.376921:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725668105731ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065126.376928:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2587, 88 off217480 00000004:00080000:2.0:1746065126.376930:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725668114638ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065126.376952:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2523, 88 off211664 00000004:00080000:2.0:1746065126.376954:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725668139133ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065126.376961:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2588, 88 off217568 00000004:00080000:2.0:1746065126.376963:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725668147770ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065126.376977:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2524, 88 off211752 00000004:00080000:2.0:1746065126.376979:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725668164159ns, next at 666938887344ns, rc = 0 00000040:00080000:2.0:1746065126.376986:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2589, 88 off217656 00000004:00080000:2.0:1746065126.376988:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725668173249ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065126.376994:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2590, 88 off217744 00000004:00080000:2.0:1746065126.376996:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725668181044ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065126.377002:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2591, 88 off217832 00000004:00080000:2.0:1746065126.377005:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725668189420ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065126.377011:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2592, 88 off217920 00000004:00080000:2.0:1746065126.377014:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725668198491ns, next at 666984569566ns, rc = 0 00000040:00080000:2.0:1746065126.377021:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2525, 88 off211840 00000004:00080000:2.0:1746065126.377023:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725668207731ns, next at 666938887344ns, rc = 0 00000004:00010000:2.0:1746065126.402464:0:24350:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e8b6d80 reply state ffff880133113c00 transno 8589943160 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065126.402482:0:24350:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065126.402572:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:29115:x1830881261157120:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 30407us (30509us total) trans 8589943160 rc 0/0 00000100:00100000:2.0:1746065126.402580:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9094 00000001:00080000:2.0:1746065126.403350:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943142 is committed 00000001:00080000:2.0:1746065126.403362:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943135 is committed 00000001:00080000:2.0:1746065126.403370:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943152 is committed 00000001:00080000:2.0:1746065126.403376:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943148 is committed 00000001:00080000:2.0:1746065126.403392:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943160 is committed 00000004:00080000:2.0:1746065126.403395:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1818 committed 00000004:00080000:2.0:1746065126.403400:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1885 committed 00000004:00080000:2.0:1746065126.403404:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1884 committed 00000004:00080000:2.0:1746065126.403406:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1883 committed 00000004:00080000:2.0:1746065126.403407:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1882 committed 00000004:00080000:2.0:1746065126.403409:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1817 committed 00000004:00080000:2.0:1746065126.403410:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1881 committed 00000004:00080000:2.0:1746065126.403411:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1816 committed 00000004:00080000:2.0:1746065126.403413:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1880 committed 00000004:00080000:2.0:1746065126.403414:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1815 committed 00000004:00080000:2.0:1746065126.403415:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1814 committed 00000004:00080000:2.0:1746065126.403416:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1813 committed 00000004:00080000:2.0:1746065126.403418:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1879 committed 00000004:00080000:2.0:1746065126.403419:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1878 committed 00000004:00080000:2.0:1746065126.403420:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1812 committed 00000004:00080000:2.0:1746065126.403421:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1811 committed 00000004:00080000:2.0:1746065126.403422:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1877 committed 00000001:00080000:2.0:1746065126.403428:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943156 is committed 00000001:00080000:2.0:1746065126.403440:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943159 is committed 00000001:00080000:2.0:1746065126.403444:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943155 is committed 00010000:00010000:2.0:1746065126.403466:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.403473:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.403478:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.403483:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e9000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065126.403486:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.403491:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.403504:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.403506:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065126.403509:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.403513:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4f3db8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065126.403639:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259777280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.403676:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.403698:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259777280 00000100:00100000:2.0:1746065126.403702:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259777280 00000100:00100000:2.0:1746065126.403723:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11069 00000100:00100000:2.0:1746065126.403728:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3298:x1830881259777280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.403870:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3298:x1830881259777280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (194us total) trans 21474840102 rc 0/0 00000100:00100000:2.0:1746065126.403878:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11069 00000100:00100000:1.0:1746065126.403987:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259777152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.404004:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.404014:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259777408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.404025:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.404033:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259777152 00000100:00100000:1.0:1746065126.404035:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259777152 00000100:00100000:1.0:1746065126.404046:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259777408 00000100:00100000:1.0:1746065126.404047:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259777408 00000100:00100000:1.0:1746065126.404055:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11070 00000100:00100000:1.0:1746065126.404059:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259777152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.404140:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3297:x1830881259777152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (135us total) trans 21474840103 rc 0/0 00000100:00100000:1.0:1746065126.404145:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11070 00000100:00100000:1.0:1746065126.404155:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11071 00000100:00100000:1.0:1746065126.404159:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881259777408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.404225:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3295:x1830881259777408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (198us total) trans 21474840104 rc 0/0 00000100:00100000:1.0:1746065126.404229:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11071 00000100:00100000:3.0:1746065126.404550:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259777536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065126.404573:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.407006:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259777536 00000100:00100000:2.0:1746065126.407020:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259777536 00000100:00100000:2.0:1746065126.407081:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11072 00000100:00100000:2.0:1746065126.407089:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3296:x1830881259777536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.407360:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1830881259777536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 271us (2784us total) trans 21474840105 rc 0/0 00000100:00100000:2.0:1746065126.407367:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11072 00000100:00100000:0.0:1746065126.407855:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.407933:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261157632 00000100:00100000:2.0:1746065126.407940:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261157632 00000100:00100000:2.0:1746065126.407971:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9095 00000100:00100000:2.0:1746065126.407977:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:29118:x1830881261157632:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065126.407993:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.408007:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8400/0x14b4f8542d4f3dbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b75d expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.408087:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.408097:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.408105:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.408116:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.408121:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.408127:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.408208:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.408218:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b741 expref: 6 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.408224:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.408247:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b741 expref: 6 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.408257:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b741 expref: 6 pid: 24350 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.408266:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259779200:192.168.202.46@tcp:104: 00000004:00080000:3.0:1746065126.408567:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d87b80/2, rc 0, transno 21474840105 00000100:00100000:3.0:1746065126.408572:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259777536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065126.408578:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259778048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065126.408606:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.408623:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259778560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065126.408638:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.408649:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259779072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065126.408660:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.408682:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259778048 00000100:00100000:3.0:1746065126.408685:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259778048 00000100:00100000:3.0:1746065126.408700:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259778560 00000100:00100000:3.0:1746065126.408702:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259778560 00000100:00100000:3.0:1746065126.408712:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259779072 00000100:00100000:3.0:1746065126.408713:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259779072 00000100:00100000:3.0:1746065126.408724:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11073 00000100:00100000:3.0:1746065126.408729:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1830881259778048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.408836:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11074 00000100:00100000:1.0:1746065126.408843:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3296:x1830881259778560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065126.409046:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065126.409049:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:0.0:1746065126.409049:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11075 00002000:00010000:1.0:1746065126.409050:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.409052:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.409054:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065126.409054:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3296:x1830881259779072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.409079:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3296:x1830881259778560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (439us total) trans 17179872882 rc 0/0 00000100:00100000:1.0:1746065126.409084:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11074 00000100:00100000:0.0:1746065126.409134:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3296:x1830881259779072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (472us total) trans 17179872883 rc 0/0 00000100:00100000:0.0:1746065126.409139:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11075 00000100:00100000:2.0:1746065126.409351:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9300 going to sleep for 11 seconds 00000004:00080000:2.0:1746065126.409373:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d85880/2, rc 0, transno 21474840102 00000100:00100000:2.0:1746065126.409377:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259777280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.409382:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259777792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.409399:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.409420:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259778304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.409434:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.409445:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259778816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.409458:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.409475:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259777792 00000100:00100000:2.0:1746065126.409477:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259777792 00000100:00100000:2.0:1746065126.409489:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259778304 00000100:00100000:2.0:1746065126.409491:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259778304 00000100:00100000:2.0:1746065126.409500:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259778816 00000100:00100000:2.0:1746065126.409502:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259778816 00000100:00100000:2.0:1746065126.409511:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11076 00000100:00100000:2.0:1746065126.409515:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3298:x1830881259777792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065126.409582:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065126.409584:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.409586:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.409587:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.409588:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065126.409608:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881259777792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (209us total) trans 21474840106 rc 0/0 00000100:00100000:2.0:1746065126.409613:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11076 00000100:00100000:2.0:1746065126.409622:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11077 00000100:00100000:2.0:1746065126.409626:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3298:x1830881259778304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.409705:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881259778304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (269us total) trans 17179872884 rc 0/0 00000100:00100000:2.0:1746065126.409709:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11077 00000100:00100000:2.0:1746065126.409717:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11078 00000100:00100000:2.0:1746065126.409721:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3298:x1830881259778816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065126.409773:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065126.409775:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.409776:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.409778:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.409779:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065126.409794:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881259778816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (335us total) trans 17179872885 rc 0/0 00000100:00100000:2.0:1746065126.409798:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11078 00000004:00080000:2.0:1746065126.409834:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a13480/2, rc 0, transno 17179872884 00000100:00100000:2.0:1746065126.409841:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259778304:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065126.409849:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba0000/2, rc 0, transno 17179872885 00000100:00100000:2.0:1746065126.409851:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259778816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065126.409857:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f543480/2, rc 0, transno 21474840106 00000100:00100000:2.0:1746065126.409859:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259777792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.409890:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065126.409894:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259779328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.409912:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.409923:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259779328 00000100:00100000:2.0:1746065126.409925:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259779328 00000100:00100000:2.0:1746065126.409935:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11079 00000100:00100000:2.0:1746065126.409938:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881259779328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.409998:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881259779328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (85us total) trans 17179872886 rc 0/0 00000100:00100000:2.0:1746065126.410003:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11079 00000004:00080000:2.0:1746065126.410017:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ad5500/2, rc 0, transno 17179872886 00000100:00100000:2.0:1746065126.410019:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259779328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065126.410214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:1.0:1746065126.410380:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d85c00/2, rc 0, transno 21474840103 00000100:00100000:1.0:1746065126.410384:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259777152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.410388:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259777664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.410406:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.410418:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259778176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.410432:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.410441:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259778688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.410454:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.410471:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259777664 00000100:00100000:1.0:1746065126.410474:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259777664 00000100:00100000:1.0:1746065126.410487:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259778176 00000100:00100000:1.0:1746065126.410489:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259778176 00000100:00100000:1.0:1746065126.410497:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259778688 00000100:00100000:1.0:1746065126.410499:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259778688 00000100:00100000:1.0:1746065126.410517:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11080 00000100:00100000:1.0:1746065126.410521:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3297:x1830881259777664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065126.410598:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:1.0:1746065126.410601:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:1.0:1746065126.410602:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.410604:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:1.0:1746065126.410605:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:1.0:1746065126.410625:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3297:x1830881259777664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (218us total) trans 21474840107 rc 0/0 00000100:00100000:1.0:1746065126.410630:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11080 00000100:00100000:1.0:1746065126.410640:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11081 00000100:00100000:1.0:1746065126.410644:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881259778176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.410915:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11082 00000100:00100000:2.0:1746065126.410925:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3297:x1830881259778688:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065126.410937:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d87480/2, rc 0, transno 21474840104 00000100:00100000:0.0:1746065126.410942:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259777408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065126.410948:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259777920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065126.410968:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065126.410979:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259778432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065126.410992:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065126.410999:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259778944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065126.411009:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065126.411027:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259777920 00000100:00100000:0.0:1746065126.411030:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259777920 00000100:00100000:0.0:1746065126.411042:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259778432 00000100:00100000:0.0:1746065126.411043:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259778432 00000100:00100000:0.0:1746065126.411049:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259778944 00000100:00100000:0.0:1746065126.411050:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259778944 00000100:00100000:0.0:1746065126.411057:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11083 00000100:00100000:0.0:1746065126.411062:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881259777920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065126.411085:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11084 00000100:00100000:3.0:1746065126.411090:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259778432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065126.411131:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065126.411134:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065126.411135:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065126.411137:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065126.411138:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065126.411160:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881259777920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (191us total) trans 21474840108 rc 0/0 00000100:00100000:0.0:1746065126.411167:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11083 00000100:00100000:0.0:1746065126.411179:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11085 00000100:00100000:0.0:1746065126.411183:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259778944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.411825:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3297:x1830881259778176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1170us (1381us total) trans 17179872887 rc 0/0 00000100:00100000:1.0:1746065126.411830:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11081 00000004:00080000:1.0:1746065126.411851:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f543800/2, rc 0, transno 21474840107 00000100:00100000:1.0:1746065126.411854:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259777664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065126.411860:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a12680/2, rc 0, transno 17179872887 00000100:00100000:1.0:1746065126.411863:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259778176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.411970:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261157760 00000100:00100000:2.0:1746065126.411974:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261157760 00000100:00100000:2.0:1746065126.411993:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9096 00000100:00100000:2.0:1746065126.411998:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29115:x1830881261157760:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065126.412008:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.412018:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b764 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.412051:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b764 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.412052:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881259778432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 962us (1059us total) trans 17179872889 rc 0/0 00000100:00100000:3.0:1746065126.412057:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11084 00010000:00010000:2.0:1746065126.412062:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b764 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.412076:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.412079:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065126.412081:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbcfa00, rc 0) 00000004:00080000:3.0:1746065126.412085:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba1500/2, rc 0, transno 17179872882 00000100:00100000:3.0:1746065126.412088:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259778560:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065126.412095:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa3b80/2, rc 0, transno 17179872883 00000100:00100000:3.0:1746065126.412097:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259779072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.412103:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29115:x1830881261157760:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 105us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.412108:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9096 00002000:00010000:2.0:1746065126.412137:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065126.412139:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.412141:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.412142:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.412144:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065126.412149:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3296:x1830881259778048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3419us (3542us total) trans 21474840109 rc 0/0 00000100:00100000:3.0:1746065126.412153:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11073 00000100:00100000:2.0:1746065126.412160:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3297:x1830881259778688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1240us (1705us total) trans 17179872888 rc 0/0 00000100:00100000:2.0:1746065126.412170:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11082 00000004:00080000:1.0:1746065126.412217:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba1180/2, rc 0, transno 17179872888 00000100:00100000:1.0:1746065126.412220:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259778688:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065126.412269:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f543b80/2, rc 0, transno 21474840109 00000100:00100000:3.0:1746065126.412272:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259778048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065126.412540:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259778944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1355us (1528us total) trans 17179872890 rc 0/0 00000100:00100000:0.0:1746065126.412546:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11085 00000004:00080000:0.0:1746065126.412567:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f541c00/2, rc 0, transno 21474840108 00000100:00100000:0.0:1746065126.412571:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259777920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065126.412577:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a11500/2, rc 0, transno 17179872889 00000100:00100000:0.0:1746065126.412580:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259778432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065126.412586:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa1f80/2, rc 0, transno 17179872890 00000100:00100000:0.0:1746065126.412588:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259778944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065126.413391:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259779200:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065126.413405:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065126.413518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.413729:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261157888 00000100:00100000:3.0:1746065126.413733:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261157888 00010000:00010000:3.0:1746065126.413751:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b741 expref: 8 pid: 24350 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.413781:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5534 00000100:00100000:3.0:1746065126.413787:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261157888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.413794:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.413799:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b741 expref: 8 pid: 24350 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.413807:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b741 expref: 8 pid: 24350 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.413839:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8a9a00/0x14b4f8542d4f3d6b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b741 expref: 8 pid: 24350 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.413849:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.413853:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.413869:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.413874:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.413886:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.413905:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261157888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 118us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.413911:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5534 00010000:00010000:0.0:1746065126.414004:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414009:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065126.414021:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065126.414117:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414123:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414128:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414133:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133084a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065126.414136:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414142:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414149:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065126.414151:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065126.414153:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414158:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084a00/0x14b4f8542d4f3dd4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414170:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414174:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414178:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414181:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133084e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065126.414183:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414188:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414197:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065126.414199:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065126.414201:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414205:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084e00/0x14b4f8542d4f3dc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414212:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414216:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414220:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414224:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133085600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065126.414226:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414231:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414235:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205600) 00010000:00010000:0.0:1746065126.414237:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065126.414239:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414243:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085600/0x14b4f8542d4f3dcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065126.414277:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8400/0x14b4f8542d4f3dbf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b75d expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.414284:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8400/0x14b4f8542d4f3dbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b75d expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.414291:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8400, rc 0) 00000100:00100000:0.0:1746065126.414331:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29118:x1830881261157632:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6354us (6484us total) trans 8589943161 rc 301/301 00000100:00100000:0.0:1746065126.414337:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9095 00000100:00100000:0.0:1746065126.415593:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.415744:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158016 00000100:00100000:2.0:1746065126.415749:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158016 00000100:00100000:2.0:1746065126.415776:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9097 00000100:00100000:2.0:1746065126.415782:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29115:x1830881261158016:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065126.415795:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.415807:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3de9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b76b expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.415878:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.415886:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.415893:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065126.415913:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065126.415916:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065126.415926:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.415943:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3de9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b76b expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.415954:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b76b expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.415964:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.415967:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065126.415969:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbcec00, rc 0) 00000100:00100000:2.0:1746065126.416235:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29115:x1830881261158016:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 451us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.416240:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9097 00000100:00100000:0.0:1746065126.422042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.422840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.423017:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158144 00000100:00100000:2.0:1746065126.423027:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158144 00000100:00100000:2.0:1746065126.423064:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158272 00000100:00100000:2.0:1746065126.423066:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158272 00000100:00100000:2.0:1746065126.423081:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11086 00000100:00100000:2.0:1746065126.423088:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1961:x1830881261158144:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065126.423103:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.423119:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b772 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065126.423139:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e6, atime: 0x6812d6e6, ctime: 0x6812d6e6, blocks: 0x7f1 00010000:00010000:2.0:1746065126.423154:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.423156:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.423163:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b772 expref: 6 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.423181:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b772 expref: 6 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.423190:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbce400, rc 0) 00000100:00100000:0.0:1746065126.423191:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11087 00000100:00100000:0.0:1746065126.423197:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261158272:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065126.423204:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.423214:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b779 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065126.423227:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6e6, atime: 0x6812d6e4, ctime: 0x6812d6e6, blocks: 0x821 00010000:00010000:0.0:1746065126.423234:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.423235:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.423239:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b779 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065126.423248:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b779 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065126.423259:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2600, rc 0) 00000100:00100000:2.0:1746065126.423375:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261158144:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 285us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.423381:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11086 00000100:00100000:0.0:1746065126.423840:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261158272:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 642us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.423845:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11087 00000100:00100000:0.0:1746065126.425859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.425899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.425926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.425959:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158400 00000100:00100000:3.0:1746065126.425965:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158400 00000100:00100000:0.0:1746065126.425979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.425990:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158528 00000100:00100000:3.0:1746065126.425992:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158528 00000100:00100000:3.0:1746065126.426002:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158784 00000100:00100000:3.0:1746065126.426003:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158784 00000100:00100000:0.0:1746065126.426010:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158656 00000100:00100000:0.0:1746065126.426012:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158656 00000100:00100000:3.0:1746065126.426014:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11088 00000100:00100000:3.0:1746065126.426019:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261158400:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065126.426033:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065126.426037:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11089 00000100:00100000:0.0:1746065126.426042:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261158528:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065126.426047:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.426050:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b780 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.426055:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b787 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065126.426067:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6e6, atime: 0x6812d6e6, ctime: 0x6812d6e6, blocks: 0x81d 00002000:00010000:0.0:1746065126.426067:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6e6, atime: 0x6812d6e6, ctime: 0x6812d6e6, blocks: 0x821 00010000:00010000:3.0:1746065126.426079:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.426079:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.426081:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065126.426081:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.426087:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b780 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065126.426087:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b787 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.426098:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b780 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065126.426098:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b787 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065126.426108:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2000, rc 0) 00010000:00010000:3.0:1746065126.426110:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b26a400, rc 0) 00000100:00100000:3.0:1746065126.426141:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261158400:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 121us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.426145:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11090 00000100:00100000:3.0:1746065126.426152:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11088 00000100:00100000:2.0:1746065126.426153:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261158784:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065126.426155:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11091 00010000:00010000:2.0:1746065126.426162:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065126.426162:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261158656:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065126.426167:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.426171:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b795 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.426175:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b78e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065126.426182:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6e7, atime: 0x6812d6e7, ctime: 0x6812d6e7, blocks: 0x102b 00002000:00010000:1.0:1746065126.426185:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6e7, atime: 0x6812d6e7, ctime: 0x6812d6e7, blocks: 0x16a9 00010000:00010000:2.0:1746065126.426190:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.426191:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.426192:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.426193:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.426195:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b795 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.426197:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b78e expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.426205:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b795 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.426205:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b78e expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.426211:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1c72000, rc 0) 00010000:00010000:2.0:1746065126.426223:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbcea00, rc 0) 00000100:00100000:0.0:1746065126.426410:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261158528:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 364us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.426416:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11089 00000100:00100000:1.0:1746065126.426546:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261158656:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 382us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.426551:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261158784:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 395us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.426551:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11091 00000100:00100000:2.0:1746065126.426557:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11090 00000100:00100000:0.0:1746065126.432563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.432622:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261159040 00000100:00100000:2.0:1746065126.432630:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261159040 00000100:00100000:2.0:1746065126.432675:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9098 00000100:00100000:2.0:1746065126.432682:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+7:29120:x1830881261159040:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065126.432703:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.432716:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3e21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b79c expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.432800:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.432810:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065126.432851:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.433758:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.433767:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.433773:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.433887:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.433896:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.433902:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065126.433911:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065126.433979:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.433984:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.433990:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.433995:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b26a600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065126.433999:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434004:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434013:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.434015:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065126.434018:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434023:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a600/0x14b4f8542d4f3e36 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434052:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434057:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434061:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434068:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbce800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065126.434070:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434074:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434079:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065126.434081:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065126.434083:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434087:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434094:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434098:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434101:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434105:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b26bc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065126.434106:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434110:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434114:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129d38900) 00010000:00010000:3.0:1746065126.434116:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065126.434118:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434121:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26bc00/0x14b4f8542d4f3e2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065126.434154:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3e21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b79c expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.434161:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcf000/0x14b4f8542d4f3e21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b79c expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.434167:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbcf000, rc 0) 00000100:00100000:3.0:1746065126.434210:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:29120:x1830881261159040:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1527us (1653us total) trans 8589943162 rc 301/301 00000100:00100000:3.0:1746065126.434223:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9098 00000100:00100000:0.0:1746065126.442102:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.443083:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261159168 00000100:00100000:3.0:1746065126.443091:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261159168 00000100:00100000:3.0:1746065126.443127:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9099 00000100:00100000:3.0:1746065126.443134:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29118:x1830881261159168:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065126.443155:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.443173:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a200/0x14b4f8542d4f3e44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7a3 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.443228:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a200/0x14b4f8542d4f3e44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7a3 expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.443241:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a200/0x14b4f8542d4f3e44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7a3 expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.443264:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.443267:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065126.443271:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b26a200, rc 0) 00000100:00100000:3.0:1746065126.443348:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29118:x1830881261159168:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 213us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.443354:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9099 00000100:00100000:0.0:1746065126.448044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.448137:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261159424 00000100:00100000:2.0:1746065126.448144:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261159424 00000100:00100000:2.0:1746065126.448193:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9100 00000100:00100000:2.0:1746065126.448202:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29118:x1830881261159424:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065126.448220:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.448223:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065126.448245:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b26a200/0x14b4f8542d4f3e44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7a3 expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.448262:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.448266:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065126.448275:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e4b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7aa expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.448324:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.448333:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b764 expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.448339:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b76b expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.448343:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.448366:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b76b expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.448375:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b76b expref: 7 pid: 24350 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.448384:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259779456:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.448477:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b764 expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.448484:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b764 expref: 7 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746065126.448489:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259779584:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.448509:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065126.450545:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259779456:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.450561:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259779584:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.450584:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065126.451281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.451388:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.451955:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261159552 00000100:00100000:1.0:1746065126.451961:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261159552 00010000:00010000:1.0:1746065126.451986:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b764 expref: 8 pid: 14644 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.452008:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261159680 00000100:00100000:1.0:1746065126.452010:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261159680 00010000:00010000:1.0:1746065126.452020:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b76b expref: 9 pid: 24350 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.452085:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5535 00000100:00100000:3.0:1746065126.452091:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5536 00000100:00100000:1.0:1746065126.452092:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261159552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065126.452097:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261159680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.452102:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.452102:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.452106:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b76b expref: 9 pid: 24350 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.452106:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b764 expref: 9 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.452114:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b76b expref: 9 pid: 24350 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.452120:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b764 expref: 9 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.452137:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcec00/0x14b4f8542d4f3df0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b76b expref: 9 pid: 24350 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.452139:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcfa00/0x14b4f8542d4f3ddb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b764 expref: 9 pid: 14644 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.452156:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.452160:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065126.452167:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065126.452172:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.452180:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065126.452182:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065126.452188:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.452210:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261159680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 113us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.452210:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261159552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 118us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.452215:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5536 00000100:00100000:1.0:1746065126.452217:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5535 00010000:00010000:3.0:1746065126.452240:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065126.452245:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000040:00080000:3.0:1746065126.452716:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2593, 88 off218008 00000004:00080000:3.0:1746065126.452721:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725743905133ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065126.452751:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2526, 88 off211928 00000004:00080000:3.0:1746065126.452753:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725743938012ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065126.452762:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2527, 88 off212016 00000004:00080000:3.0:1746065126.452764:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725743948585ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065126.452769:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2594, 88 off218096 00000004:00080000:3.0:1746065126.452771:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725743955882ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065126.452776:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2595, 88 off218184 00000004:00080000:3.0:1746065126.452778:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725743962849ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065126.452783:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2528, 88 off212104 00000004:00080000:3.0:1746065126.452785:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725743969472ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065126.452789:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2529, 88 off212192 00000004:00080000:3.0:1746065126.452791:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725743975862ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065126.452796:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2530, 88 off212280 00000004:00080000:3.0:1746065126.452798:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725743982524ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065126.452803:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2596, 88 off218272 00000004:00080000:3.0:1746065126.452805:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725743989532ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065126.452810:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2531, 88 off212368 00000004:00080000:3.0:1746065126.452811:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725743996315ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065126.452832:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2597, 88 off218360 00000004:00080000:3.0:1746065126.452834:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725744019122ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065126.452840:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2532, 88 off212456 00000004:00080000:3.0:1746065126.452842:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725744026612ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065126.452847:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2598, 88 off218448 00000004:00080000:3.0:1746065126.452849:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725744033793ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065126.452854:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2599, 88 off218536 00000004:00080000:3.0:1746065126.452856:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725744040945ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065126.452861:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2600, 88 off218624 00000004:00080000:3.0:1746065126.452863:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725744047605ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065126.452868:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2601, 88 off218712 00000004:00080000:3.0:1746065126.452869:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725744054235ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065126.452874:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2533, 88 off212544 00000004:00080000:3.0:1746065126.452876:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725744060660ns, next at 666938887344ns, rc = 0 00000001:00080000:2.0:1746065126.481025:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943161 is committed 00000001:00080000:2.0:1746065126.481038:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943163 is committed 00000004:00080000:2.0:1746065126.481041:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1826 committed 00000004:00080000:2.0:1746065126.481047:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1894 committed 00000004:00080000:2.0:1746065126.481052:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1893 committed 00000004:00080000:2.0:1746065126.481053:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1892 committed 00000004:00080000:2.0:1746065126.481054:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1891 committed 00000004:00080000:2.0:1746065126.481056:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1825 committed 00000004:00080000:2.0:1746065126.481057:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1890 committed 00000004:00080000:2.0:1746065126.481058:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1824 committed 00000004:00080000:2.0:1746065126.481059:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1889 committed 00000004:00080000:2.0:1746065126.481061:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1823 committed 00000004:00080000:2.0:1746065126.481062:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1822 committed 00000004:00080000:2.0:1746065126.481063:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1821 committed 00000004:00080000:2.0:1746065126.481065:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1888 committed 00000004:00080000:2.0:1746065126.481066:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1887 committed 00000004:00080000:2.0:1746065126.481067:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1820 committed 00000004:00080000:2.0:1746065126.481069:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1819 committed 00000004:00080000:2.0:1746065126.481070:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1886 committed 00000001:00080000:2.0:1746065126.481074:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943162 is committed 00010000:00010000:2.0:1746065126.481115:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.481126:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.481129:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065126.481143:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbce800/0x14b4f8542d4f3e4b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 249 pid: 16767 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065126.481156:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 248 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.481184:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.481186:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065126.481188:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbcee00, rc 0) 00000100:00100000:2.0:1746065126.481237:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29118:x1830881261159424:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 33034us (33198us total) trans 8589943163 rc 0/0 00000100:00100000:2.0:1746065126.481243:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9100 00000100:00100000:3.0:1746065126.481492:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259779840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065126.481529:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.481557:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259780352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065126.481568:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.481576:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259780864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065126.481585:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.481592:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259781376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065126.481601:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.481612:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746065126.481615:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259779968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065126.481625:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.481632:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259780480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065126.481640:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.481647:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259780992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065126.481656:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.481663:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259781504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065126.481672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.481740:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259780096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.481765:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259779840 00000100:00100000:1.0:1746065126.481771:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259779840 00000100:00100000:1.0:1746065126.481795:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259780352 00000100:00100000:1.0:1746065126.481797:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259780352 00000100:00100000:1.0:1746065126.481806:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259780864 00000100:00100000:1.0:1746065126.481807:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259780864 00000100:00100000:1.0:1746065126.481827:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259781376 00000100:00100000:1.0:1746065126.481829:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259781376 00000100:00100000:1.0:1746065126.481835:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259779968 00000100:00100000:1.0:1746065126.481836:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259779968 00000100:00100000:1.0:1746065126.481842:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259780480 00000100:00100000:1.0:1746065126.481843:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259780480 00000100:00100000:1.0:1746065126.481848:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259780992 00000100:00100000:1.0:1746065126.481850:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259780992 00000100:00100000:1.0:1746065126.481856:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11092 00000100:00100000:1.0:1746065126.481861:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259779840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065126.481997:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065126.481999:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065126 -> 1746065126 00002000:00010000:1.0:1746065126.482002:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065126 -> 1746065126 00002000:00010000:1.0:1746065126.482003:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065126 -> 1746065126 00002000:00010000:1.0:1746065126.482005:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746065126.482022:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881259779840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (494us total) trans 21474840110 rc 0/0 00000100:00100000:1.0:1746065126.482027:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11092 00000100:00100000:1.0:1746065126.482036:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11093 00000100:00100000:1.0:1746065126.482040:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259780352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065126.482090:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482092:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482094:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482095:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482097:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065126.482110:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881259780352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (541us total) trans 21474840111 rc 0/0 00000100:00100000:1.0:1746065126.482114:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11093 00000100:00100000:1.0:1746065126.482121:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11094 00000100:00100000:1.0:1746065126.482124:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3295:x1830881259780864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065126.482195:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065126.482197:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065126 -> 1746065126 00002000:00010000:1.0:1746065126.482199:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065126 -> 1746065126 00002000:00010000:1.0:1746065126.482201:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065126 -> 1746065126 00002000:00010000:1.0:1746065126.482203:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065126.482216:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881259780864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (629us total) trans 17179872891 rc 0/0 00000100:00100000:1.0:1746065126.482219:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11094 00000100:00100000:1.0:1746065126.482227:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11095 00000100:00100000:1.0:1746065126.482230:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3295:x1830881259781376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065126.482276:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482278:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482279:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482281:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482282:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065126.482295:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881259781376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (693us total) trans 17179872892 rc 0/0 00000100:00100000:1.0:1746065126.482299:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11095 00000100:00100000:1.0:1746065126.482318:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11096 00000100:00100000:1.0:1746065126.482322:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259779968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065126.482373:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065126.482375:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065126.482377:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065126.482378:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065126.482380:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746065126.482394:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881259779968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (768us total) trans 21474840112 rc 0/0 00000100:00100000:1.0:1746065126.482397:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11096 00000100:00100000:1.0:1746065126.482405:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11097 00000100:00100000:1.0:1746065126.482408:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881259780480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065126.482452:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482453:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482455:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482456:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.482458:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065126.482471:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881259780480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (830us total) trans 21474840113 rc 0/0 00000100:00100000:1.0:1746065126.482475:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11097 00000100:00100000:1.0:1746065126.482482:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11098 00000100:00100000:1.0:1746065126.482485:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3295:x1830881259780992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065126.482536:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:1.0:1746065126.482538:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065126.482539:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065126.482541:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065126.482543:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5801 -> 5801 00000100:00100000:1.0:1746065126.482555:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881259780992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (898us total) trans 17179872893 rc 0/0 00000100:00100000:1.0:1746065126.482559:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11098 00000100:00100000:2.0:1746065126.482606:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259779712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065126.482699:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667f800/2, rc 0, transno 21474840110 00000100:00100000:3.0:1746065126.482704:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259779840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065126.482710:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667dc00/2, rc 0, transno 21474840111 00000100:00100000:3.0:1746065126.482712:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259780352:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065126.482722:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667df80/2, rc 0, transno 17179872891 00000100:00100000:3.0:1746065126.482728:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259780864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065126.482733:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d96300/2, rc 0, transno 17179872892 00000100:00100000:3.0:1746065126.482735:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259781376:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065126.482740:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667ce00/2, rc 0, transno 21474840112 00000100:00100000:3.0:1746065126.482743:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259779968:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065126.482747:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667e680/2, rc 0, transno 21474840113 00000100:00100000:3.0:1746065126.482749:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259780480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065126.482754:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667ed80/2, rc 0, transno 17179872893 00000100:00100000:3.0:1746065126.482755:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259780992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065126.482771:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259781504 00000100:00100000:3.0:1746065126.482773:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259781504 00000100:00100000:3.0:1746065126.482787:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11099 00000100:00100000:3.0:1746065126.482790:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881259781504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065126.482885:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3295:x1830881259781504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1212us total) trans 17179872894 rc 0/0 00000100:00100000:3.0:1746065126.482890:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11099 00000004:00080000:3.0:1746065126.482925:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4b1500/2, rc 0, transno 17179872894 00000100:00100000:3.0:1746065126.482928:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259781504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.483229:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.483539:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259780608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.483559:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.483602:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259781120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.483604:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259780096 00000100:00100000:2.0:1746065126.483607:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259780096 00000100:00100000:2.0:1746065126.483623:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259780608 00000100:00100000:2.0:1746065126.483625:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259780608 00000100:00100000:1.0:1746065126.483632:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.483633:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11100 00000100:00100000:2.0:1746065126.483637:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3297:x1830881259780096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065126.483645:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259781632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.483658:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.483669:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065126.483672:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259781760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.483682:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.483696:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259781120 00000100:00100000:1.0:1746065126.483699:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259781120 00000100:00100000:1.0:1746065126.483712:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259781632 00000100:00100000:1.0:1746065126.483714:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259781632 00000100:00100000:1.0:1746065126.483721:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259781760 00000100:00100000:1.0:1746065126.483722:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259781760 00000100:00100000:2.0:1746065126.483727:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3297:x1830881259780096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (500us total) trans 21474840114 rc 0/0 00000100:00100000:1.0:1746065126.483729:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11101 00000100:00100000:2.0:1746065126.483733:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11100 00000100:00100000:1.0:1746065126.483734:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3297:x1830881259780608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.483742:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11102 00000100:00100000:2.0:1746065126.483745:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3297:x1830881259781120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065126.483799:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065126.483801:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.483802:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.483804:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.483805:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065126.483830:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3297:x1830881259780608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (255us total) trans 21474840115 rc 0/0 00000100:00100000:1.0:1746065126.483835:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11101 00000100:00100000:2.0:1746065126.483838:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3297:x1830881259781120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (206us total) trans 17179872895 rc 0/0 00000100:00100000:2.0:1746065126.483846:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11102 00000100:00100000:1.0:1746065126.483850:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11103 00000100:00100000:1.0:1746065126.483854:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3297:x1830881259781632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.483855:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11104 00000100:00100000:2.0:1746065126.483858:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3297:x1830881259781760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.483878:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.483898:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259780224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.483911:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.483917:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013667d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259780736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065126.483928:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.483934:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259781248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.483936:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3297:x1830881259781632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (277us total) trans 17179872896 rc 0/0 00000100:00100000:1.0:1746065126.483941:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11103 00000100:00100000:2.0:1746065126.483943:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.483952:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259779712 00000100:00100000:1.0:1746065126.483954:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259779712 00000100:00100000:2.0:1746065126.483957:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259780224 00000100:00100000:2.0:1746065126.483959:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259780224 00000100:00100000:1.0:1746065126.483963:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259780736 00000100:00100000:1.0:1746065126.483964:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259780736 00000100:00100000:2.0:1746065126.483967:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259781248 00000100:00100000:2.0:1746065126.483969:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259781248 00000100:00100000:1.0:1746065126.483972:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11105 00000100:00100000:1.0:1746065126.483976:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3298:x1830881259779712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.483977:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11106 00000100:00100000:2.0:1746065126.483981:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3298:x1830881259780224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065126.484043:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881259781760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (360us total) trans 17179872897 rc 0/0 00002000:00010000:1.0:1746065126.484046:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746065126.484047:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11104 00002000:00010000:1.0:1746065126.484049:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065126 -> 1746065126 00002000:00010000:1.0:1746065126.484051:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065124 -> 1746065124 00002000:00010000:1.0:1746065126.484053:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065126 -> 1746065126 00002000:00010000:1.0:1746065126.484054:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065126.484055:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11107 00000100:00100000:2.0:1746065126.484058:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881259780736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.484075:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881259779712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (195us total) trans 21474840116 rc 0/0 00000100:00100000:1.0:1746065126.484079:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11105 00000100:00100000:1.0:1746065126.484088:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11108 00000100:00100000:1.0:1746065126.484092:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881259781248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065126.484107:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065126.484109:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065126 -> 1746065126 00002000:00010000:2.0:1746065126.484111:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065126 -> 1746065126 00002000:00010000:2.0:1746065126.484112:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065126 -> 1746065126 00002000:00010000:2.0:1746065126.484114:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:2.0:1746065126.484128:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3298:x1830881259780736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (199us total) trans 17179872898 rc 0/0 00000100:00100000:2.0:1746065126.484133:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11107 00002000:00010000:1.0:1746065126.484152:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065126.484154:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.484155:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.484157:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065126.484158:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065126.484176:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3298:x1830881259781248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (232us total) trans 17179872899 rc 0/0 00002000:00010000:2.0:1746065126.484181:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00000100:00100000:1.0:1746065126.484181:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11108 00002000:00010000:2.0:1746065126.484184:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065126.484185:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065126.484187:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:2.0:1746065126.484188:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:2.0:1746065126.484201:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881259780224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (289us total) trans 21474840117 rc 0/0 00000100:00100000:2.0:1746065126.484205:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11106 00000004:00080000:2.0:1746065126.484222:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667e300/2, rc 0, transno 21474840116 00000100:00100000:2.0:1746065126.484226:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259779712:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065126.484231:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667d880/2, rc 0, transno 21474840117 00000100:00100000:2.0:1746065126.484233:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259780224:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065126.484239:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667d500/2, rc 0, transno 17179872898 00000100:00100000:2.0:1746065126.484241:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259780736:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065126.484246:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f540000/2, rc 0, transno 17179872899 00000100:00100000:2.0:1746065126.484248:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259781248:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065126.484257:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa0a80/2, rc 0, transno 17179872897 00000100:00100000:2.0:1746065126.484259:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259781760:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065126.484264:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667f100/2, rc 0, transno 21474840114 00000100:00100000:2.0:1746065126.484266:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259780096:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065126.484273:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013667fb80/2, rc 0, transno 21474840115 00000100:00100000:2.0:1746065126.484275:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013667fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259780608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065126.484279:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f541880/2, rc 0, transno 17179872895 00000100:00100000:2.0:1746065126.484281:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259781120:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065126.484286:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4b1f80/2, rc 0, transno 17179872896 00000100:00100000:2.0:1746065126.484287:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259781632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065126.484750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.484906:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261159808 00000100:00100000:2.0:1746065126.484911:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261159808 00000100:00100000:2.0:1746065126.484939:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9101 00000100:00100000:2.0:1746065126.484945:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+7:29120:x1830881261159808:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065126.484958:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.484970:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7b1 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.485014:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b1 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.485025:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b1 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.485038:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.485041:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065126.485044:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a3a00, rc 0) 00000100:00100000:2.0:1746065126.485071:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:29120:x1830881261159808:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 126us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.485076:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9101 00000100:00100000:0.0:1746065126.487633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.490125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.491828:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261159936 00000100:00100000:3.0:1746065126.491837:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261159936 00000100:00100000:3.0:1746065126.493242:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261160064 00000100:00100000:3.0:1746065126.493249:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261160064 00000100:00100000:3.0:1746065126.493276:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11109 00000100:00100000:3.0:1746065126.493282:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:29118:x1830881261159936:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065126.493296:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.493320:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7b8 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.493329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065126.493344:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b779 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.493351:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.493352:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.493355:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1392640->1757183] (req 1392640->1757183) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.493401:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11110 00000100:00100000:2.0:1746065126.493409:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:29120:x1830881261160064:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065126.493416:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.493422:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7bf expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.493435:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b780 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.493440:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.493441:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.493443:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b779 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.493444:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1269760->1859583] (req 1269760->1859583) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.493453:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b779 expref: 8 pid: 8427 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746065126.493456:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b780 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.493462:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b780 expref: 8 pid: 8428 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746065126.493464:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259781888:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.493468:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259782016:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.493635:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065126.493637:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065126.493647:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261160320 00000100:00100000:2.0:1746065126.493650:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261160320 00000100:00100000:2.0:1746065126.493694:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9102 00000100:00100000:2.0:1746065126.493700:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf15c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:29123:x1830881261160320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.493708:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.493756:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3e6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7c6 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.493849:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.493858:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.493866:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.493876:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.493881:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.493886:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.493968:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.493975:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.493980:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065126.493987:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065126.494080:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494086:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494091:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494097:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b7c800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065126.494099:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494104:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494112:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.494114:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065126.494117:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494121:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7c800/0x14b4f8542d4f3e83 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494130:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494134:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494138:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494141:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944f3c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065126.494143:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494147:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494155:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065126.494157:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065126.494159:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494162:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4f3e75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494168:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494172:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494175:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494178:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944f2a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065126.494180:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494183:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494187:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205300) 00010000:00010000:2.0:1746065126.494189:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065126.494190:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494194:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4f3e7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.494222:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3e6e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7c6 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.494229:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4f3e6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7c6 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.494236:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f3400, rc 0) 00000100:00100000:2.0:1746065126.494274:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf15c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:29123:x1830881261160320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 573us (945us total) trans 8589943164 rc 301/301 00000100:00100000:2.0:1746065126.494279:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9102 00000100:00100000:0.0:1746065126.495279:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.495324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.495505:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259781888:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065126.495524:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1392640->1757183] (req 1392640->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.495535:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f144800, rc 0) 00000100:00100000:1.0:1746065126.495545:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261160448 00000100:00100000:1.0:1746065126.495550:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261160448 00000100:00100000:3.0:1746065126.495559:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:29118:x1830881261159936:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2278us (7934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.495566:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11109 00010000:00010000:1.0:1746065126.495568:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b780 expref: 9 pid: 8428 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746065126.495583:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261160576 00000100:00100000:1.0:1746065126.495585:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261160576 00010000:00010000:1.0:1746065126.495593:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b779 expref: 10 pid: 8427 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746065126.495598:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5537 00000100:00100000:3.0:1746065126.495604:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881261160448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065126.495610:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5538 00010000:00010000:3.0:1746065126.495612:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065126.495614:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881261160576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.495619:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.495627:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b780 expref: 10 pid: 8428 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.495627:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b779 expref: 10 pid: 8427 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746065126.495634:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b779 expref: 10 pid: 8427 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.495635:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b780 expref: 10 pid: 8428 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.495649:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.495649:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2600/0x14b4f8542d4f3dfe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b779 expref: 10 pid: 8427 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746065126.495651:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.495656:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.495656:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.495657:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.495660:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.495664:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.495666:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.495684:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.495684:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.495693:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259782272:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065126.495693:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259782144:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065126.495727:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065126.495732:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065126.496025:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b26a400/0x14b4f8542d4f3e05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b780 expref: 9 pid: 8428 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746065126.496034:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259782016:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.496052:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.496059:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a2800, rc 0) 00000100:00100000:2.0:1746065126.496376:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:29120:x1830881261160064:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2968us (6257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.496382:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11110 00000100:00100000:1.0:1746065126.497617:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259782144:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065126.497631:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.497671:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881261160576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2054us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.497834:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5538 00000100:00100000:0.0:1746065126.498210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.498269:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259782272:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065126.498283:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.498310:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881261160448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2697us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.498316:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5537 00000100:00100000:2.0:1746065126.498369:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161088 00000100:00100000:2.0:1746065126.498375:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161088 00002000:00100000:2.0:1746065126.498406:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1269760->1273855) req@ffff88008f49ed80 x1830881261161088/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.498414:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ed80 with x1830881261161088 ext(1269760->1273855) 00002000:00010000:2.0:1746065126.498418:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49ed80 00000100:00100000:2.0:1746065126.498433:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5080 00000100:00100000:2.0:1746065126.498439:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881261161088:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065126.498555:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881261161088:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 115us (345us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065126.498561:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5080 00002000:00100000:2.0:1746065126.498566:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1269760->1273855) req@ffff88008f49ed80 x1830881261161088/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.498572:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ed80 with x1830881261161088 ext(1269760->1273855) 00002000:00010000:2.0:1746065126.498575:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49ed80 00000100:00100000:0.0:1746065126.498807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.498831:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261160832 00000100:00100000:2.0:1746065126.498835:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261160832 00000100:00100000:0.0:1746065126.498857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.498863:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3726 00000100:00100000:2.0:1746065126.498869:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:29123:x1830881261160832:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065126.498937:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161344 00000100:00100000:3.0:1746065126.498940:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161344 00002000:00100000:3.0:1746065126.498954:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1392640->1396735) req@ffff88008f49ce00 x1830881261161344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.498961:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ce00 with x1830881261161344 ext(1392640->1396735) 00002000:00010000:3.0:1746065126.498963:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49ce00 00000100:00100000:3.0:1746065126.499182:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5081 00000100:00100000:3.0:1746065126.499188:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881261161344:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065126.499210:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:29123:x1830881261160832:12345-192.168.202.46@tcp:35:cat.0 Request processed in 341us (403us total) trans 8589943165 rc 0/0 00000100:00100000:2.0:1746065126.499216:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3726 00000100:00100000:3.0:1746065126.499452:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881261161344:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 263us (593us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065126.499457:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5081 00002000:00100000:3.0:1746065126.499462:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1392640->1396735) req@ffff88008f49ce00 x1830881261161344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.499468:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ce00 with x1830881261161344 ext(1392640->1396735) 00002000:00010000:3.0:1746065126.499471:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49ce00 00000100:00100000:0.0:1746065126.502896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.502942:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161472 00000100:00100000:2.0:1746065126.502949:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161472 00000100:00100000:2.0:1746065126.502997:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9103 00000100:00100000:2.0:1746065126.503005:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:29123:x1830881261161472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.503024:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.503038:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f200/0x14b4f8542d4f3e91 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7cd expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.503104:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.503114:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.503123:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065126.503145:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065126.503148:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065126.503160:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065126.503181:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f200/0x14b4f8542d4f3e91 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7cd expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.503193:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7cd expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.503200:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065126.503202:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065126.503205:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009118f400, rc 0) 00000100:00100000:2.0:1746065126.503252:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:29123:x1830881261161472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 247us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.503258:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9103 00000100:00100000:0.0:1746065126.503335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.503522:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161728 00000100:00100000:3.0:1746065126.503526:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161728 00002000:00100000:3.0:1746065126.503547:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1753088->1757183) req@ffff88008f49e680 x1830881261161728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.503554:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49e680 with x1830881261161728 ext(1753088->1757183) 00002000:00010000:3.0:1746065126.503558:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49e680 00000100:00100000:3.0:1746065126.503570:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5082 00000100:00100000:3.0:1746065126.503575:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881261161728:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065126.503691:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881261161728:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 116us (356us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065126.503697:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5082 00002000:00100000:3.0:1746065126.503702:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1753088->1757183) req@ffff88008f49e680 x1830881261161728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.503708:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49e680 with x1830881261161728 ext(1753088->1757183) 00002000:00010000:3.0:1746065126.503711:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49e680 00000100:00100000:0.0:1746065126.505417:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.505469:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261162112 00000100:00100000:2.0:1746065126.505475:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261162112 00000100:00100000:2.0:1746065126.505513:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3727 00000100:00100000:2.0:1746065126.505520:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29118:x1830881261162112:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065126.505680:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29118:x1830881261162112:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 160us (265us total) trans 8589943166 rc 0/0 00000100:00100000:2.0:1746065126.505689:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3727 00000100:00100000:0.0:1746065126.505904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.506038:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161856 00000100:00100000:2.0:1746065126.506042:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161856 00000100:00100000:2.0:1746065126.506184:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11111 00000100:00100000:2.0:1746065126.506190:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881261161856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.506199:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.506211:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7d4 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.506227:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.506229:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.506235:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7d4 expref: 18 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.506247:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7d4 expref: 18 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.506255:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009118ea00, rc 0) 00000100:00100000:2.0:1746065126.506284:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261161856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 94us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.506289:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11111 00000100:00100000:0.0:1746065126.507105:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.507135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.507417:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261162240 00000100:00100000:3.0:1746065126.507422:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261162240 00000100:00100000:3.0:1746065126.507456:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261162368 00000100:00100000:3.0:1746065126.507458:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261162368 00000100:00100000:3.0:1746065126.507475:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11112 00000100:00100000:3.0:1746065126.507480:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261162240:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065126.507480:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11113 00000100:00100000:1.0:1746065126.507485:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261162368:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.507489:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.507490:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.507498:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f145000/0x14b4f8542d4f3ea6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7db expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.507498:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7e2 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.507511:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.507512:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.507517:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e2 expref: 19 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.507526:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e2 expref: 19 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065126.507531:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259782400:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065126.507532:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1c72a00, rc 0) 00000100:00100000:1.0:1746065126.507555:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261162368:12345-192.168.202.46@tcp:101:cat.0 Request processed in 70us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.507560:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11113 00000100:00100000:3.0:1746065126.507570:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.507777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.507803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.507853:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261162496 00000100:00100000:2.0:1746065126.507857:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261162496 00000100:00100000:2.0:1746065126.507871:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261162624 00000100:00100000:2.0:1746065126.507873:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261162624 00000100:00100000:2.0:1746065126.507884:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11114 00000100:00100000:2.0:1746065126.507889:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261162496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.507895:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.507902:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7e9 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.507913:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.507914:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.507919:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e9 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.507927:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e9 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.507933:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009118f000, rc 0) 00000100:00100000:2.0:1746065126.507948:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261162496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.507952:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11114 00000100:00100000:2.0:1746065126.507961:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11115 00000100:00100000:2.0:1746065126.507965:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261162624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.507970:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.507976:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7f0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.507983:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.507984:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.507987:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f0 expref: 15 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.507994:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f0 expref: 15 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.508000:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009118f600, rc 0) 00000100:00100000:2.0:1746065126.508012:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261162624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.508016:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11115 00000100:00100000:0.0:1746065126.508079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.508095:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261162880 00000100:00100000:0.0:1746065126.508098:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261162880 00002000:00100000:0.0:1746065126.508116:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1855488->1859583) req@ffff880095350a80 x1830881261162880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065126.508124:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350a80 with x1830881261162880 ext(1855488->1859583) 00002000:00010000:0.0:1746065126.508128:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350a80 00000100:00100000:0.0:1746065126.508138:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5083 00000100:00100000:0.0:1746065126.508143:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881261162880:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065126.508468:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+15:1958:x1830881261162880:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 324us (388us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065126.508473:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5083 00002000:00100000:0.0:1746065126.508477:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1855488->1859583) req@ffff880095350a80 x1830881261162880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065126.508483:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350a80 with x1830881261162880 ext(1855488->1859583) 00002000:00010000:0.0:1746065126.508485:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350a80 00002000:00010000:3.0:1746065126.510075:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065126 -> 1746065127 00002000:00010000:3.0:1746065126.510080:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065126 -> 1746065127 00000100:00100000:3.0:1746065126.510095:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259782400:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065126.510120:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f145000/0x14b4f8542d4f3ea6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7db expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.510129:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f145000/0x14b4f8542d4f3ea6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7db expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065126.510190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065126.510251:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f145000, rc 0) 00000100:00100000:3.0:1746065126.510356:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261162240:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2874us (3252us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065126.510363:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11112 00000100:00100000:3.0:1746065126.510387:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163136 00000100:00100000:3.0:1746065126.510391:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163136 00000100:00100000:3.0:1746065126.510412:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3728 00000100:00100000:3.0:1746065126.510417:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:29120:x1830881261163136:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065126.510553:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+12:29120:x1830881261163136:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 136us (364us total) trans 8589943167 rc 0/0 00000100:00100000:3.0:1746065126.510559:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3728 00000100:00100000:0.0:1746065126.514668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.514786:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163392 00000100:00100000:2.0:1746065126.514794:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163392 00002000:00100000:2.0:1746065126.514840:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880095353800 x1830881261163392/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.514849:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353800 with x1830881261163392 ext(0->1048575) 00002000:00010000:2.0:1746065126.514853:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353800 00000100:00100000:2.0:1746065126.514877:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5084 00000100:00100000:2.0:1746065126.514884:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261163392:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065126.524965:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261163392:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10073us (10295us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.524977:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5084 00002000:00100000:3.0:1746065126.524987:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff880095353800 x1830881261163392/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.524996:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353800 with x1830881261163392 ext(0->1048575) 00002000:00010000:3.0:1746065126.525001:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353800 00000100:00100000:0.0:1746065126.533155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.533244:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163520 00000100:00100000:3.0:1746065126.533432:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163520 00000100:00100000:3.0:1746065126.533469:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11116 00000100:00100000:3.0:1746065126.533476:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+13:29123:x1830881261163520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.533491:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.533505:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7f7 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.533530:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.533536:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065126.533538:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065126.533541:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.533564:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.533574:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 20 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.533585:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259782528:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065126.533658:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.537205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.537317:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259782528:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065126.537343:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065126.537349:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163648 00000100:00100000:2.0:1746065126.537355:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163648 00010000:00010000:3.0:1746065126.537358:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f145200, rc 0) 00002000:00100000:2.0:1746065126.537394:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1392640->1757183) req@ffff880095350000 x1830881261163648/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.537403:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350000 with x1830881261163648 ext(1392640->1757183) 00000100:00100000:3.0:1746065126.537405:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:29123:x1830881261163520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3929us (4258us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065126.537410:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 21 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.537412:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11116 00010000:00010000:2.0:1746065126.537422:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 21 pid: 9716 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.537428:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095350000 00000100:00100000:2.0:1746065126.537515:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1553 00000100:00100000:2.0:1746065126.537627:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881261163648:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065126.545096:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881261163648:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 7567us (7889us total) trans 21474840118 rc 0/0 00000100:00100000:2.0:1746065126.545107:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1553 00002000:00100000:2.0:1746065126.545118:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1392640->1757183) req@ffff880095350000 x1830881261163648/t21474840118(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.545126:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350000 with x1830881261163648 ext(1392640->1757183) 00010000:00010000:2.0:1746065126.545135:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 23 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746065126.545148:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 23 pid: 9716 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746065126.545155:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095350000 00000100:00100000:0.0:1746065126.550242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.550352:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163776 00000100:00100000:3.0:1746065126.550359:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163776 00010000:00010000:3.0:1746065126.550387:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 23 pid: 9716 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.550479:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5539 00000100:00100000:3.0:1746065126.550487:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881261163776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.550499:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.550519:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 23 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.550530:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 23 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.550549:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f144800/0x14b4f8542d4f3e60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1392640->1757183) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b8 expref: 23 pid: 9716 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.550946:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.550949:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.550956:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.550963:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.550989:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.550999:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259782656:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065126.551075:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065126.553629:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259782656:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065126.553646:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.553688:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881261163776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3200us (3454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.553697:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5539 00000100:00100000:0.0:1746065126.557018:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.557096:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.557164:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261164032 00000100:00100000:2.0:1746065126.557172:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261164032 00000100:00100000:0.0:1746065126.557182:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:2.0:1746065126.557209:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880095350e00 x1830881261164032/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.557218:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350e00 with x1830881261164032 ext(1048576->2097151) 00002000:00010000:2.0:1746065126.557222:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350e00 00000100:00100000:2.0:1746065126.557328:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261164416 00000100:00100000:2.0:1746065126.557331:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261164416 00002000:00100000:2.0:1746065126.557342:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880095351c00 x1830881261164416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 504/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.557354:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351c00 with x1830881261164416 ext(1048576->2097151) 00002000:00010000:2.0:1746065126.557356:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351c00 00000100:00100000:1.0:1746065126.557410:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261164544 00000100:00100000:1.0:1746065126.557413:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261164544 00002000:00100000:1.0:1746065126.557427:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a90ad500 x1830881261164544/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.557438:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad500 with x1830881261164544 ext(1048576->2097151) 00002000:00010000:1.0:1746065126.557441:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ad500 00000100:00100000:1.0:1746065126.557452:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5085 00000100:00100000:1.0:1746065126.557458:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261164032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065126.557664:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5086 00000100:00100000:0.0:1746065126.557670:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261164416:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.558107:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5087 00000100:00100000:2.0:1746065126.558114:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261164544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.564022:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881261164416:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6342us (6916us total) trans 0 rc 458752/458752 00000100:00100000:2.0:1746065126.564033:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5086 00002000:00100000:2.0:1746065126.564043:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880095351c00 x1830881261164416/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 504/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 458752/458752 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.564052:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351c00 with x1830881261164416 ext(1048576->2097151) 00002000:00010000:2.0:1746065126.564060:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351c00 00000100:00100000:1.0:1746065126.567238:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261164032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9772us (10219us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065126.567248:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5085 00002000:00100000:1.0:1746065126.567259:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880095350e00 x1830881261164032/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.567267:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350e00 with x1830881261164032 ext(1048576->2097151) 00002000:00010000:1.0:1746065126.567272:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350e00 00000100:00100000:2.0:1746065126.569583:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261164544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11461us (12392us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.569593:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5087 00002000:00100000:2.0:1746065126.569603:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a90ad500 x1830881261164544/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.569611:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad500 with x1830881261164544 ext(1048576->2097151) 00002000:00010000:2.0:1746065126.569615:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ad500 00000100:00100000:0.0:1746065126.580743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.580787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.580839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.580886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.580959:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261165056 00000100:00100000:2.0:1746065126.580967:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261165056 00002000:00100000:2.0:1746065126.581010:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800a90ace00 x1830881261165056/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.581020:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ace00 with x1830881261165056 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.581031:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ace00 00000100:00100000:2.0:1746065126.581047:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261164928 00000100:00100000:2.0:1746065126.581049:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261164928 00002000:00100000:2.0:1746065126.581060:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a5880a80 x1830881261164928/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.581066:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880a80 with x1830881261164928 ext(2097152->3145727) 00002000:00010000:2.0:1746065126.581068:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880a80 00000100:00100000:2.0:1746065126.581075:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261165440 00000100:00100000:2.0:1746065126.581077:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261165440 00000100:00100000:3.0:1746065126.581083:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261165312 00002000:00100000:2.0:1746065126.581085:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800a5882d80 x1830881261165440/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065126.581086:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261165312 00002000:00100000:2.0:1746065126.581091:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881261165440 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.581093:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882d80 00002000:00100000:3.0:1746065126.581099:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a5881180 x1830881261165312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065126.581103:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5088 00002000:00100000:3.0:1746065126.581105:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881180 with x1830881261165312 ext(2097152->3145727) 00002000:00010000:3.0:1746065126.581107:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5881180 00000100:00100000:2.0:1746065126.581109:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261165056:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065126.581127:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5089 00000100:00100000:3.0:1746065126.581131:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261164928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065126.581248:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5090 00000100:00100000:0.0:1746065126.581254:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5091 00000100:00100000:1.0:1746065126.581255:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261165440:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065126.581260:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261165312:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065126.583229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.583799:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261165824 00000100:00100000:0.0:1746065126.583808:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261165824 00000100:00100000:0.0:1746065126.583870:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9104 00000100:00100000:0.0:1746065126.583877:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29128:x1830881261165824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065126.583896:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.583911:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b64be00/0x14b4f8542d4f3ec9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b7fe expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.584225:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584236:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584244:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584253:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584261:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584265:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584355:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584362:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584366:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065126.584373:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065126.584437:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584444:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584449:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584454:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133083800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.584458:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584463:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584472:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065126.584475:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065126.584479:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584483:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f3ede lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584538:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584543:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584547:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584550:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133083400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.584552:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584557:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584563:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065126.584565:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.584567:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584571:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083400/0x14b4f8542d4f3ed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584578:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584582:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584586:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584590:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133083600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.584592:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584596:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584601:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012cf56100) 00010000:00010000:1.0:1746065126.584603:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.584604:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584608:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f3ed7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.584637:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b64be00/0x14b4f8542d4f3ec9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7fe expref: 251 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.584643:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b64be00/0x14b4f8542d4f3ec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7fe expref: 251 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.584650:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b64be00, rc 0) 00000100:00100000:1.0:1746065126.584673:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29128:x1830881261165824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 797us (1450us total) trans 8589943168 rc 301/301 00000100:00100000:1.0:1746065126.584678:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9104 00000100:00100000:2.0:1746065126.593203:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261165056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12086us (12462us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.593332:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5088 00002000:00100000:2.0:1746065126.593346:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800a90ace00 x1830881261165056/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.593358:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ace00 with x1830881261165056 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.593363:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ace00 00000100:00100000:1.0:1746065126.597337:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261165440:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16073us (16511us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065126.597351:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5090 00002000:00100000:1.0:1746065126.597361:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800a5882d80 x1830881261165440/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.597369:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881261165440 ext(3145728->4194303) 00002000:00010000:1.0:1746065126.597374:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882d80 00000100:00100000:2.0:1746065126.600238:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261165312:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18969us (19341us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.600248:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5091 00002000:00100000:2.0:1746065126.600258:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a5881180 x1830881261165312/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.600267:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881180 with x1830881261165312 ext(2097152->3145727) 00002000:00010000:2.0:1746065126.600271:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5881180 00000100:00100000:0.0:1746065126.600880:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.601262:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+14:1960:x1830881261164928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20129us (20473us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.601269:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5089 00002000:00100000:3.0:1746065126.601274:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a5880a80 x1830881261164928/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.601281:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880a80 with x1830881261164928 ext(2097152->3145727) 00002000:00010000:3.0:1746065126.601284:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880a80 00000100:00100000:1.0:1746065126.601360:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261165952 00000100:00100000:1.0:1746065126.601368:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261165952 00000100:00100000:1.0:1746065126.601407:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9105 00000100:00100000:1.0:1746065126.601413:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29128:x1830881261165952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065126.601430:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.601447:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f3eec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b805 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.601512:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.601523:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.601532:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065126.601550:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:1.0:1746065126.601553:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065126.601562:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065126.601580:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f3eec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b805 expref: 252 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.601610:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b805 expref: 251 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.601617:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065126.601619:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065126.601622:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083a00, rc 0) 00000100:00100000:1.0:1746065126.601641:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29128:x1830881261165952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 228us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.601646:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9105 00000100:00100000:0.0:1746065126.606346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.606516:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166080 00000100:00100000:3.0:1746065126.606524:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166080 00000100:00100000:3.0:1746065126.606569:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11117 00000100:00100000:3.0:1746065126.606576:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881261166080:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.606592:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.606605:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b80c expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.606625:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.606627:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.606634:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b80c expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.606649:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b80c expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.606663:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f145600, rc 0) 00000100:00100000:3.0:1746065126.606708:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881261166080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 132us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.606714:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11117 00000100:00100000:0.0:1746065126.610093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.610167:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.610325:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166208 00000100:00100000:1.0:1746065126.610333:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166208 00000100:00100000:1.0:1746065126.610375:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166336 00000100:00100000:1.0:1746065126.610378:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166336 00000100:00100000:1.0:1746065126.610393:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11118 00000100:00100000:2.0:1746065126.610398:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11119 00000100:00100000:1.0:1746065126.610399:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881261166208:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065126.610404:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881261166336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065126.610420:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.610422:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.610433:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b813 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.610434:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe49a00/0x14b4f8542d4f3f08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b81a expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.610450:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.610451:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.610458:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b813 expref: 25 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.610469:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b813 expref: 25 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065126.610472:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259782784:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065126.610482:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083400, rc 0) 00000100:00100000:1.0:1746065126.610515:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881261166208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 116us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.610521:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11118 00000100:00100000:2.0:1746065126.610539:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.611222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.611250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.611273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.611344:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166464 00000100:00100000:2.0:1746065126.611348:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166464 00000100:00100000:2.0:1746065126.611366:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166720 00000100:00100000:2.0:1746065126.611367:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166720 00000100:00100000:2.0:1746065126.611378:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166592 00000100:00100000:2.0:1746065126.611380:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166592 00000100:00100000:2.0:1746065126.611390:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11120 00000100:00100000:2.0:1746065126.611395:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261166464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.611402:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.611411:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b821 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.611423:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.611424:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.611429:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b821 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.611438:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b821 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.611445:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe48e00, rc 0) 00000100:00100000:3.0:1746065126.611449:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11121 00000100:00100000:3.0:1746065126.611456:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881261166720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.611462:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065126.611464:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261166464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.611468:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11120 00010000:00010000:3.0:1746065126.611469:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b82f expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.611477:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065126.611477:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11122 00010000:00010000:3.0:1746065126.611479:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065126.611481:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261166592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.611483:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b82f expref: 26 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.611486:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.611491:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b82f expref: 26 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.611491:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b828 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.611498:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f145400, rc 0) 00010000:00010000:2.0:1746065126.611499:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.611500:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.611503:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b828 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.611510:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b828 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065126.611511:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261166720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.611515:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11121 00010000:00010000:2.0:1746065126.611516:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe49400, rc 0) 00000100:00100000:2.0:1746065126.611526:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261166592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 45us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.611530:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11122 00002000:00010000:2.0:1746065126.611556:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime: 1746065126 -> 1746065127 00002000:00010000:2.0:1746065126.611559:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime: 1746065126 -> 1746065127 00002000:00010000:2.0:1746065126.611561:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime: 1746065126 -> 1746065127 00000100:00100000:2.0:1746065126.611575:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259782784:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065126.611590:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fe49a00/0x14b4f8542d4f3f08 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b81a expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.611598:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe49a00/0x14b4f8542d4f3f08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b81a expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.611618:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe49a00, rc 0) 00000100:00100000:2.0:1746065126.611632:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881261166336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1228us (1465us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065126.611636:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11119 00000100:00100000:0.0:1746065126.616439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.616885:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166976 00000100:00100000:3.0:1746065126.616893:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166976 00002000:00100000:3.0:1746065126.616930:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff8800a0086300 x1830881261166976/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.616938:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086300 with x1830881261166976 ext(4194304->5029887) 00002000:00010000:3.0:1746065126.616943:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0086300 00000100:00100000:3.0:1746065126.617496:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5092 00000100:00100000:3.0:1746065126.617504:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261166976:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065126.618231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.618317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.618365:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261167360 00000100:00100000:1.0:1746065126.618370:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261167360 00002000:00100000:1.0:1746065126.618392:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a0084700 x1830881261167360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.618399:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084700 with x1830881261167360 ext(1048576->2097151) 00002000:00010000:1.0:1746065126.618403:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0084700 00000100:00100000:1.0:1746065126.618413:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261167488 00000100:00100000:1.0:1746065126.618415:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261167488 00002000:00100000:1.0:1746065126.618426:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8800a0085500 x1830881261167488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.618432:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085500 with x1830881261167488 ext(0->1048575) 00002000:00010000:1.0:1746065126.618435:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0085500 00000100:00100000:1.0:1746065126.618445:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5093 00000100:00100000:1.0:1746065126.618450:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881261167360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.618464:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5094 00000100:00100000:2.0:1746065126.618471:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261167488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.635187:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261167488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16710us (16862us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.635199:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5094 00002000:00100000:2.0:1746065126.635208:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff8800a0085500 x1830881261167488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.635216:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085500 with x1830881261167488 ext(0->1048575) 00002000:00010000:2.0:1746065126.635220:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0085500 00000100:00100000:3.0:1746065126.635932:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261166976:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18427us (19499us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065126.635939:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5092 00002000:00100000:3.0:1746065126.635945:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff8800a0086300 x1830881261166976/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.635951:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086300 with x1830881261166976 ext(4194304->5029887) 00002000:00010000:3.0:1746065126.635954:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0086300 00000100:00100000:1.0:1746065126.638207:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881261167360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19748us (19969us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065126.638217:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5093 00002000:00100000:1.0:1746065126.638229:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a0084700 x1830881261167360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.638242:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084700 with x1830881261167360 ext(1048576->2097151) 00002000:00010000:1.0:1746065126.638247:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0084700 00000100:00100000:0.0:1746065126.649587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.650062:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261167616 00000100:00100000:1.0:1746065126.650070:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261167616 00000100:00100000:1.0:1746065126.650116:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11123 00000100:00100000:1.0:1746065126.650124:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:29128:x1830881261167616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065126.650139:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.650153:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b836 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.650176:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.650182:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065126.650183:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065126.650187:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 25 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.650209:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.650218:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 13 pid: 4544 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746065126.650229:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259782912:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.651085:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065126.651746:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259782912:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065126.651766:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 25 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.651777:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083200, rc 0) 00000100:00100000:1.0:1746065126.651828:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:29128:x1830881261167616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1690us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.651835:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11123 00000100:00100000:0.0:1746065126.653219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.653289:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261167744 00000100:00100000:1.0:1746065126.653296:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261167744 00002000:00100000:1.0:1746065126.653339:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1269760->1859583) req@ffff8800a0085880 x1830881261167744/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.653348:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085880 with x1830881261167744 ext(1269760->1859583) 00010000:00010000:1.0:1746065126.653355:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 14 pid: 4544 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.653366:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 14 pid: 4544 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746065126.653370:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0085880 00000100:00100000:1.0:1746065126.653709:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1554 00000100:00100000:1.0:1746065126.653719:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881261167744:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065126.660452:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881261167744:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6727us (7229us total) trans 21474840119 rc 0/0 00000100:00100000:1.0:1746065126.660465:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1554 00002000:00100000:1.0:1746065126.660476:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1269760->1859583) req@ffff8800a0085880 x1830881261167744/t21474840119(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.660484:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085880 with x1830881261167744 ext(1269760->1859583) 00010000:00010000:1.0:1746065126.660492:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 16 pid: 4544 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746065126.660506:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 16 pid: 4544 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746065126.660513:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0085880 00000100:00100000:0.0:1746065126.663323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.663428:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261167872 00000100:00100000:3.0:1746065126.663436:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261167872 00010000:00010000:3.0:1746065126.663466:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 16 pid: 4544 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746065126.663502:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5540 00000100:00100000:3.0:1746065126.663509:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261167872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.663520:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.663536:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 16 pid: 4544 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.663553:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 16 pid: 4544 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.663571:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4f3e67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1859583) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7bf expref: 16 pid: 4544 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746065126.663595:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.663597:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.663603:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.663611:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.663636:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.663647:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259783040:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065126.663713:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065126.665101:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259783040:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065126.665115:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.665148:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261167872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1639us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.665155:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5540 00000100:00100000:0.0:1746065126.668358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.668554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.668615:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261168256 00000100:00100000:1.0:1746065126.668623:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261168256 00002000:00100000:1.0:1746065126.668657:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a0087100 x1830881261168256/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.668666:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087100 with x1830881261168256 ext(1048576->2097151) 00002000:00010000:1.0:1746065126.668670:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0087100 00000100:00100000:1.0:1746065126.669339:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261168384 00000100:00100000:1.0:1746065126.669343:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261168384 00002000:00100000:1.0:1746065126.669360:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a0087480 x1830881261168384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.669367:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087480 with x1830881261168384 ext(1048576->2097151) 00002000:00010000:1.0:1746065126.669370:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0087480 00000100:00100000:3.0:1746065126.669423:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5095 00000100:00100000:3.0:1746065126.669432:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261168256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.669648:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5096 00000100:00100000:2.0:1746065126.669655:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261168384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065126.677324:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261168256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7883us (8963us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.677335:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5095 00002000:00100000:3.0:1746065126.677345:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff8800a0087100 x1830881261168256/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.677355:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087100 with x1830881261168256 ext(1048576->2097151) 00002000:00010000:3.0:1746065126.677359:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0087100 00000100:00100000:2.0:1746065126.679871:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261168384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10210us (11309us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.679880:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5096 00002000:00100000:2.0:1746065126.679887:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff8800a0087480 x1830881261168384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.679895:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087480 with x1830881261168384 ext(1048576->2097151) 00002000:00010000:2.0:1746065126.679900:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0087480 00000100:00100000:0.0:1746065126.689723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.689757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.690469:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261168896 00000100:00100000:2.0:1746065126.690476:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261168896 00000100:00100000:0.0:1746065126.690487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:2.0:1746065126.690510:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800a0087800 x1830881261168896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.690517:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087800 with x1830881261168896 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.690521:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0087800 00000100:00100000:2.0:1746065126.690730:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261168768 00000100:00100000:2.0:1746065126.690732:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261168768 00002000:00100000:2.0:1746065126.690740:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a0086a00 x1830881261168768/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065126.690742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:2.0:1746065126.690745:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086a00 with x1830881261168768 ext(2097152->3145727) 00002000:00010000:2.0:1746065126.690747:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0086a00 00000100:00100000:0.0:1746065126.690758:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261169152 00000100:00100000:2.0:1746065126.690759:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261169280 00000100:00100000:2.0:1746065126.690761:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261169280 00000100:00100000:0.0:1746065126.690762:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261169152 00002000:00100000:2.0:1746065126.690770:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800a0087b80 x1830881261169280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.690775:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087b80 with x1830881261169280 ext(3145728->4194303) 00002000:00100000:0.0:1746065126.690777:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a0084000 x1830881261169152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746065126.690778:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0087b80 00002000:00100000:0.0:1746065126.690783:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084000 with x1830881261169152 ext(2097152->3145727) 00002000:00010000:0.0:1746065126.690786:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084000 00000100:00100000:2.0:1746065126.690788:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5097 00000100:00100000:2.0:1746065126.690793:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261168896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065126.690799:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5098 00000100:00100000:0.0:1746065126.690804:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261168768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.690859:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5099 00000100:00100000:2.0:1746065126.690864:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1960:x1830881261169280:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065126.691102:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5100 00000100:00100000:1.0:1746065126.691111:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1960:x1830881261169152:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065126.701367:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881261168768:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10553us (11600us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065126.701378:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5098 00002000:00100000:1.0:1746065126.701388:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff8800a0086a00 x1830881261168768/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.701397:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086a00 with x1830881261168768 ext(2097152->3145727) 00002000:00010000:1.0:1746065126.701401:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0086a00 00000100:00100000:2.0:1746065126.701590:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881261169280:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10724us (10846us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.701597:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5099 00002000:00100000:2.0:1746065126.701603:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800a0087b80 x1830881261169280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.701609:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087b80 with x1830881261169280 ext(3145728->4194303) 00002000:00010000:2.0:1746065126.701612:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0087b80 00000100:00100000:1.0:1746065126.707185:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261169152:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16067us (16689us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065126.707195:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5100 00002000:00100000:1.0:1746065126.707204:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a0084000 x1830881261169152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.707213:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084000 with x1830881261169152 ext(2097152->3145727) 00002000:00010000:1.0:1746065126.707217:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084000 00000100:00100000:3.0:1746065126.709190:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881261168896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18391us (19471us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.709198:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5097 00002000:00100000:3.0:1746065126.709206:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff8800a0087800 x1830881261168896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.709214:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087800 with x1830881261168896 ext(3145728->4194303) 00002000:00010000:3.0:1746065126.709218:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0087800 00000100:00100000:0.0:1746065126.719054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.719290:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261169664 00000100:00100000:3.0:1746065126.719307:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261169664 00002000:00100000:3.0:1746065126.719352:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f469f80 x1830881261169664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.719361:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469f80 with x1830881261169664 ext(4194304->5029887) 00002000:00010000:3.0:1746065126.719367:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469f80 00000100:00100000:3.0:1746065126.719399:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5101 00000100:00100000:3.0:1746065126.719406:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881261169664:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065126.723975:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1830881259783424:0@lo:400:kworker.0 00000100:00100000:1.0:1746065126.724024:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.724071:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065126.724076:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259783552:0@lo:400:kworker.0 00000100:00100000:1.0:1746065126.724096:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065126.724131:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259783424 00000100:00100000:1.0:1746065126.724137:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259783424 00000100:00100000:1.0:1746065126.724172:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1746065126.724178:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830881259783424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065126.724214:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830881259783424:12345-0@lo:400:kworker.0 Request processed in 36us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.724219:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1746065126.724241:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259783552 00000100:00100000:1.0:1746065126.724244:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259783552 00000100:00100000:1.0:1746065126.724258:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1746065126.724262:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881259783552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065126.724282:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881259783552:12345-0@lo:400:kworker.0 Request processed in 20us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.724287:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1746065126.724323:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259783552:0@lo:400:kworker.0 00000100:00100000:1.0:1746065126.724329:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1830881259783424:0@lo:400:kworker.0 00000100:00080000:1.0:1746065126.724351:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065126.726401:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1830881259783296:0@lo:400:kworker.0 00000100:00100000:2.0:1746065126.726446:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.726487:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830881259783808:0@lo:400:kworker.0 00000100:00100000:2.0:1746065126.726510:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.726526:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746065126.726535:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3296:1830881259783168:0@lo:400:kworker.0 00000100:00100000:2.0:1746065126.726554:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.726578:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259783680:0@lo:400:kworker.0 00000100:00100000:2.0:1746065126.726595:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.726627:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259783680 00000100:00100000:2.0:1746065126.726632:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259783680 00000100:00100000:2.0:1746065126.726662:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1746065126.726667:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881259783680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065126.726680:0:14641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259783168 00000100:00100000:3.0:1746065126.726682:0:14641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259783168 00000100:00100000:3.0:1746065126.726701:0:14641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1746065126.726702:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881259783680:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.726706:0:14641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3296:x1830881259783168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065126.726707:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1746065126.726728:0:14641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3296:x1830881259783168:12345-0@lo:400:kworker.0 Request processed in 22us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.726732:0:14641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1746065126.726734:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259783680:0@lo:400:kworker.0 00000100:00100000:2.0:1746065126.726748:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3296:1830881259783168:0@lo:400:kworker.0 00000100:00100000:2.0:1746065126.726765:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259783296 00000100:00100000:2.0:1746065126.726767:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259783296 00000100:00100000:2.0:1746065126.726792:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259783808 00000100:00100000:2.0:1746065126.726794:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259783808 00000100:00100000:2.0:1746065126.726811:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1746065126.726835:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830881259783296:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1746065126.726852:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065126.726860:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830881259783296:12345-0@lo:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.726864:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1746065126.726868:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1746065126.726875:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830881259783808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065126.726882:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1830881259783296:0@lo:400:kworker.0 00000100:00100000:0.0:1746065126.726905:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830881259783808:12345-0@lo:400:kworker.0 Request processed in 31us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.726909:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1746065126.726913:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830881259783808:0@lo:400:kworker.0 00000100:00100000:3.0:1746065126.731962:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881261169664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12549us (12908us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065126.731973:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5101 00002000:00100000:3.0:1746065126.731981:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f469f80 x1830881261169664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.731988:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469f80 with x1830881261169664 ext(4194304->5029887) 00002000:00010000:3.0:1746065126.731993:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469f80 00000100:00100000:2.0:1746065126.732570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.732663:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261169920 00000100:00100000:1.0:1746065126.732671:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261169920 00000100:00100000:1.0:1746065126.732751:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9106 00000100:00100000:1.0:1746065126.732758:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29132:x1830881261169920:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065126.732772:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.732786:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b83d expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.732895:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.732906:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.732916:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.732926:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.732934:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.732939:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733016:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733023:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733029:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:1.0:1746065126.733036:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065126.733807:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733828:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733834:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733838:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.733841:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733846:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733856:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065126.733859:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065126.733862:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733866:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f40 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733936:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733941:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733945:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733949:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.733951:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733955:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733961:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065126.733962:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.733964:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733968:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f3f32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733976:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733981:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733985:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733988:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.733989:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733994:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.733999:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012dc07700) 00010000:00010000:1.0:1746065126.734001:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.734003:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.734006:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f3f39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.734036:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b83d expref: 253 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.734043:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b83d expref: 253 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.734049:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133082c00, rc 0) 00000100:00100000:1.0:1746065126.734330:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29132:x1830881261169920:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1570us (1759us total) trans 8589943169 rc 301/301 00000100:00100000:1.0:1746065126.734337:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9106 00000100:00100000:0.0:1746065126.739383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.739431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.739491:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261170432 00000100:00100000:1.0:1746065126.739498:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261170432 00000100:00100000:3.0:1746065126.739535:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261170176 00000100:00100000:3.0:1746065126.739538:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261170176 00000100:00100000:3.0:1746065126.739565:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3729 00000100:00100000:3.0:1746065126.739652:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29128:x1830881261170176:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065126.739909:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9107 00000100:00100000:1.0:1746065126.739915:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:29133:x1830881261170432:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065126.739928:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.739940:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082400/0x14b4f8542d4f3f4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b844 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.740685:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740696:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740705:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740716:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740720:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740724:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740802:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740809:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740835:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:1.0:1746065126.740843:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065126.740894:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740899:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740904:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740908:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.740911:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740915:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740923:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065126.740925:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065126.740928:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740932:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f3f63 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740960:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740964:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740968:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740971:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.740973:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740978:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740984:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065126.740985:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.740987:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740991:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f3f55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.740999:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.741002:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.741006:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.741009:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065126.741012:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.741016:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.741021:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012dc07700) 00010000:00010000:1.0:1746065126.741022:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065126.741023:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065126.741027:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f3f5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065126.741031:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065126.741043:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259783936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1746065126.741057:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082400/0x14b4f8542d4f3f4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b844 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.741063:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082400/0x14b4f8542d4f3f4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b844 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.741070:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133082400, rc 0) 00000100:00100000:0.0:1746065126.741083:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065126.741169:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:29128:x1830881261170176:12345-192.168.202.46@tcp:35:cat.0 Request processed in 1597us (1792us total) trans 8589943170 rc 0/0 00000100:00100000:3.0:1746065126.741176:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3729 00000100:00100000:1.0:1746065126.742099:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259783936 00000100:00100000:1.0:1746065126.742104:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259783936 00000100:00100000:1.0:1746065126.742133:0:8431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1746065126.742138:0:8431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881259783936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746065126.742153:0:8431:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 458424320 pending 15335424 free 3850371072 avail 3848273920 00000100:00100000:1.0:1746065126.742181:0:8431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881259783936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.742186:0:8431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1746065126.742209:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:29133:x1830881261170432:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2293us (2777us total) trans 8589943171 rc 301/301 00000100:00100000:1.0:1746065126.742215:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9107 00000100:00100000:1.0:1746065126.742296:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259783936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065126.761808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.763082:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261170560 00000100:00100000:2.0:1746065126.763089:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261170560 00000100:00100000:2.0:1746065126.763135:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11124 00000100:00100000:2.0:1746065126.763141:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+20:29133:x1830881261170560:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065126.763154:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.763168:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b84b expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.763195:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b787 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.763202:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b821 expref: 38 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.763208:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e2 expref: 21 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.763213:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.763214:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.763217:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1118208->1441791] (req 1118208->1441791) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.763241:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e2 expref: 21 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.763250:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e2 expref: 21 pid: 4545 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746065126.763260:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259784064:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.763338:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b821 expref: 38 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.763345:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b821 expref: 38 pid: 8851 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746065126.763355:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259784192:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.763374:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b787 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.763380:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b787 expref: 7 pid: 8851 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746065126.763387:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259784320:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.763400:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.764759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.764801:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261170688 00000100:00100000:3.0:1746065126.764805:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261170688 00010000:00010000:3.0:1746065126.764844:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b787 expref: 8 pid: 8851 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746065126.764866:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ad7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259784064:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.764879:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259784192:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.764885:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259784320:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.764901:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1118208->1441791] (req 1118208->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 21 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.764938:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a010a000, rc 0) 00000100:00100000:3.0:1746065126.764961:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5541 00000100:00100000:3.0:1746065126.764968:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261170688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065126.764971:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+21:29133:x1830881261170560:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1830us (3170us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065126.764976:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065126.764976:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11124 00010000:00010000:3.0:1746065126.764992:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b787 expref: 8 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065126.764999:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b787 expref: 8 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065126.765016:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f3e0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b787 expref: 8 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065126.765311:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.765470:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261170688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 500us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.765475:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5541 00000100:00100000:0.0:1746065126.771202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.771248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.771349:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261170816 00000100:00100000:3.0:1746065126.771357:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261170816 00010000:00010000:3.0:1746065126.771386:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e2 expref: 21 pid: 4545 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065126.771422:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261170944 00000100:00100000:3.0:1746065126.771424:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261170944 00010000:00010000:3.0:1746065126.771434:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b821 expref: 39 pid: 8851 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065126.771459:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5542 00000100:00100000:3.0:1746065126.771466:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261170816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.771477:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.771495:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e2 expref: 21 pid: 4545 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065126.771504:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e2 expref: 21 pid: 4545 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065126.771521:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72a00/0x14b4f8542d4f3ead lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e2 expref: 21 pid: 4545 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065126.771537:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065126.771570:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261170816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 105us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.771576:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5542 00000100:00100000:3.0:1746065126.771617:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5543 00000100:00100000:3.0:1746065126.771622:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881261170944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.771627:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.771634:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b821 expref: 39 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065126.771642:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b821 expref: 39 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065126.771657:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe48e00/0x14b4f8542d4f3f0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b821 expref: 39 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065126.771664:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.771666:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.771672:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.771679:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.771704:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.771714:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259784448:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065126.771758:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.773522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.773672:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261171200 00000100:00100000:2.0:1746065126.773677:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261171200 00002000:00100000:2.0:1746065126.773721:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1118208->1122303) req@ffff88009f46a680 x1830881261171200/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065126.773727:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259784448:192.168.202.46@tcp:105: 00002000:00100000:2.0:1746065126.773734:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46a680 with x1830881261171200 ext(1118208->1122303) 00002000:00010000:2.0:1746065126.773738:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46a680 00010000:00010000:3.0:1746065126.773740:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065126.773762:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5102 00000100:00100000:3.0:1746065126.773763:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261170944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2141us (2515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.773767:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261171200:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065126.773770:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5543 00000100:00100000:2.0:1746065126.773907:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261171200:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 139us (389us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065126.773913:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5102 00002000:00100000:2.0:1746065126.773918:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1118208->1122303) req@ffff88009f46a680 x1830881261171200/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.773924:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46a680 with x1830881261171200 ext(1118208->1122303) 00002000:00010000:2.0:1746065126.773926:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46a680 00000100:00100000:0.0:1746065126.780532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.783151:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261171456 00000100:00100000:2.0:1746065126.783162:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261171456 00002000:00100000:3.0:1746065126.783284:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1437696->1441791) req@ffff88009f46aa00 x1830881261171456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.783293:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46aa00 with x1830881261171456 ext(1437696->1441791) 00002000:00010000:3.0:1746065126.783309:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46aa00 00000100:00100000:3.0:1746065126.783330:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5103 00000100:00100000:3.0:1746065126.783338:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1959:x1830881261171456:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065126.783966:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1959:x1830881261171456:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 627us (3441us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065126.783973:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5103 00002000:00100000:3.0:1746065126.783979:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1437696->1441791) req@ffff88009f46aa00 x1830881261171456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.783985:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46aa00 with x1830881261171456 ext(1437696->1441791) 00002000:00010000:3.0:1746065126.783988:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46aa00 00000100:00100000:0.0:1746065126.785802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.785974:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261171712 00000100:00100000:3.0:1746065126.785981:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261171712 00000100:00100000:3.0:1746065126.786129:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3730 00000100:00100000:3.0:1746065126.786137:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:29133:x1830881261171712:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065126.786755:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:29133:x1830881261171712:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 618us (957us total) trans 8589943172 rc 0/0 00000100:00100000:3.0:1746065126.786762:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3730 00000100:00100000:0.0:1746065126.788026:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065126.788040:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259784576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065126.788079:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065126.788219:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259784576 00000100:00100000:2.0:1746065126.788224:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259784576 00000100:00100000:2.0:1746065126.788256:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1746065126.788262:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881259784576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746065126.788276:0:8430:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 480444416 pending 23855104 free 3849322496 avail 3847225344 00000100:00100000:2.0:1746065126.788315:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881259784576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.788319:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1746065126.788408:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259784576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1746065126.832975:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065126.871081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.871118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.871178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.871189:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261172224 00000100:00100000:3.0:1746065126.871196:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261172224 00000100:00100000:1.0:1746065126.871206:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261172352 00000100:00100000:1.0:1746065126.871210:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261172352 00000100:00100000:3.0:1746065126.871225:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261171968 00000100:00100000:3.0:1746065126.871226:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261171968 00000100:00100000:1.0:1746065126.871233:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11125 00000100:00100000:3.0:1746065126.871237:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9108 00000100:00100000:1.0:1746065126.871239:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:29132:x1830881261172352:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:3.0:1746065126.871242:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:29142:x1830881261172224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.871257:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065126.871257:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.871268:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145000/0x14b4f8542d4f3f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b859 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.871268:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b860 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.871290:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b795 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.871325:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b82f expref: 26 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.871332:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f0 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.871337:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.871339:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.871342:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2236416->3121151] (req 2236416->3121151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 26 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.871363:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871376:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871385:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871396:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065126.871397:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9109 00010000:00010000:3.0:1746065126.871401:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065126.871403:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:29143:x1830881261171968:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.871406:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065126.871412:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.871418:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090785c00/0x14b4f8542d4f3f94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b852 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.871447:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.871453:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.871458:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.871464:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.871468:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.871472:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065126.871484:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871491:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871496:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065126.871503:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065126.871508:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.871513:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.871517:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065126.871521:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065126.871654:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f0 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.871668:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f0 expref: 14 pid: 8851 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065126.871679:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259784704:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065126.871930:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871936:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871944:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871948:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f144a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065126.871951:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871956:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871964:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065126.871966:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065126.871969:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871973:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fa9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871987:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871992:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871995:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.871999:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f144e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065126.872001:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872005:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872013:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065126.872015:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065126.872016:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872021:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3f86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872027:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872032:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872036:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872040:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f144c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065126.872042:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872046:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872051:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008fd8ee00) 00010000:00010000:3.0:1746065126.872052:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065126.872054:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872058:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f3f8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065126.872082:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145000/0x14b4f8542d4f3f78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b859 expref: 255 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.872089:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145000/0x14b4f8542d4f3f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b859 expref: 255 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.872096:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f145000, rc 0) 00010000:00010000:0.0:1746065126.872178:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872185:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872189:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872193:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090785600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065126.872195:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872200:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872207:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065126.872210:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065126.872212:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872215:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3fb0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872239:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872244:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872247:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872251:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090785a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065126.872253:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872257:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872268:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065126.872269:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065126.872271:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872275:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3f9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872281:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872290:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872294:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872308:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090785800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065126.872311:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872314:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872320:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008fd8ee00) 00010000:00010000:0.0:1746065126.872322:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065126.872324:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872328:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.872350:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785c00/0x14b4f8542d4f3f94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b852 expref: 16 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.872356:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090785c00/0x14b4f8542d4f3f94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b852 expref: 16 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.872362:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090785c00, rc 0) 00010000:00010000:1.0:1746065126.872989:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b82f expref: 26 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.872999:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b82f expref: 26 pid: 9716 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065126.873008:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259784832:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065126.873285:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:29142:x1830881261172224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2041us (2209us total) trans 8589943173 rc 301/301 00000100:00100000:0.0:1746065126.873290:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+15:29143:x1830881261171968:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1886us (2170us total) trans 8589943174 rc 301/301 00000100:00100000:3.0:1746065126.873292:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9108 00000100:00100000:0.0:1746065126.873313:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9109 00010000:00010000:1.0:1746065126.873420:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b795 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065126.873429:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b795 expref: 6 pid: 8427 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065126.873437:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259784960:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065126.873456:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065126.878234:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259784704:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065126.882188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.882257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.882289:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.882314:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259784832:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065126.882317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.882326:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881259784960:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065126.882349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065126.882358:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2236416->3121151] (req 2236416->3121151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 26 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.882373:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133082600, rc 0) 00000100:00100000:0.0:1746065126.882381:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261172864 00000100:00100000:0.0:1746065126.882385:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261172864 00010000:00010000:0.0:1746065126.882408:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b795 expref: 7 pid: 8427 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065126.882409:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:29132:x1830881261172352:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11170us (11231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.882416:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11125 00000100:00100000:0.0:1746065126.882426:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261172992 00000100:00100000:0.0:1746065126.882428:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261172992 00000100:00100000:1.0:1746065126.882430:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261172480 00000100:00100000:1.0:1746065126.882433:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261172480 00010000:00010000:0.0:1746065126.882437:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b82f expref: 26 pid: 9716 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065126.882448:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11126 00000100:00100000:0.0:1746065126.882448:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261173120 00000100:00100000:0.0:1746065126.882450:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261173120 00000100:00100000:1.0:1746065126.882454:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261172480:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065126.882457:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f0 expref: 15 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065126.882465:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065126.882468:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5544 00000100:00100000:0.0:1746065126.882473:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261172864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.882477:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133083e00/0x14b4f8542d4f3fc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b867 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.882483:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065126.882499:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b795 expref: 7 pid: 8427 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065126.882510:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259785088:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065126.882511:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b795 expref: 7 pid: 8427 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065126.882527:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbcea00/0x14b4f8542d4f3e13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b795 expref: 7 pid: 8427 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065126.882535:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065126.882550:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261172864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.882552:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.882555:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5544 00000100:00100000:0.0:1746065126.882570:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5545 00000100:00100000:0.0:1746065126.882574:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881261172992:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065126.882580:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065126.882586:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b82f expref: 26 pid: 9716 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065126.882593:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b82f expref: 26 pid: 9716 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065126.882604:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f3f16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b82f expref: 26 pid: 9716 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065126.882610:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.882621:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5546 00000100:00100000:0.0:1746065126.882624:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881261172992:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.882627:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261173120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065126.882632:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5545 00010000:00010000:1.0:1746065126.882633:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.882642:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f0 expref: 15 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065126.882652:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f0 expref: 15 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065126.882663:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009118f600/0x14b4f8542d4f3ebb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f0 expref: 15 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065126.882682:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.882684:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.882689:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.882697:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.882714:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.882723:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259785216:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065126.883511:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261172736 00000100:00100000:3.0:1746065126.883516:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261172736 00000100:00100000:3.0:1746065126.883538:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3731 00000100:00100000:3.0:1746065126.883542:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:29143:x1830881261172736:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065126.884140:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065126.885365:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+16:29143:x1830881261172736:12345-192.168.202.46@tcp:35:cat.0 Request processed in 1818us (3104us total) trans 8589943175 rc 0/0 00000100:00100000:3.0:1746065126.885373:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3731 00002000:00010000:2.0:1746065126.886902:0:4545:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065126 -> 1746065127 00002000:00010000:2.0:1746065126.886907:0:4545:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065126 -> 1746065127 00002000:00010000:2.0:1746065126.886909:0:4545:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065126 -> 1746065127 00000100:00100000:2.0:1746065126.886926:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259785088:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065126.886950:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133083e00/0x14b4f8542d4f3fc5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b867 expref: 39 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.886961:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133083e00/0x14b4f8542d4f3fc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b867 expref: 39 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065126.886973:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083e00, rc 0) 00000100:00100000:2.0:1746065126.886997:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881261172480:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4543us (4815us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065126.887003:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11126 00000100:00100000:2.0:1746065126.888102:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259785216:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065126.888112:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065126.888131:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881261173120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5505us (5781us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.888137:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5546 00000100:00100000:0.0:1746065126.888699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.888928:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261173504 00000100:00100000:3.0:1746065126.888934:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261173504 00002000:00100000:3.0:1746065126.888963:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2236416->2240511) req@ffff88012f35aa00 x1830881261173504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.888972:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35aa00 with x1830881261173504 ext(2236416->2240511) 00002000:00010000:3.0:1746065126.888977:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f35aa00 00000100:00100000:3.0:1746065126.888995:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5104 00000100:00100000:3.0:1746065126.889001:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261173504:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065126.889126:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261173504:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 125us (429us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065126.889135:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5104 00002000:00100000:3.0:1746065126.889141:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2236416->2240511) req@ffff88012f35aa00 x1830881261173504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.889147:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f35aa00 with x1830881261173504 ext(2236416->2240511) 00002000:00010000:3.0:1746065126.889149:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f35aa00 00000100:00100000:0.0:1746065126.895991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.896635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.896876:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261173248 00000100:00100000:3.0:1746065126.896883:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261173248 00000100:00100000:3.0:1746065126.896919:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261173632 00000100:00100000:3.0:1746065126.896922:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261173632 00000100:00100000:3.0:1746065126.896938:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11127 00000100:00100000:3.0:1746065126.896945:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261173248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.896960:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.896976:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b86e expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.896994:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.896995:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.897003:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b86e expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.897016:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b86e expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.897025:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f144e00, rc 0) 00000100:00100000:0.0:1746065126.897045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.897065:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+16:1960:x1830881261173248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 116us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.897074:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11127 00000100:00100000:3.0:1746065126.897085:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261173760 00000100:00100000:3.0:1746065126.897087:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261173760 00000100:00100000:3.0:1746065126.897100:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11128 00000100:00100000:3.0:1746065126.897105:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261173632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.897110:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.897116:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b875 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.897150:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259785344:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065126.897179:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11129 00000100:00100000:2.0:1746065126.897188:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:29142:x1830881261173760:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.897195:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.897204:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b87c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.897211:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c180 going to sleep for 11 seconds 00010000:00010000:2.0:1746065126.897218:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.897223:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065126.897225:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065126.897227:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 39 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.897243:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 19 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.897252:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 19 pid: 4545 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065126.897260:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259785472:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065126.897279:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.902941:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.903007:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261173888 00000100:00100000:1.0:1746065126.903014:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261173888 00002000:00100000:1.0:1746065126.903047:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1118208->1441791) req@ffff88012f359880 x1830881261173888/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065126.903056:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f359880 with x1830881261173888 ext(1118208->1441791) 00010000:00010000:1.0:1746065126.903785:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 20 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065126.903800:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 20 pid: 4545 timeout: 826 lvb_type: 0 00002000:00010000:1.0:1746065126.903807:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f359880 00000100:00100000:1.0:1746065126.903848:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1555 00000100:00100000:1.0:1746065126.903856:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261173888:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065126.904150:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259785344:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065126.904174:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fd3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b875 expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.904185:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f3fd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b875 expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065126.904198:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f144a00, rc 0) 00000100:00100000:3.0:1746065126.904224:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261173632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7118us (7589us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065126.904230:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11128 00000100:00100000:2.0:1746065126.904324:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259785472:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065126.904340:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 39 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.904351:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a010b200, rc 0) 00000100:00100000:2.0:1746065126.904369:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:29142:x1830881261173760:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7184us (7324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.904373:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11129 00000100:00100000:0.0:1746065126.906149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.906333:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261174144 00000100:00100000:2.0:1746065126.906339:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261174144 00002000:00100000:2.0:1746065126.906371:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3117056->3121151) req@ffff88012f359f80 x1830881261174144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.906380:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f359f80 with x1830881261174144 ext(3117056->3121151) 00002000:00010000:2.0:1746065126.906384:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f359f80 00000100:00100000:2.0:1746065126.907024:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5105 00000100:00100000:2.0:1746065126.907034:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261174144:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.907246:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261174144:12345-192.168.202.46@tcp:3:cat.0 Request processed in 213us (1102us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065126.907252:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5105 00002000:00100000:2.0:1746065126.907258:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3117056->3121151) req@ffff88012f359f80 x1830881261174144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.907264:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f359f80 with x1830881261174144 ext(3117056->3121151) 00002000:00010000:2.0:1746065126.907267:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f359f80 00000100:00100000:1.0:1746065126.911091:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.911152:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261174400 00000100:00100000:0.0:1746065126.911163:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261174400 00000100:00100000:0.0:1746065126.911210:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9110 00000100:00100000:0.0:1746065126.911217:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+16:29145:x1830881261174400:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065126.911236:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065126.911250:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b883 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.911348:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911358:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911367:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911377:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911382:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911389:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911471:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911479:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911484:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065126.911491:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065126.911545:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911550:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911555:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911560:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090785600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065126.911563:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911568:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911575:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065126.911577:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065126.911580:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911588:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090785600/0x14b4f8542d4f3ff6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911601:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911605:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911608:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911612:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090785a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065126.911613:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911617:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911621:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065126.911622:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065126.911624:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911627:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090785a00/0x14b4f8542d4f3fe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911632:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911635:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911639:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911642:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090785400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065126.911644:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911648:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911652:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c8fa800) 00010000:00010000:0.0:1746065126.911654:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065126.911655:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911658:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090785400/0x14b4f8542d4f3fef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065126.911679:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fe1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b883 expref: 18 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.911685:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090785800/0x14b4f8542d4f3fe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b883 expref: 18 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065126.911690:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090785800, rc 0) 00000100:00100000:0.0:1746065126.911721:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+17:29145:x1830881261174400:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 505us (638us total) trans 8589943176 rc 301/301 00000100:00100000:0.0:1746065126.911726:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9110 00000100:00100000:2.0:1746065126.913941:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261173888:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 10079us (11000us total) trans 17179872900 rc 0/0 00000100:00100000:2.0:1746065126.913951:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1555 00002000:00100000:2.0:1746065126.913962:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1118208->1441791) req@ffff88012f359880 x1830881261173888/t17179872900(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.913971:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f359880 with x1830881261173888 ext(1118208->1441791) 00010000:00010000:2.0:1746065126.913979:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 22 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065126.913993:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 22 pid: 4545 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746065126.913999:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f359880 00000100:00100000:1.0:1746065126.915876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.915903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.916393:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261174912 00000100:00100000:3.0:1746065126.916401:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261174912 00000100:00100000:3.0:1746065126.916438:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3732 00000100:00100000:3.0:1746065126.916445:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:29132:x1830881261174912:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065126.916616:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29132:x1830881261174912:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 170us (711us total) trans 8589943177 rc 0/0 00000100:00100000:3.0:1746065126.916622:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3732 00000100:00100000:2.0:1746065126.920130:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261174656 00000100:00100000:2.0:1746065126.920141:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261174656 00002000:00100000:2.0:1746065126.920557:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880135cdc700 x1830881261174656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.920566:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc700 with x1830881261174656 ext(1048576->2097151) 00002000:00010000:2.0:1746065126.920570:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdc700 00000100:00100000:2.0:1746065126.920599:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5106 00000100:00100000:2.0:1746065126.920606:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261174656:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065126.920772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.920800:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261175040 00000100:00100000:3.0:1746065126.920804:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261175040 00010000:00010000:3.0:1746065126.920835:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 22 pid: 4545 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065126.920853:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5547 00000100:00100000:3.0:1746065126.920857:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261175040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065126.920866:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065126.920881:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 22 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065126.921031:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 22 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065126.921048:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a010a000/0x14b4f8542d4f3f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1441791) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b84b expref: 22 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065126.921059:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.921060:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.921065:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.921072:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.921166:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065126.921176:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259785600:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065126.921973:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065126.929090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.929168:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261175168 00000100:00100000:3.0:1746065126.929176:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261175168 00000100:00100000:3.0:1746065126.929212:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11130 00000100:00100000:3.0:1746065126.929219:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:29145:x1830881261175168:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065126.929235:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.929250:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b88a expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.929276:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.929282:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065126.929284:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065126.929286:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3997696->4136959] (req 3997696->4136959) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.929322:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.929332:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 24 pid: 4545 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065126.929346:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259785728:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065126.929415:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.929479:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259785600:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065126.929493:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065126.929514:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261175040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8656us (8744us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065126.929521:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5547 00000100:00100000:0.0:1746065126.930669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.930765:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259785728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065126.930779:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3997696->4136959] (req 3997696->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.930789:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0dea00, rc 0) 00000100:00100000:3.0:1746065126.930810:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:29145:x1830881261175168:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1592us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.930832:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11130 00000100:00100000:3.0:1746065126.930852:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261175424 00000100:00100000:3.0:1746065126.930855:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261175424 00002000:00100000:3.0:1746065126.930874:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012f359180 x1830881261175424/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.930880:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f359180 with x1830881261175424 ext(1048576->2097151) 00002000:00010000:3.0:1746065126.930883:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f359180 00000100:00100000:3.0:1746065126.930896:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5107 00000100:00100000:3.0:1746065126.930900:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261175424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065126.932181:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:1961:x1830881261174656:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11569us (16303us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065126.932190:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5106 00002000:00100000:2.0:1746065126.932196:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880135cdc700 x1830881261174656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.932202:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc700 with x1830881261174656 ext(1048576->2097151) 00002000:00010000:2.0:1746065126.932206:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdc700 00000100:00100000:0.0:1746065126.935016:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.935595:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261175552 00000100:00100000:2.0:1746065126.935604:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261175552 00002000:00100000:2.0:1746065126.935639:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2236416->3121151) req@ffff88009f15f800 x1830881261175552/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.935649:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15f800 with x1830881261175552 ext(2236416->3121151) 00010000:00010000:2.0:1746065126.935657:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 25 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065126.935670:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 25 pid: 4545 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746065126.935676:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f15f800 00000100:00100000:2.0:1746065126.935711:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1556 00000100:00100000:2.0:1746065126.935718:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261175552:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065126.936380:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261175424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5477us (5712us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.936388:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5107 00002000:00100000:3.0:1746065126.936393:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012f359180 x1830881261175424/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.936406:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f359180 with x1830881261175424 ext(1048576->2097151) 00002000:00010000:3.0:1746065126.936409:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f359180 00000100:00100000:0.0:1746065126.946944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.946987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.947013:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261175808 00000100:00100000:2.0:1746065126.947021:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261175808 00000100:00100000:3.0:1746065126.947153:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261175680 00000100:00100000:3.0:1746065126.947158:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261175680 00000100:00100000:3.0:1746065126.947205:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11131 00000100:00100000:3.0:1746065126.947213:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:29142:x1830881261175680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.947227:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.947242:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b891 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.947264:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065126.947266:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065126.947270:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.947280:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.947289:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0dec00, rc 0) 00000100:00100000:3.0:1746065126.947336:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:29142:x1830881261175680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 124us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.947341:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11131 00000100:00100000:2.0:1746065126.947954:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11132 00000100:00100000:2.0:1746065126.947961:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+21:29143:x1830881261175808:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065126.947969:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065126.947979:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b898 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.947994:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.947995:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065126.948001:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b898 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.948012:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b898 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065126.948019:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f230800, rc 0) 00000100:00100000:2.0:1746065126.948039:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+22:29143:x1830881261175808:12345-192.168.202.46@tcp:101:cat.0 Request processed in 80us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065126.948044:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11132 00000100:00100000:0.0:1746065126.951967:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261175552:12345-192.168.202.46@tcp:4:cat.0 Request processed in 16240us (16950us total) trans 21474840120 rc 0/0 00000100:00100000:0.0:1746065126.951978:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1556 00002000:00100000:0.0:1746065126.951988:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2236416->3121151) req@ffff88009f15f800 x1830881261175552/t21474840120(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/448 e 0 to 0 dl 1746065137 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065126.951997:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15f800 with x1830881261175552 ext(2236416->3121151) 00010000:00010000:0.0:1746065126.952006:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 28 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065126.952020:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 28 pid: 4545 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065126.952025:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f15f800 00000100:00100000:0.0:1746065126.955521:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.956126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.956733:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261176064 00000100:00100000:2.0:1746065126.956742:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261176064 00002000:00100000:2.0:1746065126.956778:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f15d500 x1830881261176064/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.956786:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15d500 with x1830881261176064 ext(1048576->2097151) 00000100:00100000:1.0:1746065126.956969:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261176192 00000100:00100000:1.0:1746065126.956973:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261176192 00010000:00010000:1.0:1746065126.956993:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 28 pid: 4545 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746065126.957014:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5548 00000100:00100000:1.0:1746065126.957020:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261176192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065126.957030:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065126.957046:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 28 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065126.957055:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 28 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065126.957074:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133082600/0x14b4f8542d4f3f7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2236416->3121151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b860 expref: 28 pid: 4545 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065126.957090:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.957092:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.957098:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.957105:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.957112:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.957113:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065126.957116:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.957121:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065126.957145:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.957154:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259785856:192.168.202.46@tcp:105: 00002000:00010000:2.0:1746065126.957549:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15d500 00000100:00100000:2.0:1746065126.957564:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5108 00000100:00100000:2.0:1746065126.957570:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261176064:12345-192.168.202.46@tcp:3:multiop.0 00010000:00010000:1.0:1746065126.959948:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065126.959965:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259785984:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065126.960024:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065126.970513:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065126.970613:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259785856:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065126.971714:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261176448 00000100:00100000:2.0:1746065126.971722:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261176448 00002000:00100000:2.0:1746065126.971758:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009f15e300 x1830881261176448/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.971768:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15e300 with x1830881261176448 ext(2097152->3145727) 00002000:00010000:2.0:1746065126.971772:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15e300 00000100:00100000:3.0:1746065126.972310:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261176064:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 14726us (16782us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.972318:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5108 00002000:00100000:3.0:1746065126.972323:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f15d500 x1830881261176064/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.972331:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15d500 with x1830881261176064 ext(1048576->2097151) 00002000:00010000:3.0:1746065126.972334:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f15d500 00000100:00100000:3.0:1746065126.972350:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5109 00000100:00100000:3.0:1746065126.972356:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261176448:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065126.974232:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259785984:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065126.974251:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065126.974272:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261176192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 17251us (18146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065126.974280:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5548 00000100:00100000:0.0:1746065126.981618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.981669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.981758:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261176704 00000100:00100000:2.0:1746065126.981766:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261176704 00002000:00100000:2.0:1746065126.981801:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3997696->4001791) req@ffff88009f15fb80 x1830881261176704/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.981811:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15fb80 with x1830881261176704 ext(3997696->4001791) 00000100:00100000:3.0:1746065126.981896:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261176832 00000100:00100000:3.0:1746065126.981900:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261176832 00002000:00010000:2.0:1746065126.982005:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15fb80 00000100:00100000:2.0:1746065126.982022:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5110 00000100:00100000:2.0:1746065126.982030:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881261176704:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065126.982173:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+17:1961:x1830881261176704:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 144us (563us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065126.982179:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5110 00002000:00100000:2.0:1746065126.982184:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (3997696->4001791) req@ffff88009f15fb80 x1830881261176704/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.982191:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15fb80 with x1830881261176704 ext(3997696->4001791) 00002000:00010000:2.0:1746065126.982193:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15fb80 00000100:00100000:3.0:1746065126.982341:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11133 00000100:00100000:3.0:1746065126.982347:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:29143:x1830881261176832:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065126.982355:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065126.982368:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b89f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.982385:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.982387:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065126.982392:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b89f expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.982405:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b89f expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065126.982414:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0df600, rc 0) 00000100:00100000:3.0:1746065126.982433:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:29143:x1830881261176832:12345-192.168.202.46@tcp:101:cat.0 Request processed in 87us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065126.982439:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11133 00000100:00100000:3.0:1746065126.989388:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881261176448:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17023us (18873us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065126.989399:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5109 00002000:00100000:3.0:1746065126.989408:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009f15e300 x1830881261176448/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.989417:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15e300 with x1830881261176448 ext(2097152->3145727) 00002000:00010000:3.0:1746065126.989423:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15e300 00000100:00100000:2.0:1746065126.990548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065126.993753:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261177088 00000100:00100000:3.0:1746065126.993765:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261177088 00002000:00100000:3.0:1746065126.993810:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (4132864->4136959) req@ffff88009c124e00 x1830881261177088/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.993855:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124e00 with x1830881261177088 ext(4132864->4136959) 00002000:00010000:3.0:1746065126.993860:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c124e00 00000100:00100000:3.0:1746065126.993884:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5111 00000100:00100000:3.0:1746065126.993892:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261177088:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065126.994042:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261177088:12345-192.168.202.46@tcp:3:cat.0 Request processed in 151us (3496us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065126.994048:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5111 00002000:00100000:3.0:1746065126.994054:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (4132864->4136959) req@ffff88009c124e00 x1830881261177088/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/4536 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065126.994060:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c124e00 with x1830881261177088 ext(4132864->4136959) 00002000:00010000:3.0:1746065126.994062:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c124e00 00000100:00100000:0.0:1746065126.995487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065126.995522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065126.995575:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261177344 00000100:00100000:2.0:1746065126.995579:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261177344 00002000:00100000:2.0:1746065126.995603:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009f23b100 x1830881261177344/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.995610:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f23b100 with x1830881261177344 ext(2097152->3145727) 00002000:00010000:2.0:1746065126.995614:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f23b100 00000100:00100000:2.0:1746065126.995624:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261177472 00000100:00100000:2.0:1746065126.995626:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261177472 00002000:00100000:2.0:1746065126.995633:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3997695) req@ffff88009f238a80 x1830881261177472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/0 e 0 to 0 dl 1746065137 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065126.995639:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f238a80 with x1830881261177472 ext(3145728->3997695) 00002000:00010000:2.0:1746065126.995641:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f238a80 00000100:00100000:2.0:1746065126.995659:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5112 00000100:00100000:2.0:1746065126.995663:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881261177344:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065126.997467:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5113 00000100:00100000:3.0:1746065126.997477:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261177472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065127.000767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.000847:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261177856 00000100:00100000:2.0:1746065127.000856:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261177856 00000100:00100000:2.0:1746065127.001452:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3733 00000100:00100000:2.0:1746065127.001462:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:29145:x1830881261177856:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065127.001667:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+18:29145:x1830881261177856:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 206us (906us total) trans 8589943178 rc 0/0 00000100:00100000:2.0:1746065127.001673:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3733 00000100:00100000:1.0:1746065127.002790:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.002850:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261177984 00000100:00100000:2.0:1746065127.002855:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261177984 00000100:00100000:2.0:1746065127.004540:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11134 00000100:00100000:2.0:1746065127.004553:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:29142:x1830881261177984:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.004569:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.004584:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8a6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.004610:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.004616:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.004617:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.004620:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.004644:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.004655:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 20 pid: 8851 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.004664:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259786112:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.005015:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.008587:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881261177472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11104us (13056us total) trans 0 rc 851968/851968 00000100:00100000:3.0:1746065127.008597:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5113 00002000:00100000:3.0:1746065127.008607:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3997695) req@ffff88009f238a80 x1830881261177472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 851968/851968 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.008615:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f238a80 with x1830881261177472 ext(3145728->3997695) 00010000:00010000:3.0:1746065127.008622:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 18 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.008635:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 18 pid: 8851 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746065127.008641:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f238a80 00000100:00100000:2.0:1746065127.008990:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261177344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13323us (13503us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065127.008998:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5112 00002000:00100000:2.0:1746065127.009003:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009f23b100 x1830881261177344/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:42/0 lens 488/440 e 0 to 0 dl 1746065137 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.009011:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f23b100 with x1830881261177344 ext(2097152->3145727) 00002000:00010000:2.0:1746065127.009014:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f23b100 00000100:00100000:0.0:1746065127.011591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.011619:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259786112:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.011646:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.011660:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094614a00, rc 0) 00000100:00100000:3.0:1746065127.011889:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261178112 00000100:00100000:3.0:1746065127.011895:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261178112 00002000:00100000:3.0:1746065127.011937:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3997696->4136959) req@ffff88009f238e00 x1830881261178112/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.011945:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f238e00 with x1830881261178112 ext(3997696->4136959) 00010000:00010000:3.0:1746065127.011951:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 17 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.011961:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 17 pid: 8851 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746065127.011966:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f238e00 00000100:00100000:3.0:1746065127.011982:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1557 00000100:00100000:3.0:1746065127.011988:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261178112:12345-192.168.202.46@tcp:4:cat.0 00000100:00080000:0.0:1746065127.012223:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065127.012255:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:29142:x1830881261177984:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7704us (9464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.012262:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11134 00000100:00100000:3.0:1746065127.017544:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261178112:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5548us (5953us total) trans 21474840121 rc 0/0 00000100:00100000:3.0:1746065127.017555:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1557 00002000:00100000:3.0:1746065127.017564:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3997696->4136959) req@ffff88009f238e00 x1830881261178112/t21474840121(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.017571:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f238e00 with x1830881261178112 ext(3997696->4136959) 00010000:00010000:3.0:1746065127.017579:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 19 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.017591:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 19 pid: 8851 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746065127.017601:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f238e00 00000100:00100000:0.0:1746065127.018174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.018255:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261178240 00000100:00100000:2.0:1746065127.018261:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261178240 00000100:00100000:2.0:1746065127.018316:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11135 00000100:00100000:2.0:1746065127.018324:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:29143:x1830881261178240:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.018337:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.018350:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8ad expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.018371:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.018377:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.018386:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.018395:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094614c00, rc 0) 00000100:00100000:2.0:1746065127.018415:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:29143:x1830881261178240:12345-192.168.202.46@tcp:101:cat.0 Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.018423:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11135 00000100:00100000:0.0:1746065127.021988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.022290:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261178368 00000100:00100000:1.0:1746065127.022307:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261178368 00010000:00010000:1.0:1746065127.022337:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 20 pid: 8851 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746065127.022388:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5549 00000100:00100000:1.0:1746065127.022396:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261178368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065127.022408:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065127.022427:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 20 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065127.022443:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 20 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065127.022463:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0dea00/0x14b4f8542d4f4004 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3997696->4136959) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b88a expref: 20 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065127.022495:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.022497:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.022503:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.022510:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.022518:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.022519:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.022521:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.022527:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.022552:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065127.022562:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259786240:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065127.022642:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065127.022649:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259786368:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065127.022667:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065127.024554:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259786240:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065127.024563:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259786368:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065127.024577:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065127.024602:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261178368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2207us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.024610:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5549 00000100:00100000:0.0:1746065127.027853:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.027896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.027948:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261178624 00000100:00100000:3.0:1746065127.027956:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261178624 00000100:00100000:2.0:1746065127.027960:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261178880 00000100:00100000:2.0:1746065127.027963:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261178880 00002000:00100000:3.0:1746065127.027990:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009f239180 x1830881261178624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.027990:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009f239c00 x1830881261178880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.027999:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f239180 with x1830881261178624 ext(3145728->4194303) 00002000:00100000:2.0:1746065127.027999:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f239c00 with x1830881261178880 ext(3145728->4194303) 00002000:00010000:3.0:1746065127.028004:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f239180 00002000:00010000:2.0:1746065127.028004:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f239c00 00000100:00100000:3.0:1746065127.028019:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5114 00000100:00100000:3.0:1746065127.028025:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261178624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065127.028030:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5115 00000100:00100000:2.0:1746065127.028034:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261178880:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065127.039048:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261178624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11014us (11194us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.039057:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5114 00002000:00100000:3.0:1746065127.039067:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009f239180 x1830881261178624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.039075:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f239180 with x1830881261178624 ext(3145728->4194303) 00002000:00010000:3.0:1746065127.039079:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f239180 00000100:00100000:2.0:1746065127.039647:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261178880:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11610us (11749us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065127.039655:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5115 00002000:00100000:2.0:1746065127.039661:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009f239c00 x1830881261178880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.039668:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f239c00 with x1830881261178880 ext(3145728->4194303) 00002000:00010000:2.0:1746065127.039672:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f239c00 00000100:00100000:0.0:1746065127.052468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.052609:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261179136 00000100:00100000:3.0:1746065127.052617:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261179136 00000100:00100000:3.0:1746065127.052672:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3734 00000100:00100000:3.0:1746065127.052680:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29142:x1830881261179136:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065127.052887:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:29142:x1830881261179136:12345-192.168.202.46@tcp:35:cat.0 Request processed in 206us (425us total) trans 8589943179 rc 0/0 00000100:00100000:3.0:1746065127.052893:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3734 00000100:00080000:0.0:1746065127.052931:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065127.053024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.053091:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261179392 00000100:00100000:0.0:1746065127.053094:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261179392 00000100:00100000:0.0:1746065127.053115:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9111 00000100:00100000:0.0:1746065127.053120:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:29149:x1830881261179392:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065127.053129:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.053143:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2c00/0x14b4f8542d4f402e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8b4 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.053211:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053222:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053230:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053240:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053245:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053253:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053338:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053346:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053351:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065127.053358:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065127.053394:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053399:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053404:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053410:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946f2400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065127.053413:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053418:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053427:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065127.053429:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065127.053432:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053440:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2400/0x14b4f8542d4f4043 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053452:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053457:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053461:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053464:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946f2000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065127.053465:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053469:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053474:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065127.053476:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065127.053478:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053482:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2000/0x14b4f8542d4f4035 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053487:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053491:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053495:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053499:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946f2200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065127.053501:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053505:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053510:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c8fa800) 00010000:00010000:0.0:1746065127.053511:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065127.053513:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053517:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2200/0x14b4f8542d4f403c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065127.053541:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2c00/0x14b4f8542d4f402e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8b4 expref: 258 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.053548:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2c00/0x14b4f8542d4f402e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8b4 expref: 258 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.053554:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f2c00, rc 0) 00000100:00100000:0.0:1746065127.053576:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:29149:x1830881261179392:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 456us (552us total) trans 8589943180 rc 301/301 00000100:00100000:0.0:1746065127.053581:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9111 00000100:00100000:0.0:1746065127.108883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.108932:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261179520 00000100:00100000:3.0:1746065127.108940:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261179520 00000100:00100000:3.0:1746065127.108985:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11136 00000100:00100000:3.0:1746065127.108992:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:29149:x1830881261179520:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065127.109007:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.109021:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8bb expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.109047:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 40 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.109055:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b898 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.109062:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.109064:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.109067:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [2023424->2097151] (req 2023424->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 40 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.109092:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b898 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.109102:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b898 expref: 21 pid: 21998 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065127.109113:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259786496:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.110743:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 40 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.110758:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 40 pid: 8851 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065127.110769:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259786624:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.111505:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.113412:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259786496:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065127.113547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.113660:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261179648 00000100:00100000:1.0:1746065127.113665:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261179648 00000100:00100000:3.0:1746065127.113717:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259786624:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.113741:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [2023424->2097151] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 40 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.113755:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0dfe00, rc 0) 00010000:00010000:1.0:1746065127.113811:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b898 expref: 22 pid: 21998 timeout: 826 lvb_type: 0 00000100:00080000:0.0:1746065127.113876:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065127.113935:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:29149:x1830881261179520:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4941us (5065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.113943:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11136 00000100:00100000:1.0:1746065127.114020:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5550 00000100:00100000:1.0:1746065127.114027:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261179648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065127.114037:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065127.114053:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b898 expref: 22 pid: 21998 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065127.114062:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b898 expref: 22 pid: 21998 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065127.114083:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f230800/0x14b4f8542d4f4012 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b898 expref: 22 pid: 21998 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065127.114107:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065127.114124:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261179648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 98us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.114130:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5550 00000100:00100000:0.0:1746065127.116756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.116842:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261179776 00000100:00100000:2.0:1746065127.116849:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261179776 00010000:00010000:2.0:1746065127.116874:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 40 pid: 8851 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.116906:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5551 00000100:00100000:2.0:1746065127.116913:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1961:x1830881261179776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.116923:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.116941:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 40 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.116951:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 40 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.116968:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a010b200/0x14b4f8542d4f3fda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b87c expref: 40 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.116983:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.116984:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.116990:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 39 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.116997:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 39 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.117023:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 39 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.117033:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259786752:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.118190:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065127.121054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.121235:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c126680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259786752:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065127.121252:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.121283:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261179776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4370us (4532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.121291:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5551 00000100:00100000:3.0:1746065127.121575:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261180032 00000100:00100000:3.0:1746065127.121581:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261180032 00002000:00100000:3.0:1746065127.121611:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (2023424->2027519) req@ffff88009f46a300 x1830881261180032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.121621:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46a300 with x1830881261180032 ext(2023424->2027519) 00002000:00010000:3.0:1746065127.121626:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46a300 00000100:00100000:3.0:1746065127.121640:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5116 00000100:00100000:3.0:1746065127.121652:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261180032:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065127.121766:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261180032:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 120us (718us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065127.121771:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5116 00002000:00100000:3.0:1746065127.121776:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (2023424->2027519) req@ffff88009f46a300 x1830881261180032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.121782:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46a300 with x1830881261180032 ext(2023424->2027519) 00002000:00010000:3.0:1746065127.121785:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46a300 00000100:00100000:0.0:1746065127.122970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.123017:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261180288 00000100:00100000:2.0:1746065127.123022:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261180288 00000100:00100000:2.0:1746065127.123050:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9112 00000100:00100000:2.0:1746065127.123056:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+18:29153:x1830881261180288:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065127.123080:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.123100:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094615600/0x14b4f8542d4f4058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8c2 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.123322:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123334:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123342:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123352:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123356:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123360:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123444:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123451:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123456:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065127.123464:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065127.123526:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123535:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123541:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123594:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094615c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065127.123597:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065127.123863:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065127.123945:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123954:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.123956:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065127.123959:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123964:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094615c00/0x14b4f8542d4f406d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123975:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123980:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123984:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123988:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094615800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065127.123990:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.123998:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.124003:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065127.124005:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065127.124007:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.124011:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094615800/0x14b4f8542d4f405f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.124016:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.124021:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.124025:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.124029:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094615a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065127.124030:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.124034:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.124038:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205700) 00010000:00010000:2.0:1746065127.124040:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065127.124042:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065127.124046:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094615a00/0x14b4f8542d4f4066 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00000100:00100000:3.0:1746065127.124052:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261180416 00000100:00100000:3.0:1746065127.124055:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261180416 00010000:00010000:2.0:1746065127.124073:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615600/0x14b4f8542d4f4058 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c2 expref: 20 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.124080:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094615600/0x14b4f8542d4f4058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c2 expref: 20 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.124086:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094615600, rc 0) 00000100:00100000:3.0:1746065127.124088:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11137 00000100:00100000:3.0:1746065127.124093:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:29149:x1830881261180416:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065127.124101:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.124109:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8c9 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.124117:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+19:29153:x1830881261180288:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1061us (1150us total) trans 8589943181 rc 301/301 00000100:00100000:2.0:1746065127.124121:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9112 00010000:00010000:3.0:1746065127.124129:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b78e expref: 6 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.124136:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b828 expref: 40 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.124142:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e9 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.124147:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.124149:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.124152:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->2646015] (req 2097152->2646015) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 40 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.124173:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e9 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.124182:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e9 expref: 20 pid: 8851 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065127.124193:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259786880:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.124377:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b828 expref: 40 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.124385:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b828 expref: 40 pid: 8851 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065127.124393:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259787008:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.124418:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b78e expref: 6 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.124424:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b78e expref: 6 pid: 8429 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065127.124430:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259787136:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.124444:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.127409:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259786880:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065127.130572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.130649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.130724:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261180672 00000100:00100000:1.0:1746065127.130733:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261180672 00010000:00010000:1.0:1746065127.130769:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b78e expref: 7 pid: 8429 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065127.130791:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261180544 00000100:00100000:1.0:1746065127.130793:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261180544 00010000:00010000:1.0:1746065127.130801:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b828 expref: 41 pid: 8851 timeout: 826 lvb_type: 1 00000100:00080000:0.0:1746065127.130865:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065127.131016:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5552 00000100:00100000:1.0:1746065127.131023:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261180672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065127.131036:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065127.131054:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b78e expref: 7 pid: 8429 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.131063:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b78e expref: 7 pid: 8429 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.131088:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065127.131127:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261180672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.131133:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5552 00000100:00100000:1.0:1746065127.131146:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5553 00000100:00100000:1.0:1746065127.131151:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881261180544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065127.131157:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065127.131164:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b828 expref: 41 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.131177:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b828 expref: 41 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.131186:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065127.131200:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881261180544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.131205:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5553 00010000:00010000:3.0:1746065127.131335:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f3f1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b828 expref: 40 pid: 8851 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065127.131648:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259787008:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.131663:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1c72000/0x14b4f8542d4f3e1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b78e expref: 6 pid: 8429 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065127.131671:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259787136:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.131695:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->2646015] (req 2097152->2646015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 39 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.131703:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0dea00, rc 0) 00000100:00100000:3.0:1746065127.131722:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f23a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:29149:x1830881261180416:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7629us (7860us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.131728:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11137 00000100:00100000:0.0:1746065127.131748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.131876:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261180800 00000100:00100000:2.0:1746065127.131880:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261180800 00010000:00010000:2.0:1746065127.131895:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e9 expref: 21 pid: 8851 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746065127.131911:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5554 00000100:00100000:2.0:1746065127.131916:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261180800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.131922:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.131930:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e9 expref: 21 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746065127.131939:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e9 expref: 21 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746065127.131950:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009118f000/0x14b4f8542d4f3eb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7e9 expref: 21 pid: 8851 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746065127.131962:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.131964:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.131969:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.131975:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.131997:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.132006:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259787264:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.132057:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.134316:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259787264:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065127.134334:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.134363:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+20:1958:x1830881261180800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2445us (2847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.134370:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5554 00000100:00100000:0.0:1746065127.138158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.138378:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261181056 00000100:00100000:2.0:1746065127.138386:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261181056 00002000:00100000:2.0:1746065127.138424:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2641920->2646015) req@ffff880130447800 x1830881261181056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.138433:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447800 with x1830881261181056 ext(2641920->2646015) 00002000:00010000:2.0:1746065127.138438:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130447800 00000100:00100000:2.0:1746065127.138468:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5117 00000100:00100000:2.0:1746065127.138475:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261181056:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065127.138616:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881261181056:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 140us (464us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065127.138622:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5117 00002000:00100000:2.0:1746065127.138628:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2641920->2646015) req@ffff880130447800 x1830881261181056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.138634:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447800 with x1830881261181056 ext(2641920->2646015) 00002000:00010000:2.0:1746065127.138637:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130447800 00000100:00100000:0.0:1746065127.140107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.140397:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261181312 00000100:00100000:3.0:1746065127.140403:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261181312 00000100:00100000:3.0:1746065127.140443:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3735 00000100:00100000:3.0:1746065127.140449:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:29149:x1830881261181312:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065127.140717:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:29149:x1830881261181312:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 267us (611us total) trans 8589943182 rc 0/0 00000100:00100000:3.0:1746065127.140723:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3735 00000100:00100000:0.0:1746065127.178394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.178455:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261181568 00000100:00100000:2.0:1746065127.178462:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261181568 00000100:00100000:0.0:1746065127.178471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.178525:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261181824 00000100:00100000:1.0:1746065127.178529:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261181824 00000100:00100000:1.0:1746065127.178564:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9113 00000100:00100000:1.0:1746065127.178572:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:29160:x1830881261181568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.178597:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.178612:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ae00/0x14b4f8542d4f4082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8d0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.178701:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.178712:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.178720:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.178731:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.178736:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.178741:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065127.178864:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9114 00000100:00100000:0.0:1746065127.178871:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:29159:x1830881261181824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065127.178879:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.178886:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2a00/0x14b4f8542d4f4097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8d7 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.178928:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.178934:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.178940:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.178946:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.178951:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.178955:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.178997:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179003:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179007:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:0.0:1746065127.179013:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065127.179145:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179151:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179156:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179164:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946f3a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065127.179167:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179173:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179181:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065127.179184:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065127.179187:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179191:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3a00/0x14b4f8542d4f40ac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179205:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179209:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179213:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179217:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946f3e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065127.179219:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179223:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179228:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065127.179230:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065127.179232:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179236:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3e00/0x14b4f8542d4f409e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179241:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179245:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179249:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179253:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946f3c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065127.179254:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179258:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179263:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715100) 00010000:00010000:0.0:1746065127.179264:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065127.179266:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179270:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f3c00/0x14b4f8542d4f40a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065127.179306:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2a00/0x14b4f8542d4f4097 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8d7 expref: 260 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.179313:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946f2a00/0x14b4f8542d4f4097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8d7 expref: 260 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.179321:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f2a00, rc 0) 00000100:00100000:0.0:1746065127.179358:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:29159:x1830881261181824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 488us (887us total) trans 8589943183 rc 301/301 00000100:00100000:0.0:1746065127.179364:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9114 00010000:00010000:1.0:1746065127.179657:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.179664:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.179670:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065127.179676:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065127.179714:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.179719:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.179727:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.179730:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f76b600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065127.179732:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.179737:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.179743:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065127.179745:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065127.179747:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.179751:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40ba lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180283:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180289:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180302:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180307:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f76b200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065127.180309:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180313:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180323:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065127.180325:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065127.180327:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180331:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180338:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180343:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180346:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180350:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f76b400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065127.180351:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180355:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180361:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715100) 00010000:00010000:1.0:1746065127.180362:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065127.180365:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180369:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.180394:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ae00/0x14b4f8542d4f4082 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8d0 expref: 21 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.180400:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ae00/0x14b4f8542d4f4082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8d0 expref: 21 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.180407:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76ae00, rc 0) 00000100:00100000:1.0:1746065127.180432:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+20:29160:x1830881261181568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1861us (2083us total) trans 8589943184 rc 301/301 00000100:00100000:1.0:1746065127.180437:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9113 00000100:00100000:0.0:1746065127.181458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.181842:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261182080 00000100:00100000:3.0:1746065127.181849:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261182080 00000100:00100000:3.0:1746065127.182207:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3736 00000100:00100000:3.0:1746065127.182215:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+20:29160:x1830881261182080:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065127.182382:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:29160:x1830881261182080:12345-192.168.202.46@tcp:35:cat.0 Request processed in 167us (926us total) trans 8589943185 rc 0/0 00000100:00100000:3.0:1746065127.182389:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3736 00000100:00100000:0.0:1746065127.184285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.184328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.184432:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261182208 00000100:00100000:1.0:1746065127.184439:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261182208 00000100:00100000:1.0:1746065127.184502:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261182336 00000100:00100000:1.0:1746065127.184504:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261182336 00000100:00100000:1.0:1746065127.184517:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11138 00000100:00100000:1.0:1746065127.184523:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261182208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.184537:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.184550:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f40c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8de expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065127.184589:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259787392:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065127.184644:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.184702:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11139 00000100:00100000:3.0:1746065127.184712:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261182336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.184719:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.184726:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0df800/0x14b4f8542d4f40cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8e5 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.184747:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259787520:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065127.184767:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c300 going to sleep for 11 seconds 00002000:00010000:3.0:1746065127.186322:0:4545:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065127 -> 1746065128 00002000:00010000:3.0:1746065127.186328:0:4545:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065127 -> 1746065128 00002000:00010000:3.0:1746065127.186330:0:4545:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065127 -> 1746065128 00000100:00100000:3.0:1746065127.186347:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259787520:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065127.186368:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0df800/0x14b4f8542d4f40cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8e5 expref: 23 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.186380:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0df800/0x14b4f8542d4f40cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8e5 expref: 23 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.186388:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0df800, rc 0) 00000100:00100000:3.0:1746065127.186413:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261182336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1705us (2084us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065127.186420:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11139 00002000:00010000:1.0:1746065127.186484:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065127 -> 1746065128 00002000:00010000:1.0:1746065127.186487:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065127 -> 1746065128 00002000:00010000:1.0:1746065127.186489:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065127 -> 1746065128 00000100:00100000:1.0:1746065127.186497:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259787392:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065127.186512:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f40c8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8de expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.186524:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f40c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8de expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.186530:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76be00, rc 0) 00000100:00100000:1.0:1746065127.186546:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261182208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2023us (2267us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065127.186551:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11138 00000100:00100000:0.0:1746065127.187674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.187744:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261182592 00000100:00100000:3.0:1746065127.187749:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261182592 00002000:00100000:3.0:1746065127.187776:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2023423) req@ffff88012d7ff100 x1830881261182592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.187785:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff100 with x1830881261182592 ext(1048576->2023423) 00002000:00010000:3.0:1746065127.187789:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7ff100 00000100:00100000:2.0:1746065127.188033:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5118 00000100:00100000:2.0:1746065127.188042:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881261182592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065127.198129:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881261182592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10080us (10448us total) trans 0 rc 974848/974848 00000100:00100000:2.0:1746065127.198139:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5118 00002000:00100000:2.0:1746065127.198148:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2023423) req@ffff88012d7ff100 x1830881261182592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 974848/974848 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.198158:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff100 with x1830881261182592 ext(1048576->2023423) 00002000:00010000:2.0:1746065127.198162:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7ff100 00000100:00100000:0.0:1746065127.198535:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.198578:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261182720 00000100:00100000:1.0:1746065127.198586:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261182720 00000100:00100000:1.0:1746065127.198630:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11140 00000100:00100000:1.0:1746065127.198637:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:29160:x1830881261182720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.198651:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.198666:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8ec expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.198704:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.198711:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065127.198712:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065127.198716:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.198738:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.198754:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 38 pid: 8851 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746065127.198764:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259787648:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.199161:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065127.202028:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259787648:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065127.202054:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.202070:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76b000, rc 0) 00000100:00100000:1.0:1746065127.202123:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:29160:x1830881261182720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3485us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.202130:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11140 00000100:00100000:0.0:1746065127.204075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.206258:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261182848 00000100:00100000:2.0:1746065127.206269:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261182848 00002000:00100000:2.0:1746065127.206323:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (2023424->2097151) req@ffff88009f9cf480 x1830881261182848/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.206332:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf480 with x1830881261182848 ext(2023424->2097151) 00010000:00010000:2.0:1746065127.206340:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 39 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.206353:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 39 pid: 8851 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746065127.206364:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cf480 00000100:00100000:1.0:1746065127.211639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.212023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.212042:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261183104 00000100:00100000:1.0:1746065127.212049:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261183104 00002000:00100000:1.0:1746065127.212079:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2646016->3694591) req@ffff880135cdfb80 x1830881261183104/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.212088:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdfb80 with x1830881261183104 ext(2646016->3694591) 00002000:00010000:1.0:1746065127.212092:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdfb80 00000100:00100000:1.0:1746065127.212109:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261183360 00000100:00100000:1.0:1746065127.212111:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261183360 00002000:00100000:1.0:1746065127.212119:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3694592->4194303) req@ffff880135cdd180 x1830881261183360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.212125:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd180 with x1830881261183360 ext(3694592->4194303) 00002000:00010000:1.0:1746065127.212128:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdd180 00000100:00100000:1.0:1746065127.212142:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1558 00000100:00100000:1.0:1746065127.212148:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881261182848:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065127.212338:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5119 00000100:00100000:0.0:1746065127.212345:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1959:x1830881261183104:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065127.212530:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5120 00000100:00100000:2.0:1746065127.212539:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1958:x1830881261183360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065127.217335:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881261182848:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5110us (13189us total) trans 17179872901 rc 0/0 00000100:00100000:1.0:1746065127.218438:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1558 00002000:00100000:1.0:1746065127.218452:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (2023424->2097151) req@ffff88009f9cf480 x1830881261182848/t17179872901(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.218461:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf480 with x1830881261182848 ext(2023424->2097151) 00010000:00010000:1.0:1746065127.218471:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 45 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065127.218558:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 45 pid: 8851 timeout: 826 lvb_type: 0 00002000:00010000:1.0:1746065127.218566:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cf480 00000100:00100000:2.0:1746065127.225374:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1958:x1830881261183360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12828us (13343us total) trans 0 rc 499712/499712 00000100:00100000:2.0:1746065127.225385:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5120 00002000:00100000:2.0:1746065127.225395:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (3694592->4194303) req@ffff880135cdd180 x1830881261183360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 499712/499712 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.225404:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd180 with x1830881261183360 ext(3694592->4194303) 00002000:00010000:2.0:1746065127.225409:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdd180 00000100:00100000:1.0:1746065127.227309:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1959:x1830881261183104:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14943us (15656us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065127.227318:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5119 00002000:00100000:1.0:1746065127.227327:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (2646016->3694591) req@ffff880135cdfb80 x1830881261183104/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.227336:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdfb80 with x1830881261183104 ext(2646016->3694591) 00002000:00010000:1.0:1746065127.227342:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdfb80 00000100:00100000:0.0:1746065127.229151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.229727:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261183488 00000100:00100000:2.0:1746065127.229739:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261183488 00010000:00010000:2.0:1746065127.229775:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 41 pid: 8851 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.229858:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5555 00000100:00100000:2.0:1746065127.229868:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881261183488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.229882:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.229906:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 41 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.229918:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 41 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.229945:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dfe00/0x14b4f8542d4f4051 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8bb expref: 41 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.229986:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.229989:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.229996:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.230004:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.230037:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.230050:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259787776:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.231494:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065127.240056:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259787776:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065127.240076:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.240128:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1960:x1830881261183488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 10261us (10985us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.240138:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5555 00000100:00100000:0.0:1746065127.241532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.241593:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261183616 00000100:00100000:1.0:1746065127.241600:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261183616 00000100:00100000:1.0:1746065127.241639:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11141 00000100:00100000:1.0:1746065127.241645:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1961:x1830881261183616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.241659:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.241672:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8f3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.241691:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.241692:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.241699:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8f3 expref: 41 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.241712:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8f3 expref: 41 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.241720:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76aa00, rc 0) 00000100:00100000:1.0:1746065127.241749:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881261183616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 104us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.241754:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11141 00000100:00100000:0.0:1746065127.246228:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.246507:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261183872 00000100:00100000:1.0:1746065127.246517:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261183872 00002000:00100000:1.0:1746065127.246561:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f9cd500 x1830881261183872/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.246570:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd500 with x1830881261183872 ext(1048576->2097151) 00002000:00010000:1.0:1746065127.246575:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cd500 00000100:00100000:1.0:1746065127.249384:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5121 00000100:00100000:1.0:1746065127.249401:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261183872:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065127.258640:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.258891:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261184128 00000100:00100000:2.0:1746065127.258900:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261184128 00002000:00100000:2.0:1746065127.258938:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f9cc700 x1830881261184128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.258952:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc700 with x1830881261184128 ext(4194304->5029887) 00002000:00010000:2.0:1746065127.258957:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cc700 00000100:00100000:2.0:1746065127.258979:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5122 00000100:00100000:2.0:1746065127.258987:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1958:x1830881261184128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065127.260642:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261183872:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11246us (14423us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065127.260651:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5121 00002000:00100000:1.0:1746065127.260658:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009f9cd500 x1830881261183872/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.260666:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd500 with x1830881261183872 ext(1048576->2097151) 00002000:00010000:1.0:1746065127.260669:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cd500 00000100:00100000:2.0:1746065127.270095:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1958:x1830881261184128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11100us (11456us total) trans 0 rc 835584/835584 00000100:00100000:2.0:1746065127.270107:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5122 00002000:00100000:2.0:1746065127.270119:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f9cc700 x1830881261184128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.270128:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc700 with x1830881261184128 ext(4194304->5029887) 00002000:00010000:2.0:1746065127.270133:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cc700 00000100:00100000:0.0:1746065127.271551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.271931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.272469:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261184256 00000100:00100000:1.0:1746065127.272477:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261184256 00000100:00100000:1.0:1746065127.272517:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261184384 00000100:00100000:1.0:1746065127.272520:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261184384 00000100:00100000:1.0:1746065127.272662:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11142 00000100:00100000:1.0:1746065127.272669:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:29153:x1830881261184256:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065127.272684:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.272698:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b8fa expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.272773:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11143 00000100:00100000:2.0:1746065127.272780:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+22:29160:x1830881261184384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.272787:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.272795:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b901 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.272830:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 40 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.272837:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.272838:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.272841:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.272870:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 40 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.272879:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 40 pid: 8851 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.272889:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259787904:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065127.273030:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b772 expref: 5 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.273038:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b80c expref: 40 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.273044:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7d4 expref: 24 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.273049:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.273051:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.273053:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [1003520->1048575] (req 1003520->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.273067:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7d4 expref: 24 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.273073:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7d4 expref: 24 pid: 4544 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065127.273080:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259788032:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.273514:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065127.273788:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b80c expref: 40 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.273796:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b80c expref: 40 pid: 9716 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065127.273803:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259788160:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065127.273859:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b772 expref: 5 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.273867:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b772 expref: 5 pid: 21998 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065127.273878:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133088700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259788288:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.273894:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.274802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.274997:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259788032:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.275161:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261184640 00000100:00100000:2.0:1746065127.275166:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261184640 00000100:00100000:2.0:1746065127.275198:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3737 00000100:00100000:2.0:1746065127.275203:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:29159:x1830881261184640:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065127.275388:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259787904:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.275405:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 24 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.275415:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe49400, rc 0) 00000100:00100000:3.0:1746065127.275435:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+24:29160:x1830881261184384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2656us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.275444:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11143 00000100:00100000:2.0:1746065127.275992:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:29159:x1830881261184640:12345-192.168.202.46@tcp:35:cat.0 Request processed in 787us (1190us total) trans 8589943186 rc 0/0 00000100:00100000:2.0:1746065127.275998:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3737 00000100:00100000:0.0:1746065127.276494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.276609:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261184768 00000100:00100000:2.0:1746065127.276613:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261184768 00002000:00100000:2.0:1746065127.276637:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2646015) req@ffff88009f9cfb80 x1830881261184768/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.276645:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cfb80 with x1830881261184768 ext(2097152->2646015) 00010000:00010000:2.0:1746065127.276651:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 41 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.276660:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 41 pid: 8851 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746065127.276666:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cfb80 00000100:00100000:2.0:1746065127.276678:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1559 00000100:00100000:2.0:1746065127.276684:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881261184768:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065127.279570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.279621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.279640:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261184896 00000100:00100000:0.0:1746065127.279647:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261184896 00010000:00010000:0.0:1746065127.279675:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b772 expref: 6 pid: 21998 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065127.279695:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261185024 00000100:00100000:0.0:1746065127.279697:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261185024 00010000:00010000:0.0:1746065127.279706:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7d4 expref: 24 pid: 4544 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065127.279719:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5556 00000100:00100000:0.0:1746065127.279725:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261184896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.279735:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.279753:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b772 expref: 6 pid: 21998 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065127.279762:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b772 expref: 6 pid: 21998 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065127.279783:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065127.279843:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5557 00000100:00100000:1.0:1746065127.279850:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261185024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065127.279858:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065127.279871:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7d4 expref: 24 pid: 4544 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.279879:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7d4 expref: 24 pid: 4544 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.279890:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009118ea00/0x14b4f8542d4f3e9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7d4 expref: 24 pid: 4544 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.279912:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065127.279940:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261185024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.279943:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259788160:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.279946:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5557 00010000:00010000:2.0:1746065127.279953:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbce400/0x14b4f8542d4f3df7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b772 expref: 6 pid: 21998 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746065127.279963:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133088700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259788288:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.279987:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [1003520->1048575] (req 1003520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.279996:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76a200, rc 0) 00000100:00100000:2.0:1746065127.280017:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:29153:x1830881261184256:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7349us (8470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.280023:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11142 00000100:00100000:2.0:1746065127.281491:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.281609:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261185152 00000100:00100000:3.0:1746065127.281615:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261185152 00010000:00010000:3.0:1746065127.281632:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b80c expref: 43 pid: 9716 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065127.281651:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5558 00000100:00100000:3.0:1746065127.281656:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881261185152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065127.281663:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.281675:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b80c expref: 43 pid: 9716 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065127.281684:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b80c expref: 43 pid: 9716 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065127.281697:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f145600/0x14b4f8542d4f3efa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b80c expref: 43 pid: 9716 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065127.281707:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.281708:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.281714:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.281721:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.281742:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.281751:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259788416:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065127.281802:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065127.281981:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881261184896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2255us (2416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.281987:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5556 00000100:00100000:0.0:1746065127.285379:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881261184768:12345-192.168.202.46@tcp:4:cat.0 Request processed in 8686us (8876us total) trans 17179872902 rc 0/0 00000100:00100000:0.0:1746065127.285390:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1559 00002000:00100000:0.0:1746065127.285400:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2646015) req@ffff88009f9cfb80 x1830881261184768/t17179872902(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065127.285408:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cfb80 with x1830881261184768 ext(2097152->2646015) 00010000:00010000:0.0:1746065127.285417:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 43 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.285429:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 43 pid: 8851 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065127.285436:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cfb80 00000100:00100000:3.0:1746065127.287857:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259788416:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065127.287876:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065127.287917:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881261185152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6258us (6429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.287926:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5558 00000100:00100000:0.0:1746065127.288105:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.288188:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261185408 00000100:00100000:1.0:1746065127.288194:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261185408 00002000:00100000:1.0:1746065127.288225:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (1003520->1007615) req@ffff88009f9cc380 x1830881261185408/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.288233:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc380 with x1830881261185408 ext(1003520->1007615) 00002000:00010000:1.0:1746065127.288237:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cc380 00000100:00100000:1.0:1746065127.288251:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5123 00000100:00100000:1.0:1746065127.288257:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261185408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065127.288410:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261185408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 153us (306us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065127.288416:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5123 00002000:00100000:1.0:1746065127.288421:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (1003520->1007615) req@ffff88009f9cc380 x1830881261185408/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.288427:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc380 with x1830881261185408 ext(1003520->1007615) 00002000:00010000:1.0:1746065127.288430:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cc380 00000100:00100000:0.0:1746065127.291506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.292084:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261185536 00000100:00100000:3.0:1746065127.292096:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261185536 00000100:00100000:0.0:1746065127.292100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065127.292124:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 42 pid: 8851 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065127.292156:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5559 00000100:00100000:0.0:1746065127.292163:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1960:x1830881261185536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.292174:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.292192:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 42 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.292203:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 42 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.292222:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0dea00/0x14b4f8542d4f407b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2646015) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8c9 expref: 42 pid: 8851 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.292248:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.292249:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.292255:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.292262:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.292271:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261185664 00000100:00100000:2.0:1746065127.292275:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261185664 00010000:00010000:0.0:1746065127.292287:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.292314:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11144 00000100:00100000:0.0:1746065127.292314:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259788544:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.292319:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:29153:x1830881261185664:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065127.292331:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.292341:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b908 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.292360:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065127.292363:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b13c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065127.292366:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b813 expref: 27 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.292370:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.292371:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.292374:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->1896447] (req 1048576->1896447) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.292390:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b813 expref: 27 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.292400:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b813 expref: 27 pid: 4545 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746065127.292412:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259788672:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.292439:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.292446:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 20 pid: 9716 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.292453:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259788800:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.292467:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.296215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.296241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.296347:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259788544:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065127.296364:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.296399:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881261185536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4236us (4897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.296408:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5559 00000100:00100000:2.0:1746065127.296432:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261185792 00000100:00100000:2.0:1746065127.296436:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261185792 00010000:00010000:2.0:1746065127.296460:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 21 pid: 9716 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.296475:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261185920 00000100:00100000:2.0:1746065127.296477:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261185920 00010000:00010000:2.0:1746065127.296485:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b813 expref: 28 pid: 4545 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746065127.296498:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5560 00000100:00100000:2.0:1746065127.296503:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261185792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.296512:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.296529:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 21 pid: 9716 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.296537:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 21 pid: 9716 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.296557:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.296570:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261185792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.296576:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5560 00000100:00100000:2.0:1746065127.296585:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5561 00000100:00100000:2.0:1746065127.296589:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881261185920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.296595:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.296601:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b813 expref: 28 pid: 4545 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746065127.296608:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b813 expref: 28 pid: 4545 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746065127.296618:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.296620:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.296625:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.296632:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.296655:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.296664:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259788928:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.296706:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8ac90c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065127.296859:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133083400/0x14b4f8542d4f3f01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b813 expref: 28 pid: 4545 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065127.296873:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259788672:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.296881:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f145200/0x14b4f8542d4f3ec2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7f7 expref: 20 pid: 9716 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065127.296887:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259788800:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.296902:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.296910:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f3000, rc 0) 00000100:00100000:3.0:1746065127.296933:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:29153:x1830881261185664:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4613us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.296943:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11144 00000100:00100000:0.0:1746065127.298681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.298733:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261186176 00000100:00100000:2.0:1746065127.298739:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261186176 00002000:00100000:2.0:1746065127.298768:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880094ff7b80 x1830881261186176/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.298776:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7b80 with x1830881261186176 ext(2097152->3145727) 00002000:00010000:2.0:1746065127.298780:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff7b80 00000100:00100000:2.0:1746065127.298795:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5124 00000100:00100000:2.0:1746065127.298801:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261186176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065127.298804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.298861:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261186432 00000100:00100000:1.0:1746065127.298864:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261186432 00002000:00100000:1.0:1746065127.298879:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094ff4e00 x1830881261186432/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.298885:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4e00 with x1830881261186432 ext(3145728->4194303) 00002000:00010000:1.0:1746065127.298887:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff4e00 00000100:00100000:1.0:1746065127.298897:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5125 00000100:00100000:1.0:1746065127.298901:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261186432:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065127.299291:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259788928:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065127.299317:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065127.299343:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881261185920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2754us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.299350:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5561 00000100:00100000:0.0:1746065127.310666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.310781:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261186432:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11877us (11974us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065127.310790:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5125 00002000:00100000:2.0:1746065127.310799:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880094ff4e00 x1830881261186432/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.310808:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4e00 with x1830881261186432 ext(3145728->4194303) 00002000:00010000:2.0:1746065127.310813:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff4e00 00000100:00100000:2.0:1746065127.310858:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261186688 00000100:00100000:2.0:1746065127.310864:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261186688 00002000:00100000:2.0:1746065127.310889:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1892352->1896447) req@ffff880094ff6a00 x1830881261186688/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.310895:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6a00 with x1830881261186688 ext(1892352->1896447) 00002000:00010000:2.0:1746065127.310897:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff6a00 00000100:00100000:2.0:1746065127.311964:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261186176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13161us (13285us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065127.311970:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5124 00002000:00100000:2.0:1746065127.311975:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880094ff7b80 x1830881261186176/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.311982:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7b80 with x1830881261186176 ext(2097152->3145727) 00002000:00010000:2.0:1746065127.311986:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff7b80 00000100:00100000:2.0:1746065127.311997:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5126 00000100:00100000:2.0:1746065127.312004:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881261186688:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065127.312107:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+19:1958:x1830881261186688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 104us (1448us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065127.312112:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5126 00002000:00100000:2.0:1746065127.312115:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1892352->1896447) req@ffff880094ff6a00 x1830881261186688/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.312121:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6a00 with x1830881261186688 ext(1892352->1896447) 00002000:00010000:2.0:1746065127.312123:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff6a00 00000100:00100000:0.0:1746065127.313660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.314132:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261186944 00000100:00100000:2.0:1746065127.314139:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261186944 00000100:00100000:2.0:1746065127.314174:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3738 00000100:00100000:2.0:1746065127.314179:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:29153:x1830881261186944:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065127.314389:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:29153:x1830881261186944:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 208us (730us total) trans 8589943187 rc 0/0 00000100:00100000:2.0:1746065127.314394:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3738 00000100:00100000:2.0:1746065127.321932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.322129:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261187200 00000100:00100000:1.0:1746065127.322138:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261187200 00002000:00100000:1.0:1746065127.322174:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009ba1f480 x1830881261187200/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.322186:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f480 with x1830881261187200 ext(4194304->5029887) 00002000:00010000:1.0:1746065127.322191:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1f480 00000100:00100000:1.0:1746065127.322222:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5127 00000100:00100000:1.0:1746065127.322229:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261187200:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065127.329464:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261187200:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7225us (7530us total) trans 0 rc 835584/835584 00000100:00100000:1.0:1746065127.329475:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5127 00002000:00100000:1.0:1746065127.329486:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009ba1f480 x1830881261187200/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.329496:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f480 with x1830881261187200 ext(4194304->5029887) 00002000:00010000:1.0:1746065127.329502:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1f480 00000100:00100000:0.0:1746065127.374218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.374266:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261187456 00000100:00100000:1.0:1746065127.374273:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261187456 00000100:00100000:1.0:1746065127.374338:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9115 00000100:00100000:1.0:1746065127.374346:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:29165:x1830881261187456:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065127.374368:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.374384:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b90f expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.374481:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374494:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374505:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374518:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374524:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374529:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374636:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374646:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374652:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065127.374661:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065127.374740:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374746:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374752:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374757:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f76ba00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065127.374760:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374766:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374776:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065127.374778:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065127.374782:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374787:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f410e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374853:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374860:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374864:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374867:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f76b200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065127.374870:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374874:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374881:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065127.374883:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065127.374886:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374890:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b200/0x14b4f8542d4f4100 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374897:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374902:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374906:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374909:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f76b400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065127.374911:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374915:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374921:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715900) 00010000:00010000:1.0:1746065127.374923:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065127.374924:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374928:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b400/0x14b4f8542d4f4107 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.374962:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b90f expref: 262 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.374969:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76b600/0x14b4f8542d4f40f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b90f expref: 262 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.374976:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76b600, rc 0) 00000100:00100000:1.0:1746065127.375030:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:29165:x1830881261187456:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 685us (819us total) trans 8589943188 rc 301/301 00000100:00100000:1.0:1746065127.375039:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9115 00000100:00100000:0.0:1746065127.382612:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.383245:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261187584 00000100:00100000:3.0:1746065127.383252:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261187584 00000100:00100000:3.0:1746065127.383310:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11145 00000100:00100000:3.0:1746065127.383317:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:29165:x1830881261187584:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065127.383332:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.383346:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b916 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.383372:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.383380:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.383381:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.383384:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3932160->4095999] (req 3932160->4095999) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 42 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.383408:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.383424:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 21 pid: 21998 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065127.383434:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259789056:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.383593:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.390014:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259789056:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.390052:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3932160->4095999] (req 3932160->4095999) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 42 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.390068:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091103800, rc 0) 00000100:00100000:3.0:1746065127.390524:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:29165:x1830881261187584:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7204us (7918us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.390532:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11145 00000100:00100000:0.0:1746065127.393022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.393078:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261187712 00000100:00100000:3.0:1746065127.393085:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261187712 00010000:00010000:3.0:1746065127.393110:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 22 pid: 21998 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065127.393711:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5562 00000100:00100000:3.0:1746065127.393720:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261187712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065127.393732:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.393753:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 22 pid: 21998 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.393769:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 22 pid: 21998 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.393786:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f40eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b901 expref: 22 pid: 21998 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.393942:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.393944:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.393950:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 41 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.393958:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 41 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.393987:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 41 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.393997:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259789184:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065127.394383:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.396629:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259789184:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065127.396659:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065127.396704:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261187712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2985us (3685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.396714:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5562 00000100:00100000:0.0:1746065127.397031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.397164:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261187968 00000100:00100000:2.0:1746065127.397170:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261187968 00002000:00100000:2.0:1746065127.397199:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3932160->3936255) req@ffff88012f3d1880 x1830881261187968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.397207:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1880 with x1830881261187968 ext(3932160->3936255) 00002000:00010000:2.0:1746065127.397211:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d1880 00000100:00100000:2.0:1746065127.397240:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5128 00000100:00100000:2.0:1746065127.397246:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881261187968:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065127.397398:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881261187968:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 152us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065127.397404:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5128 00002000:00100000:2.0:1746065127.397410:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3932160->3936255) req@ffff88012f3d1880 x1830881261187968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.397416:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d1880 with x1830881261187968 ext(3932160->3936255) 00002000:00010000:2.0:1746065127.397418:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d1880 00000100:00100000:0.0:1746065127.402988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.403114:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261188224 00000100:00100000:2.0:1746065127.403121:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261188224 00002000:00100000:2.0:1746065127.403154:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4091904->4095999) req@ffff88012f3d2680 x1830881261188224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.403163:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d2680 with x1830881261188224 ext(4091904->4095999) 00002000:00010000:2.0:1746065127.403167:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d2680 00000100:00100000:2.0:1746065127.403193:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5129 00000100:00100000:2.0:1746065127.403199:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1958:x1830881261188224:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065127.403353:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1958:x1830881261188224:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 154us (371us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065127.403359:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5129 00002000:00100000:2.0:1746065127.403363:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4091904->4095999) req@ffff88012f3d2680 x1830881261188224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.403370:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d2680 with x1830881261188224 ext(4091904->4095999) 00002000:00010000:2.0:1746065127.403373:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d2680 00000100:00100000:0.0:1746065127.406657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.406741:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261188480 00000100:00100000:2.0:1746065127.406749:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261188480 00000100:00100000:2.0:1746065127.406785:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3739 00000100:00100000:2.0:1746065127.406791:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009badc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:29165:x1830881261188480:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065127.406997:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009badc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:29165:x1830881261188480:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 205us (347us total) trans 8589943189 rc 0/0 00000100:00100000:2.0:1746065127.407003:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3739 00000100:00100000:0.0:1746065127.432341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.432439:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261188736 00000100:00100000:2.0:1746065127.432447:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261188736 00000100:00100000:2.0:1746065127.432511:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3740 00000100:00100000:2.0:1746065127.432518:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:29115:x1830881261188736:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065127.432685:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29115:x1830881261188736:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 167us (352us total) trans 8589943190 rc 0/0 00000100:00100000:2.0:1746065127.432691:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3740 00000100:00080000:0.0:1746065127.432743:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065127.434365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.435870:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261188992 00000100:00100000:2.0:1746065127.435878:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261188992 00000100:00100000:2.0:1746065127.435922:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3741 00000100:00100000:2.0:1746065127.435929:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29115:x1830881261188992:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065127.436215:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29115:x1830881261188992:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 166us (1733us total) trans 8589943191 rc 0/0 00000100:00100000:2.0:1746065127.436220:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3741 00000100:00100000:0.0:1746065127.446916:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.447036:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261189248 00000100:00100000:3.0:1746065127.447044:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261189248 00000100:00100000:3.0:1746065127.447093:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9116 00000100:00100000:3.0:1746065127.447102:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:29168:x1830881261189248:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065127.447121:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.447136:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091103400/0x14b4f8542d4f4123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b91d expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.447223:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447233:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447241:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447251:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447256:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447261:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447377:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091102e00/0x14b4f8542d4f4138 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447384:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091102e00/0x14b4f8542d4f4138 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447390:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091102e00/0x14b4f8542d4f4138 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065127.447399:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065127.447464:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447469:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447474:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447479:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091103200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.447482:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447487:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447494:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065127.447497:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065127.447500:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447504:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091103200/0x14b4f8542d4f412a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447695:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447701:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447705:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447712:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091103000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.447715:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447719:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447726:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f700) 00010000:00010000:3.0:1746065127.447728:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065127.447730:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447734:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091103000/0x14b4f8542d4f4131 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.447768:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091103400/0x14b4f8542d4f4123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b91d expref: 25 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.447780:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091102e00/0x14b4f8542d4f4138 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b91d expref: 24 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.447785:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.447787:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065127.447789:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091102e00, rc 0) 00000100:00100000:3.0:1746065127.447864:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:29168:x1830881261189248:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 762us (955us total) trans 8589943192 rc 0/0 00000100:00100000:3.0:1746065127.447870:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9116 00000100:00100000:0.0:1746065127.449847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.450021:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261189376 00000100:00100000:3.0:1746065127.450028:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261189376 00000100:00100000:0.0:1746065127.450453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.450492:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 627 00000100:00100000:3.0:1746065127.450499:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881261189376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065127.450512:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.450545:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091102e00/0x14b4f8542d4f4138 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b91d expref: 24 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.450571:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.450575:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065127.450606:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881261189376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 108us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.450611:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 627 00000100:00100000:2.0:1746065127.450669:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261189504 00000100:00100000:2.0:1746065127.450673:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261189504 00000100:00100000:2.0:1746065127.450703:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11146 00000100:00100000:2.0:1746065127.450708:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261189504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.450720:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.450731:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f2c00/0x14b4f8542d4f4146 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b924 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.450766:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259789312:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065127.450837:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065127.452502:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259789312:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065127.452525:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f2c00/0x14b4f8542d4f4146 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b924 expref: 22 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.452535:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f2c00/0x14b4f8542d4f4146 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b924 expref: 22 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.453050:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f2c00, rc 0) 00000100:00100000:2.0:1746065127.453090:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261189504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2380us (2636us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065127.453096:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11146 00000100:00100000:0.0:1746065127.459265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.459325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.459403:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261189888 00000100:00100000:3.0:1746065127.459411:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261189888 00002000:00100000:3.0:1746065127.459446:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1896448->2097151) req@ffff88012f3d3480 x1830881261189888/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.459454:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3480 with x1830881261189888 ext(1896448->2097151) 00002000:00010000:3.0:1746065127.459458:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d3480 00000100:00100000:3.0:1746065127.459474:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261190016 00000100:00100000:3.0:1746065127.459476:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261190016 00002000:00100000:3.0:1746065127.459487:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (0->1003519) req@ffff88012f3d3100 x1830881261190016/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.459493:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3100 with x1830881261190016 ext(0->1003519) 00002000:00010000:3.0:1746065127.459495:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d3100 00000100:00100000:3.0:1746065127.459508:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5130 00000100:00100000:3.0:1746065127.459520:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881261189888:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065127.459907:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5131 00000100:00100000:3.0:1746065127.459913:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881261190016:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065127.462811:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+19:1959:x1830881261189888:12345-192.168.202.46@tcp:3:cat.0 Request processed in 3289us (3546us total) trans 0 rc 200704/200704 00000100:00100000:2.0:1746065127.462836:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5130 00002000:00100000:2.0:1746065127.462845:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1896448->2097151) req@ffff88012f3d3480 x1830881261189888/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 200704/200704 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.462853:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3480 with x1830881261189888 ext(1896448->2097151) 00002000:00010000:2.0:1746065127.462858:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3d3480 00000100:00100000:3.0:1746065127.468360:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1959:x1830881261190016:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8439us (9027us total) trans 0 rc 1003520/1003520 00000100:00100000:3.0:1746065127.468372:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5131 00002000:00100000:3.0:1746065127.468381:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1003519) req@ffff88012f3d3100 x1830881261190016/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1003520/1003520 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.468390:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3d3100 with x1830881261190016 ext(0->1003519) 00002000:00010000:3.0:1746065127.468395:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3d3100 00000100:00100000:0.0:1746065127.478944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.479048:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261190144 00000100:00100000:2.0:1746065127.479056:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261190144 00000100:00100000:2.0:1746065127.479090:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11147 00000100:00100000:2.0:1746065127.479097:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:29172:x1830881261190144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.479112:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.479125:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b92b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.479151:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 41 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.479158:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.479159:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.479163:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.479186:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 41 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.479196:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 41 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.479207:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259789440:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.479305:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.480773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.480858:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259789440:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.480877:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.480892:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946f3e00, rc 0) 00000100:00100000:2.0:1746065127.480918:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:29172:x1830881261190144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1822us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.480924:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11147 00000100:00100000:3.0:1746065127.480992:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261190272 00000100:00100000:3.0:1746065127.480997:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261190272 00002000:00100000:3.0:1746065127.481022:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3932160->4095999) req@ffff880130269f80 x1830881261190272/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.481029:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130269f80 with x1830881261190272 ext(3932160->4095999) 00010000:00010000:3.0:1746065127.481035:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 42 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.481044:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 42 pid: 8429 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746065127.481049:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130269f80 00000100:00100000:3.0:1746065127.481069:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1560 00000100:00100000:3.0:1746065127.481074:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881261190272:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065127.484976:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881261190272:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 3894us (4200us total) trans 17179872903 rc 0/0 00000100:00100000:3.0:1746065127.484988:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1560 00002000:00100000:3.0:1746065127.484996:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3932160->4095999) req@ffff880130269f80 x1830881261190272/t17179872903(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.485004:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130269f80 with x1830881261190272 ext(3932160->4095999) 00010000:00010000:3.0:1746065127.485011:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 44 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.485023:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 44 pid: 8429 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746065127.485028:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130269f80 00000100:00100000:0.0:1746065127.487813:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.487929:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261190400 00000100:00100000:3.0:1746065127.487935:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261190400 00010000:00010000:3.0:1746065127.487963:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 44 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065127.487997:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5563 00000100:00100000:3.0:1746065127.488004:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881261190400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065127.488014:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.488031:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 44 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.488041:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 44 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.488063:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091103800/0x14b4f8542d4f411c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3932160->4095999) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b916 expref: 44 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.488102:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.488104:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.488110:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.488117:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.488144:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.488154:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259789568:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065127.489103:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.493016:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259789568:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065127.493051:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065127.493088:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881261190400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5083us (5279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.493097:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5563 00000100:00100000:0.0:1746065127.496248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.496671:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261190784 00000100:00100000:3.0:1746065127.496678:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261190784 00002000:00100000:3.0:1746065127.498259:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88013026b480 x1830881261190784/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.498274:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026b480 with x1830881261190784 ext(3145728->4194303) 00002000:00010000:3.0:1746065127.498279:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013026b480 00000100:00100000:3.0:1746065127.498321:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5132 00000100:00100000:3.0:1746065127.498328:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261190784:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065127.502555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.504530:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261190656 00000100:00100000:2.0:1746065127.504541:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261190656 00002000:00100000:2.0:1746065127.504587:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880130268a80 x1830881261190656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.504596:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130268a80 with x1830881261190656 ext(2097152->3145727) 00002000:00010000:2.0:1746065127.504601:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130268a80 00000100:00100000:2.0:1746065127.504627:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5133 00000100:00100000:2.0:1746065127.504634:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261190656:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065127.509327:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261190784:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10991us (13078us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.509337:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5132 00002000:00100000:3.0:1746065127.509347:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88013026b480 x1830881261190784/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.509354:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013026b480 with x1830881261190784 ext(3145728->4194303) 00002000:00010000:3.0:1746065127.509359:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013026b480 00000100:00100000:2.0:1746065127.517624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.517665:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261191168 00000100:00100000:2.0:1746065127.517672:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261191168 00000100:00100000:2.0:1746065127.517723:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9117 00000100:00100000:2.0:1746065127.517731:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:29175:x1830881261191168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.517752:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.517766:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f4154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b932 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.517869:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.517879:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.517888:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.517899:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.517904:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.517908:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.517994:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082400/0x14b4f8542d4f4169 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518001:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082400/0x14b4f8542d4f4169 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518007:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082400/0x14b4f8542d4f4169 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065127.518014:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065127.518085:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518090:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518095:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518099:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065127.518102:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518108:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518116:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065127.518118:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065127.518121:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518125:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f415b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518137:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518141:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518145:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518148:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133083c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065127.518150:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518154:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518158:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205300) 00010000:00010000:2.0:1746065127.518160:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065127.518161:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518165:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4162 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.518191:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f4154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b932 expref: 265 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.518200:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082400/0x14b4f8542d4f4169 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b932 expref: 264 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.518204:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.518206:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065127.518208:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133082400, rc 0) 00000100:00100000:2.0:1746065127.518240:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:29175:x1830881261191168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 511us (624us total) trans 8589943193 rc 0/0 00000100:00100000:2.0:1746065127.518245:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9117 00000100:00100000:3.0:1746065127.518973:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1960:x1830881261190656:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14337us (16424us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.518981:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5133 00002000:00100000:3.0:1746065127.518988:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880130268a80 x1830881261190656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.518996:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130268a80 with x1830881261190656 ext(2097152->3145727) 00002000:00010000:3.0:1746065127.519000:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130268a80 00000100:00100000:0.0:1746065127.527973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.528736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.528766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.528795:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.528845:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261191296 00000100:00100000:0.0:1746065127.528847:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.528852:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261191296 00000100:00100000:1.0:1746065127.528888:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261191552 00000100:00100000:1.0:1746065127.528890:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261191552 00000100:00100000:1.0:1746065127.528902:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261191680 00000100:00100000:1.0:1746065127.528904:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261191680 00000100:00100000:1.0:1746065127.528916:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11148 00000100:00100000:1.0:1746065127.528922:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881261191296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.528937:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.528952:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f145a00/0x14b4f8542d4f4177 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b939 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065127.528998:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259789696:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065127.529058:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065127.529075:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11149 00000100:00100000:1.0:1746065127.529080:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261191552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.529087:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.529095:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f417e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b940 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065127.529116:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259789824:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065127.529146:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065127.529159:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11150 00000100:00100000:1.0:1746065127.529164:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881261191680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.529172:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.529179:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b947 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.529189:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.529191:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.529197:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b947 expref: 46 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.529209:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b947 expref: 46 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.529218:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f144c00, rc 0) 00000100:00100000:1.0:1746065127.529237:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881261191680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 72us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.529242:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11150 00000100:00100000:3.0:1746065127.529467:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261191424 00000100:00100000:3.0:1746065127.529471:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261191424 00000100:00100000:3.0:1746065127.529494:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 628 00000100:00100000:3.0:1746065127.529500:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013026a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1960:x1830881261191424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065127.529511:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.529526:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082400/0x14b4f8542d4f4169 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b932 expref: 264 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.529536:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261191936 00000100:00100000:2.0:1746065127.529541:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261191936 00010000:00010000:3.0:1746065127.529547:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.529551:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065127.529571:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:1960:x1830881261191424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.529576:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 628 00002000:00100000:2.0:1746065127.529653:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880130269500 x1830881261191936/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.529661:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130269500 with x1830881261191936 ext(4194304->5029887) 00002000:00010000:2.0:1746065127.529665:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130269500 00000100:00100000:2.0:1746065127.529676:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5134 00000100:00100000:2.0:1746065127.529681:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881261191936:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:2.0:1746065127.531097:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime: 1746065126 -> 1746065128 00002000:00010000:1.0:1746065127.531097:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065127 -> 1746065128 00002000:00010000:2.0:1746065127.531101:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime: 1746065126 -> 1746065128 00002000:00010000:1.0:1746065127.531101:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime: 1746065124 -> 1746065128 00002000:00010000:2.0:1746065127.531102:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime: 1746065126 -> 1746065128 00002000:00010000:1.0:1746065127.531103:0:8428:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065127 -> 1746065128 00000100:00100000:2.0:1746065127.531115:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259789696:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065127.531115:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259789824:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065127.531134:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f417e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b940 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.531135:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f145a00/0x14b4f8542d4f4177 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b939 expref: 45 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.531143:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f145400/0x14b4f8542d4f417e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b940 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.531144:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f145a00/0x14b4f8542d4f4177 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b939 expref: 45 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.531157:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f145a00, rc 0) 00010000:00010000:1.0:1746065127.531163:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f145400, rc 0) 00000100:00100000:2.0:1746065127.531177:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881261191296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2255us (3213us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065127.531180:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013026aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261191552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2100us (2412us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065127.531183:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11148 00000100:00100000:1.0:1746065127.531186:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11149 00000100:00100000:0.0:1746065127.533520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.533844:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261192064 00000100:00100000:1.0:1746065127.533850:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261192064 00000100:00100000:1.0:1746065127.533889:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11151 00000100:00100000:1.0:1746065127.533895:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:29175:x1830881261192064:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.533909:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.533925:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b94e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.533947:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.533952:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065127.533953:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065127.533956:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 45 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.533975:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.533982:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 23 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746065127.533990:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259789952:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.534050:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.536658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.536734:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259789952:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065127.536758:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 45 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.536772:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b26a400, rc 0) 00000100:00100000:1.0:1746065127.536837:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:29175:x1830881261192064:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2918us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.536845:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11151 00000100:00100000:3.0:1746065127.537640:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261192192 00000100:00100000:3.0:1746065127.537648:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261192192 00002000:00100000:3.0:1746065127.537680:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (1003520->1048575) req@ffff88009a4e9f80 x1830881261192192/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.537688:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9f80 with x1830881261192192 ext(1003520->1048575) 00010000:00010000:3.0:1746065127.537694:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.537704:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746065127.537710:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a4e9f80 00000100:00100000:3.0:1746065127.537724:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1561 00000100:00100000:3.0:1746065127.537730:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261192192:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065127.538345:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881261191936:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8658us (9492us total) trans 0 rc 835584/835584 00000100:00100000:2.0:1746065127.538354:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5134 00002000:00100000:2.0:1746065127.538362:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880130269500 x1830881261191936/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.538369:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130269500 with x1830881261191936 ext(4194304->5029887) 00002000:00010000:2.0:1746065127.538373:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130269500 00000100:00100000:3.0:1746065127.539868:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261192192:12345-192.168.202.46@tcp:4:cat.0 Request processed in 2134us (3212us total) trans 17179872904 rc 0/0 00000100:00100000:3.0:1746065127.539881:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1561 00002000:00100000:3.0:1746065127.539887:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (1003520->1048575) req@ffff88009a4e9f80 x1830881261192192/t17179872904(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.539895:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9f80 with x1830881261192192 ext(1003520->1048575) 00010000:00010000:3.0:1746065127.539902:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.539914:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746065127.539920:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a4e9f80 00000100:00100000:0.0:1746065127.545939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.546767:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261192320 00000100:00100000:1.0:1746065127.546775:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261192320 00010000:00010000:1.0:1746065127.546807:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746065127.546862:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5564 00000100:00100000:1.0:1746065127.546868:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261192320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065127.546879:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065127.546896:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065127.546906:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746065127.546924:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f76a200/0x14b4f8542d4f40e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8fa expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065127.547290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.547421:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261192448 00000100:00100000:3.0:1746065127.547427:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261192448 00000100:00100000:3.0:1746065127.547458:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11152 00000100:00100000:3.0:1746065127.547464:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881261192448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.547480:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.547491:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b955 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.547507:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.547516:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b955 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.547529:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b955 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.547543:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.547544:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.547548:0:8428:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 44 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.547554:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 44 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.547583:0:8428:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 44 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.547596:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259790080:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065127.547665:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ca80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065127.548068:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065127.548101:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261192320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1230us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.548108:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5564 00000100:00100000:3.0:1746065127.549692:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259790080:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065127.549718:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091102e00, rc 0) 00000100:00100000:3.0:1746065127.549745:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881261192448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2281us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.549751:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11152 00000100:00100000:0.0:1746065127.554772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.554906:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261192704 00000100:00100000:3.0:1746065127.554915:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261192704 00002000:00100000:3.0:1746065127.554955:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009a4eb480 x1830881261192704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.554964:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eb480 with x1830881261192704 ext(0->1048575) 00002000:00010000:3.0:1746065127.554970:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4eb480 00000100:00100000:3.0:1746065127.555010:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5135 00000100:00100000:3.0:1746065127.555020:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881261192704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065127.568428:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881261192704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13400us (13656us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.568439:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5135 00002000:00100000:3.0:1746065127.568449:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009a4eb480 x1830881261192704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.568457:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eb480 with x1830881261192704 ext(0->1048575) 00002000:00010000:3.0:1746065127.568462:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4eb480 00000100:00100000:0.0:1746065127.571956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.572002:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261192832 00000100:00100000:3.0:1746065127.572010:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261192832 00000100:00100000:3.0:1746065127.572045:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11153 00000100:00100000:3.0:1746065127.572052:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:29168:x1830881261192832:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065127.572066:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.572081:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b95c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.572105:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b955 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.572113:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 44 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.572118:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.572120:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.572122:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [16384->921599] (req 16384->921599) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.572149:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 44 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.572159:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 44 pid: 8428 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065127.572168:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259790208:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.572242:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b955 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.572249:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b955 expref: 25 pid: 8428 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065127.572255:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259790336:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.572271:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.574715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.575327:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259790208:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.575337:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259790336:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.575378:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [16384->921599] (req 16384->921599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.575394:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091103400, rc 0) 00000100:00100000:3.0:1746065127.575434:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+25:29168:x1830881261192832:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3381us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.575445:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11153 00000100:00100000:0.0:1746065127.575781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.575905:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261193088 00000100:00100000:3.0:1746065127.575910:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261193088 00000100:00100000:3.0:1746065127.575952:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11154 00000100:00100000:3.0:1746065127.575958:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:29175:x1830881261193088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.575972:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.575985:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b963 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.576007:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.576013:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065127.576014:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065127.576017:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.576037:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.576046:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 18 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065127.576055:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259790464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.576238:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261192960 00000100:00100000:1.0:1746065127.576242:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261192960 00010000:00010000:1.0:1746065127.576258:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b955 expref: 25 pid: 8428 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065127.576276:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5565 00000100:00100000:1.0:1746065127.576281:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261192960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065127.576288:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065127.576315:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b955 expref: 25 pid: 8428 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.576324:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b955 expref: 25 pid: 8428 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.576337:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091102e00/0x14b4f8542d4f4193 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b955 expref: 25 pid: 8428 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746065127.576354:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065127.576368:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881261192960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.576373:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5565 00000100:00100000:3.0:1746065127.576891:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.577794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.578070:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261193216 00000100:00100000:2.0:1746065127.578076:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261193216 00010000:00010000:2.0:1746065127.578099:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 45 pid: 8428 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.578134:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5566 00000100:00100000:2.0:1746065127.578140:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881261193216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.578149:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.578165:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 45 pid: 8428 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.578178:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 45 pid: 8428 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.578193:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b26a400/0x14b4f8542d4f418c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b94e expref: 45 pid: 8428 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.578216:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.578218:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.578223:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.578230:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.578252:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.578260:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259790592:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.578320:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.578430:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259790464:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.578456:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.578464:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091103c00, rc 0) 00000100:00100000:3.0:1746065127.578483:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:29175:x1830881261193088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2526us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.578489:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11154 00000100:00100000:0.0:1746065127.579201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.579518:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261193344 00000100:00100000:3.0:1746065127.579524:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261193344 00002000:00100000:3.0:1746065127.579550:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1896447) req@ffff880133298000 x1830881261193344/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.579558:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133298000 with x1830881261193344 ext(1048576->1896447) 00010000:00010000:3.0:1746065127.579564:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 19 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.579574:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 19 pid: 8429 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746065127.579579:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880133298000 00000100:00100000:3.0:1746065127.579603:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1562 00000100:00100000:3.0:1746065127.579608:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261193344:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065127.580201:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259790592:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065127.580215:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.580241:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881261193216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2100us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.580247:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5566 00000100:00100000:0.0:1746065127.580729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.580934:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261193600 00000100:00100000:2.0:1746065127.580939:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261193600 00002000:00100000:2.0:1746065127.580957:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (16384->20479) req@ffff880133299180 x1830881261193600/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.580964:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133299180 with x1830881261193600 ext(16384->20479) 00002000:00010000:2.0:1746065127.580968:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133299180 00000100:00100000:2.0:1746065127.580989:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5136 00000100:00100000:2.0:1746065127.580994:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261193600:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065127.581543:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261193600:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 547us (812us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065127.581549:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5136 00002000:00100000:2.0:1746065127.581554:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (16384->20479) req@ffff880133299180 x1830881261193600/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.581561:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133299180 with x1830881261193600 ext(16384->20479) 00002000:00010000:2.0:1746065127.581564:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133299180 00000100:00100000:0.0:1746065127.588856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.588931:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261193856 00000100:00100000:2.0:1746065127.588938:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261193856 00002000:00100000:2.0:1746065127.588975:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (917504->921599) req@ffff880133298700 x1830881261193856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.588984:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133298700 with x1830881261193856 ext(917504->921599) 00002000:00010000:2.0:1746065127.588989:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133298700 00000100:00100000:2.0:1746065127.589007:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5137 00000100:00100000:2.0:1746065127.589013:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261193856:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065127.589140:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261193856:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 127us (291us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065127.589149:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5137 00002000:00100000:2.0:1746065127.589153:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (917504->921599) req@ffff880133298700 x1830881261193856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.589159:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133298700 with x1830881261193856 ext(917504->921599) 00002000:00010000:2.0:1746065127.589161:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133298700 00000100:00100000:3.0:1746065127.591885:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261193344:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 12269us (12678us total) trans 21474840122 rc 0/0 00000100:00100000:3.0:1746065127.591894:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1562 00002000:00100000:3.0:1746065127.591902:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->1896447) req@ffff880133298000 x1830881261193344/t21474840122(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.591909:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133298000 with x1830881261193344 ext(1048576->1896447) 00010000:00010000:3.0:1746065127.591917:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.591930:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746065127.591935:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880133298000 00000100:00100000:0.0:1746065127.593446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.593531:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261194112 00000100:00100000:2.0:1746065127.593539:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261194112 00000100:00100000:2.0:1746065127.593582:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3742 00000100:00100000:2.0:1746065127.593589:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+23:29168:x1830881261194112:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065127.594344:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+24:29168:x1830881261194112:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 752us (901us total) trans 8589943194 rc 0/0 00000100:00100000:2.0:1746065127.594350:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3742 00000100:00100000:0.0:1746065127.595272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.595357:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261194240 00000100:00100000:2.0:1746065127.595362:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261194240 00010000:00010000:2.0:1746065127.595410:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.595439:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5567 00000100:00100000:2.0:1746065127.595446:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013329aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261194240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.595457:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.595473:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.595483:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.595501:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946f3000/0x14b4f8542d4f40f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1896447) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b908 expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.595512:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.595513:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.595519:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.595526:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.595549:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.595559:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259790720:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.595626:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065127.597133:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259790720:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065127.597147:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.597181:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013329aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261194240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1735us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.597188:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5567 00000100:00100000:0.0:1746065127.600794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.600849:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.600888:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261194624 00000100:00100000:1.0:1746065127.600895:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261194624 00000100:00100000:3.0:1746065127.600896:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261194752 00000100:00100000:3.0:1746065127.600899:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261194752 00002000:00100000:3.0:1746065127.600927:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f9b9c00 x1830881261194752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.600927:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009a0c9050 x1830881261194624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.600936:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9c00 with x1830881261194752 ext(1048576->2097151) 00002000:00010000:3.0:1746065127.600940:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9b9c00 00002000:00100000:1.0:1746065127.600940:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0c9050 with x1830881261194624 ext(1048576->2097151) 00002000:00010000:1.0:1746065127.600943:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0c9050 00000100:00100000:3.0:1746065127.600965:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5138 00000100:00100000:1.0:1746065127.600968:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5139 00000100:00100000:3.0:1746065127.600971:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261194752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065127.600972:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881261194624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065127.609051:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881261194624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8068us (8253us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065127.609060:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5139 00002000:00100000:1.0:1746065127.609070:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009a0c9050 x1830881261194624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.609078:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0c9050 with x1830881261194624 ext(1048576->2097151) 00002000:00010000:1.0:1746065127.609082:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0c9050 00000100:00100000:3.0:1746065127.613485:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261194752:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12506us (12627us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.613494:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5138 00002000:00100000:3.0:1746065127.613503:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f9b9c00 x1830881261194752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.613511:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9c00 with x1830881261194752 ext(1048576->2097151) 00002000:00010000:3.0:1746065127.613516:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9b9c00 00000100:00100000:0.0:1746065127.625922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.626287:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.626915:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195008 00000100:00100000:3.0:1746065127.626923:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195008 00002000:00100000:3.0:1746065127.626956:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f9b9880 x1830881261195008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.626964:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9880 with x1830881261195008 ext(2097152->3145727) 00002000:00010000:3.0:1746065127.626969:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b9880 00000100:00100000:1.0:1746065127.627470:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195136 00000100:00100000:3.0:1746065127.627475:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5140 00000100:00100000:1.0:1746065127.627475:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195136 00000100:00100000:3.0:1746065127.627483:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881261195008:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:1.0:1746065127.627489:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009f9bb800 x1830881261195136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.627495:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb800 with x1830881261195136 ext(3145728->4194303) 00002000:00010000:1.0:1746065127.627497:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb800 00000100:00100000:0.0:1746065127.627615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.627634:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195520 00000100:00100000:0.0:1746065127.627637:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195520 00000100:00100000:1.0:1746065127.627895:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5141 00000100:00100000:1.0:1746065127.627902:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881261195136:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065127.628938:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9118 00000100:00100000:0.0:1746065127.628946:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:29179:x1830881261195520:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065127.628961:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.628975:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f41a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b96a expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.629047:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065127.629059:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7cd expref: 23 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.629066:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b805 expref: 264 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.629072:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065127.629096:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b805 expref: 264 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.629106:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b805 expref: 264 pid: 24350 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065127.629116:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259790848:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065127.629173:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7cd expref: 23 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.629179:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7cd expref: 23 pid: 16767 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065127.629190:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259790976:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065127.629203:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.632502:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.632618:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195648 00000100:00100000:2.0:1746065127.632625:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195648 00010000:00010000:2.0:1746065127.632653:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b805 expref: 265 pid: 24350 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.632681:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5568 00000100:00100000:2.0:1746065127.632686:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:1960:x1830881261195648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.632697:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.632703:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b805 expref: 265 pid: 24350 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.632711:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b805 expref: 265 pid: 24350 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.632728:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.632732:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.632740:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.632745:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.632775:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:1960:x1830881261195648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.632781:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5568 00010000:00010000:1.0:1746065127.632952:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f3ef3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b805 expref: 264 pid: 24350 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746065127.632979:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259790848:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065127.634558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.634578:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195776 00000100:00100000:0.0:1746065127.634583:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195776 00010000:00010000:0.0:1746065127.634606:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7cd expref: 24 pid: 16767 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065127.635098:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5569 00000100:00100000:0.0:1746065127.635105:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261195776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.635234:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.635240:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7cd expref: 24 pid: 16767 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.635251:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7cd expref: 24 pid: 16767 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746065127.635262:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259790976:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065127.635266:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009118f400/0x14b4f8542d4f3e98 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7cd expref: 24 pid: 16767 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065127.635279:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065127.635283:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065127.635463:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065127.635473:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.635485:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065127.636767:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881261195008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9278us (10845us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.636776:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5140 00002000:00100000:3.0:1746065127.636785:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009f9b9880 x1830881261195008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.636793:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9880 with x1830881261195008 ext(2097152->3145727) 00002000:00010000:3.0:1746065127.636797:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b9880 00010000:00010000:0.0:1746065127.637699:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.637731:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261195776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2625us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.637739:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5569 00010000:00010000:2.0:1746065127.637895:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.637902:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065127.637918:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065127.640040:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f41a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b96a expref: 265 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.640064:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b96a expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.640071:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.640073:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065127.640076:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094614e00, rc 0) 00000100:00100000:2.0:1746065127.640118:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:29179:x1830881261195520:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11171us (12501us total) trans 8589943195 rc 0/0 00000100:00100000:2.0:1746065127.640125:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9118 00000100:00100000:1.0:1746065127.640211:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881261195136:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12309us (13923us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065127.640219:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5141 00002000:00100000:1.0:1746065127.640227:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009f9bb800 x1830881261195136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.640235:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb800 with x1830881261195136 ext(3145728->4194303) 00002000:00010000:1.0:1746065127.640239:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb800 00000100:00100000:2.0:1746065127.645643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.646576:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195904 00000100:00100000:3.0:1746065127.646585:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195904 00000100:00100000:3.0:1746065127.646630:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11155 00000100:00100000:3.0:1746065127.646638:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1959:x1830881261195904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.646653:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.646669:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0041c00/0x14b4f8542d4f41bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b971 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.646714:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259791104:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065127.647176:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.648357:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259791104:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065127.648381:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0041c00/0x14b4f8542d4f41bd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b971 expref: 45 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.648392:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0041c00/0x14b4f8542d4f41bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b971 expref: 45 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.648422:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0041c00, rc 0) 00000100:00100000:3.0:1746065127.648458:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1959:x1830881261195904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1819us (2823us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065127.648465:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11155 00000100:00100000:0.0:1746065127.652689:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.652752:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261196160 00000100:00100000:1.0:1746065127.652760:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261196160 00002000:00100000:1.0:1746065127.652795:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f9b9500 x1830881261196160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.652804:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9500 with x1830881261196160 ext(4194304->5029887) 00002000:00010000:1.0:1746065127.652808:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b9500 00000100:00100000:1.0:1746065127.652854:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5142 00000100:00100000:1.0:1746065127.652861:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1959:x1830881261196160:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065127.659209:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1959:x1830881261196160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6340us (6520us total) trans 0 rc 835584/835584 00000100:00100000:1.0:1746065127.659219:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5142 00002000:00100000:1.0:1746065127.659229:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff88009f9b9500 x1830881261196160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.659244:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9b9500 with x1830881261196160 ext(4194304->5029887) 00002000:00010000:1.0:1746065127.659249:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9b9500 00000100:00100000:0.0:1746065127.662376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.662420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.662620:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261196288 00000100:00100000:1.0:1746065127.662628:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261196288 00000100:00100000:1.0:1746065127.662660:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261196416 00000100:00100000:1.0:1746065127.662661:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261196416 00000100:00100000:1.0:1746065127.662983:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11156 00000100:00100000:3.0:1746065127.662988:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11157 00000100:00100000:1.0:1746065127.662990:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:29179:x1830881261196288:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:3.0:1746065127.662994:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1958:x1830881261196416:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.663008:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.663014:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.663023:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0041a00/0x14b4f8542d4f41c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b97f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.663023:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b978 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.663044:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.663051:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b947 expref: 47 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.663056:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.663058:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.663061:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 47 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.663063:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259791232:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065127.663076:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b947 expref: 47 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.663085:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b947 expref: 47 pid: 25185 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746065127.663093:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133088000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259791360:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.663118:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ca80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065127.663131:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.663138:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 23 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746065127.663144:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133088380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259791488:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.663158:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.664285:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259791232:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065127.664321:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0041a00/0x14b4f8542d4f41c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b97f expref: 47 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.664331:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0041a00/0x14b4f8542d4f41c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b97f expref: 47 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.664359:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0041a00, rc 0) 00000100:00100000:1.0:1746065127.664439:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133088000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259791360:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.664446:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133088380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259791488:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065127.664459:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 46 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.664467:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f3000, rc 0) 00000100:00100000:3.0:1746065127.665043:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1958:x1830881261196416:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2047us (2620us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065127.665050:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11157 00000100:00100000:1.0:1746065127.665115:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:29179:x1830881261196288:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2124us (2746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.665120:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11156 00000100:00100000:0.0:1746065127.668214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.668309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.668544:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261196544 00000100:00100000:2.0:1746065127.668551:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261196544 00010000:00010000:2.0:1746065127.668580:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.668622:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5570 00000100:00100000:2.0:1746065127.668629:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881261196544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.668640:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.668658:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.668668:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.668687:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946f3e00/0x14b4f8542d4f414d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b92b expref: 24 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.668704:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.668742:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881261196544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 113us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.668747:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5570 00000100:00100000:1.0:1746065127.668930:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261196672 00000100:00100000:1.0:1746065127.668934:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261196672 00000100:00100000:1.0:1746065127.668957:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11158 00000100:00100000:1.0:1746065127.668962:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:29175:x1830881261196672:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.668974:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.668984:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b986 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065127.668993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065127.668999:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.669000:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.669006:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5025792->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b986 expref: 46 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.669017:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5025792->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b986 expref: 46 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.669024:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2e00, rc 0) 00000100:00100000:1.0:1746065127.669041:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:29175:x1830881261196672:12345-192.168.202.46@tcp:101:cat.0 Request processed in 79us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.669052:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11158 00000100:00100000:3.0:1746065127.669111:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261196800 00000100:00100000:3.0:1746065127.669115:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261196800 00010000:00010000:3.0:1746065127.669127:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b947 expref: 46 pid: 25185 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746065127.669156:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5571 00000100:00100000:3.0:1746065127.669161:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881261196800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065127.669167:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.669175:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b947 expref: 46 pid: 25185 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065127.669183:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b947 expref: 46 pid: 25185 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065127.669194:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f144c00/0x14b4f8542d4f4185 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b947 expref: 46 pid: 25185 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746065127.669201:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.669203:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.669207:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.669218:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.669239:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.669249:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259791616:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065127.669316:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.670754:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259791616:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065127.670768:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065127.670800:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881261196800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1639us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.670806:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5571 00000100:00100000:0.0:1746065127.671688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.671719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.671794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.671908:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261197184 00000100:00100000:2.0:1746065127.671911:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261197312 00000100:00100000:2.0:1746065127.671915:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261197312 00000100:00100000:1.0:1746065127.671915:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261197184 00000100:00100000:2.0:1746065127.671939:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11159 00000100:00100000:2.0:1746065127.671944:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881261197312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.671956:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065127.671959:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11160 00000100:00100000:1.0:1746065127.671965:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881261197184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.671968:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f41d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b994 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.671972:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.671979:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f41e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b98d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.671992:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f41d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b994 expref: 48 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.672000:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f41d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b994 expref: 48 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.672008:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083000, rc 0) 00000100:00100000:1.0:1746065127.672011:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133088380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259791744:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065127.672031:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1961:x1830881261197312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 86us (236us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065127.672036:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11159 00000100:00100000:1.0:1746065127.672053:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065127.672066:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261197056 00000100:00100000:1.0:1746065127.672069:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261197056 00002000:00100000:1.0:1746065127.672089:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3997696->4001791) req@ffff88009f9bb480 x1830881261197056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.672098:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb480 with x1830881261197056 ext(3997696->4001791) 00002000:00010000:1.0:1746065127.672101:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb480 00000100:00100000:1.0:1746065127.672113:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5143 00000100:00100000:1.0:1746065127.672119:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261197056:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065127.672231:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261197056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 112us (545us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065127.672236:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5143 00002000:00100000:1.0:1746065127.672239:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3997696->4001791) req@ffff88009f9bb480 x1830881261197056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.672244:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb480 with x1830881261197056 ext(3997696->4001791) 00002000:00010000:1.0:1746065127.672246:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb480 00000100:00100000:0.0:1746065127.672801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.673158:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261197568 00000100:00100000:2.0:1746065127.673162:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261197568 00000100:00100000:2.0:1746065127.673189:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9119 00000100:00100000:2.0:1746065127.673194:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:29182:x1830881261197568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.673207:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.673219:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f41e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b99b expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.673311:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.673321:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.673330:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.673340:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.673346:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.673350:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065127.673730:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133088380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259791744:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065127.673747:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f41e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b98d expref: 46 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.673755:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f41e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b98d expref: 46 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.673841:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f3c00, rc 0) 00000100:00100000:0.0:1746065127.673871:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881261197184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1906us (2151us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065127.673879:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11160 00010000:00010000:2.0:1746065127.674235:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674420:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674427:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065127.674435:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065127.674502:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674511:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674516:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674520:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133083c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065127.674523:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674529:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674537:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065127.674539:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065127.674542:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674547:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f41ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674554:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674558:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674563:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674566:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065127.674568:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674575:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674579:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205300) 00010000:00010000:2.0:1746065127.674581:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065127.674583:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674587:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f41f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.674616:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f41e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b99b expref: 26 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.674625:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b99b expref: 25 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.674630:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.674631:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065127.674633:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083600, rc 0) 00000100:00100000:2.0:1746065127.674669:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+25:29182:x1830881261197568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1474us (1868us total) trans 8589943196 rc 0/0 00000100:00100000:2.0:1746065127.674675:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9119 00000100:00100000:0.0:1746065127.675400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.675516:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261197824 00000100:00100000:3.0:1746065127.675521:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261197824 00002000:00100000:3.0:1746065127.675545:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (5025792->5029887) req@ffff88009f9bb100 x1830881261197824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.675553:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb100 with x1830881261197824 ext(5025792->5029887) 00002000:00010000:3.0:1746065127.675557:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb100 00000100:00100000:3.0:1746065127.675610:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5144 00000100:00100000:3.0:1746065127.675616:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1958:x1830881261197824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065127.675721:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1958:x1830881261197824:12345-192.168.202.46@tcp:3:cat.0 Request processed in 104us (320us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065127.675729:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5144 00002000:00100000:3.0:1746065127.675734:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (5025792->5029887) req@ffff88009f9bb100 x1830881261197824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.675740:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9bb100 with x1830881261197824 ext(5025792->5029887) 00002000:00010000:3.0:1746065127.675743:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9bb100 00000100:00100000:0.0:1746065127.676106:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.677598:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198080 00000100:00100000:2.0:1746065127.677604:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198080 00000100:00100000:2.0:1746065127.677647:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3743 00000100:00100000:2.0:1746065127.677653:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:29182:x1830881261198080:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065127.677791:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+26:29182:x1830881261198080:12345-192.168.202.46@tcp:35:cat.0 Request processed in 137us (1685us total) trans 8589943197 rc 0/0 00000100:00100000:2.0:1746065127.677797:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3743 00000100:00100000:0.0:1746065127.678091:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.678455:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198208 00000100:00100000:2.0:1746065127.678459:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198208 00000100:00100000:2.0:1746065127.678675:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11161 00000100:00100000:2.0:1746065127.678681:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:29179:x1830881261198208:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065127.678690:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.678701:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9a2 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.678718:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.678725:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.678730:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.678731:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.678734:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->3309567] (req 3145728->3309567) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.678752:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.678761:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 19 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.678769:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259791872:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.678853:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.678859:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 29 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.678866:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259792000:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.678883:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.680307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.680334:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.680532:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198720 00000100:00100000:2.0:1746065127.680537:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198720 00000100:00100000:0.0:1746065127.680861:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.680936:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198336 00000100:00100000:1.0:1746065127.680940:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198336 00000100:00100000:1.0:1746065127.680958:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198464 00000100:00100000:1.0:1746065127.680960:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198464 00000100:00100000:1.0:1746065127.680974:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11162 00000100:00100000:1.0:1746065127.680979:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261198336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.680992:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.681003:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9a9 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.681018:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.681019:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.681026:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a9 expref: 21 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.681042:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a9 expref: 21 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.681051:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2800, rc 0) 00000100:00100000:1.0:1746065127.681079:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261198336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 99us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.681084:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11162 00000100:00100000:1.0:1746065127.681096:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11163 00000100:00100000:1.0:1746065127.681101:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261198464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.681107:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.681114:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f4218 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9b0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.681129:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f4218 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9b0 expref: 24 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.681136:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f4218 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9b0 expref: 24 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.681244:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2000, rc 0) 00000100:00100000:1.0:1746065127.681261:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261198464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 160us (401us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065127.681266:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11163 00000100:00100000:2.0:1746065127.681273:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3744 00000100:00100000:2.0:1746065127.681283:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:29175:x1830881261198720:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065127.681419:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:29175:x1830881261198720:12345-192.168.202.46@tcp:35:cat.0 Request processed in 139us (1128us total) trans 8589943198 rc 0/0 00000100:00100000:2.0:1746065127.681423:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3744 00000100:00100000:0.0:1746065127.684264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.684724:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259791872:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.684733:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259792000:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.684756:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198848 00010000:00010000:2.0:1746065127.684757:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->3309567] (req 3145728->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.684762:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198848 00010000:00010000:2.0:1746065127.684771:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083800, rc 0) 00010000:00010000:3.0:1746065127.684784:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746065127.684806:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5572 00000100:00100000:3.0:1746065127.684812:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261198848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065127.684826:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:29179:x1830881261198208:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6131us (6721us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065127.684848:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.684866:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.684876:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.684893:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094614c00/0x14b4f8542d4f4027 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ad expref: 21 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746065127.684911:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065127.684928:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261198848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 116us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.684936:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5572 00000100:00100000:2.0:1746065127.684979:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11161 00000100:00100000:0.0:1746065127.686599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.686662:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198976 00000100:00100000:2.0:1746065127.686666:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198976 00010000:00010000:2.0:1746065127.686684:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 29 pid: 8429 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746065127.686957:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5573 00000100:00100000:2.0:1746065127.686964:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261198976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.686971:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.686982:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 29 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.686991:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 29 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.687004:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4020 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8a6 expref: 29 pid: 8429 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746065127.687013:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.687015:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.687020:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.687026:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.687047:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.687060:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259792128:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.687115:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.688637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.688690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.690040:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261199232 00000100:00100000:1.0:1746065127.690049:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261199232 00002000:00100000:1.0:1746065127.690082:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009fb11c00 x1830881261199232/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 504/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.690090:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881261199232 ext(0->1048575) 00002000:00010000:1.0:1746065127.690095:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11c00 00000100:00100000:3.0:1746065127.690117:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261199488 00000100:00100000:3.0:1746065127.690121:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261199488 00000100:00100000:1.0:1746065127.690124:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5145 00000100:00100000:1.0:1746065127.690130:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261199232:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065127.690136:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009fb10380 x1830881261199488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.690141:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881261199488 ext(1048576->2097151) 00002000:00010000:3.0:1746065127.690144:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10380 00000100:00100000:3.0:1746065127.690155:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5146 00000100:00100000:3.0:1746065127.690159:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261199488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065127.690651:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259792128:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065127.690663:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.690684:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261198976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3721us (4087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.690691:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5573 00000100:00100000:0.0:1746065127.695613:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.695842:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261199744 00000100:00100000:1.0:1746065127.695842:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261199232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5711us (7205us total) trans 0 rc 143360/143360 00000100:00100000:2.0:1746065127.695851:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261199744 00000100:00100000:1.0:1746065127.695853:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5145 00002000:00100000:1.0:1746065127.695862:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009fb11c00 x1830881261199232/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 504/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 143360/143360 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.695869:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881261199232 ext(0->1048575) 00002000:00010000:1.0:1746065127.695874:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11c00 00002000:00100000:2.0:1746065127.695877:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37b:0x0] (3305472->3309567) req@ffff88009fb13b80 x1830881261199744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.695882:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881261199744 ext(3305472->3309567) 00002000:00010000:2.0:1746065127.695885:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13b80 00000100:00100000:1.0:1746065127.695904:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5147 00000100:00100000:1.0:1746065127.695910:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261199744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065127.696249:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261199744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 338us (643us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065127.696255:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5147 00002000:00100000:1.0:1746065127.696260:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3305472->3309567) req@ffff88009fb13b80 x1830881261199744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.696266:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881261199744 ext(3305472->3309567) 00002000:00010000:1.0:1746065127.696269:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13b80 00000100:00100000:3.0:1746065127.696434:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261199488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6272us (7741us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.696441:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5146 00002000:00100000:3.0:1746065127.696447:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009fb10380 x1830881261199488/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.696455:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881261199488 ext(1048576->2097151) 00002000:00010000:3.0:1746065127.696458:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10380 00000100:00100000:0.0:1746065127.719020:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.719066:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.719133:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261199872 00000100:00100000:3.0:1746065127.719142:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261199872 00000100:00100000:3.0:1746065127.719189:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261200000 00000100:00100000:3.0:1746065127.719192:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261200000 00000100:00100000:3.0:1746065127.719208:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11164 00000100:00100000:3.0:1746065127.719222:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261199872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.719239:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.719253:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0041000/0x14b4f8542d4f421f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9b7 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.719280:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0041000/0x14b4f8542d4f421f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9b7 expref: 24 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.719322:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0041000/0x14b4f8542d4f421f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9b7 expref: 24 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.719336:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0041000, rc 0) 00000100:00100000:2.0:1746065127.719355:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11165 00000100:00100000:2.0:1746065127.719363:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261200000:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.719370:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065127.719372:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261199872:12345-192.168.202.46@tcp:101:cat.0 Request processed in 153us (358us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065127.719378:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11164 00010000:00010000:2.0:1746065127.719379:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133083a00/0x14b4f8542d4f4226 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9be expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.719410:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259792256:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065127.719454:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11da80 going to sleep for 11 seconds 00002000:00010000:2.0:1746065127.724687:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065127 -> 1746065128 00002000:00010000:2.0:1746065127.724696:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065127 -> 1746065128 00002000:00010000:2.0:1746065127.724698:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065127 -> 1746065128 00000100:00100000:2.0:1746065127.724718:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259792256:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065127.724745:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133083a00/0x14b4f8542d4f4226 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9be expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.724757:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133083a00/0x14b4f8542d4f4226 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9be expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.724777:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083a00, rc 0) 00000100:00100000:2.0:1746065127.724841:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261200000:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5477us (5772us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065127.724848:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11165 00000100:00100000:1.0:1746065127.724858:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.724879:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261200256 00000100:00100000:2.0:1746065127.724884:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261200256 00000100:00100000:2.0:1746065127.724911:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9120 00000100:00100000:2.0:1746065127.724916:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+26:29186:x1830881261200256:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065127.724931:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.724942:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f422d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9c5 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.725022:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725033:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725043:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725057:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725061:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725064:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725149:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4242 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725156:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4242 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725162:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4242 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065127.725170:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065127.725234:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725240:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725245:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725250:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133083c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065127.725253:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725257:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725266:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065127.725269:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065127.725272:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725275:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083c00/0x14b4f8542d4f4234 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725352:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725358:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725363:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725367:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133083000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065127.725369:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725373:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725379:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205700) 00010000:00010000:2.0:1746065127.725380:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065127.725382:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725386:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083000/0x14b4f8542d4f423b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.725414:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082800/0x14b4f8542d4f422d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9c5 expref: 29 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.725424:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4242 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9c5 expref: 28 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.725429:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.725430:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065127.725433:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083e00, rc 0) 00000100:00100000:2.0:1746065127.725467:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+28:29186:x1830881261200256:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 550us (609us total) trans 8589943199 rc 0/0 00000100:00100000:2.0:1746065127.725473:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9120 00000100:00100000:0.0:1746065127.726861:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.727642:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261200384 00000100:00100000:2.0:1746065127.727649:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261200384 00000100:00100000:2.0:1746065127.727693:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11166 00000100:00100000:2.0:1746065127.727699:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+23:29182:x1830881261200384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.727713:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.727725:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9cc expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.727743:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.727744:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.727750:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9cc expref: 24 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.727953:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9cc expref: 24 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.727963:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133082200, rc 0) 00000100:00100000:2.0:1746065127.728014:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+24:29182:x1830881261200384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 314us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.728023:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11166 00000100:00100000:0.0:1746065127.728890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.731315:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261200512 00000100:00100000:2.0:1746065127.731324:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261200512 00000100:00100000:2.0:1746065127.731376:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 629 00000100:00100000:2.0:1746065127.731383:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261200512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.731395:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.731414:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4242 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9c5 expref: 28 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.731426:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.731430:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.731480:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881261200512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.731485:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 629 00000100:00100000:0.0:1746065127.733115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.733205:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261200768 00000100:00100000:3.0:1746065127.733212:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261200768 00002000:00100000:3.0:1746065127.733242:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009fb11f80 x1830881261200768/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.733249:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11f80 with x1830881261200768 ext(2097152->3145727) 00002000:00010000:3.0:1746065127.733253:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11f80 00000100:00100000:3.0:1746065127.733281:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5148 00000100:00100000:3.0:1746065127.733288:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261200768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065127.741858:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+24:1960:x1830881261200768:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8562us (8738us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.741868:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5148 00002000:00100000:3.0:1746065127.741878:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88009fb11f80 x1830881261200768/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.741892:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11f80 with x1830881261200768 ext(2097152->3145727) 00002000:00010000:3.0:1746065127.741897:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11f80 00000100:00100000:0.0:1746065127.748314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.748364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.748484:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261200896 00000100:00100000:2.0:1746065127.748492:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261200896 00000100:00100000:2.0:1746065127.748542:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261201024 00000100:00100000:2.0:1746065127.748544:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261201024 00000100:00100000:2.0:1746065127.748561:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11167 00000100:00100000:2.0:1746065127.748569:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+25:29186:x1830881261200896:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065127.748583:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.748598:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9d3 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.748624:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9cc expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.748631:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.748633:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.748636:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2154496->2424831] (req 2154496->2424831) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.748658:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9cc expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.748667:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9cc expref: 26 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.748677:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259792384:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.748745:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065127.748908:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11168 00000100:00100000:1.0:1746065127.748916:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+26:29182:x1830881261201024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.748923:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.748929:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9da expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.748941:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.748946:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065127.748947:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065127.748950:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.748963:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.748970:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 44 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065127.748977:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259792512:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.749017:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065127.750791:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259792384:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.750811:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2154496->2424831] (req 2154496->2424831) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.750842:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083000, rc 0) 00000100:00100000:1.0:1746065127.750977:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259792512:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065127.750992:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.750999:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f3600, rc 0) 00000100:00100000:2.0:1746065127.751342:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+27:29186:x1830881261200896:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2773us (3035us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.751349:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11167 00000100:00100000:0.0:1746065127.751462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.751638:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+26:29182:x1830881261201024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2722us (3272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.751643:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11168 00000100:00100000:2.0:1746065127.752143:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261201152 00000100:00100000:2.0:1746065127.752148:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261201152 00002000:00100000:2.0:1746065127.752172:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3997696->4194303) req@ffff88009fb12d80 x1830881261201152/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.752186:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12d80 with x1830881261201152 ext(3997696->4194303) 00010000:00010000:2.0:1746065127.752191:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 45 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.752200:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 45 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065127.752205:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb12d80 00000100:00100000:2.0:1746065127.752226:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1563 00000100:00100000:2.0:1746065127.752232:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881261201152:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065127.753061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.754136:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261201280 00000100:00100000:2.0:1746065127.754143:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261201280 00010000:00010000:2.0:1746065127.754169:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9cc expref: 26 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.754200:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5574 00000100:00100000:2.0:1746065127.754206:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261201280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.754547:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.754560:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9cc expref: 26 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.754570:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9cc expref: 26 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.754588:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133082200/0x14b4f8542d4f4250 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9cc expref: 26 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.754615:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.754617:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.754622:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.754629:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.754655:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.754665:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259792640:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.754728:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.755016:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1961:x1830881261201152:12345-192.168.202.46@tcp:4:cat.0 Request processed in 2781us (3552us total) trans 17179872905 rc 0/0 00000100:00100000:3.0:1746065127.755023:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1563 00002000:00100000:3.0:1746065127.755031:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3997696->4194303) req@ffff88009fb12d80 x1830881261201152/t17179872905(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.755038:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12d80 with x1830881261201152 ext(3997696->4194303) 00010000:00010000:3.0:1746065127.755044:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 47 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.755054:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 47 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065127.755059:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb12d80 00000100:00100000:1.0:1746065127.757229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.757455:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261201408 00000100:00100000:0.0:1746065127.757462:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261201408 00010000:00010000:0.0:1746065127.757487:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 47 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065127.757510:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5575 00000100:00100000:0.0:1746065127.757517:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1961:x1830881261201408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.757526:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.757543:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 47 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.757553:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 47 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.757571:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f41cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b978 expref: 47 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.757762:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881259792640:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065127.757774:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065127.757844:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.757846:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.757852:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.757859:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.757882:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065127.757891:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259792768:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.758246:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261201280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4038us (5184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.758253:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5574 00000100:00100000:0.0:1746065127.758434:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.758875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.759044:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261201664 00000100:00100000:3.0:1746065127.759049:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261201664 00002000:00100000:3.0:1746065127.759073:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2154496->2158591) req@ffff88009fb10e00 x1830881261201664/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.759081:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10e00 with x1830881261201664 ext(2154496->2158591) 00002000:00010000:3.0:1746065127.759085:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10e00 00000100:00100000:3.0:1746065127.759100:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5149 00000100:00100000:3.0:1746065127.759105:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261201664:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065127.760422:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261201664:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1312us (1543us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065127.760430:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5149 00002000:00100000:3.0:1746065127.760437:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2154496->2158591) req@ffff88009fb10e00 x1830881261201664/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.760445:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10e00 with x1830881261201664 ext(2154496->2158591) 00002000:00010000:3.0:1746065127.760448:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10e00 00000100:00100000:0.0:1746065127.763379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.764745:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261201920 00000100:00100000:3.0:1746065127.764752:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261201920 00002000:00100000:3.0:1746065127.764785:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009fb10000 x1830881261201920/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.764794:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10000 with x1830881261201920 ext(3145728->4194303) 00002000:00010000:3.0:1746065127.764798:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10000 00000100:00100000:3.0:1746065127.764844:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5150 00000100:00100000:3.0:1746065127.764851:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881261201920:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065127.764996:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259792768:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065127.765012:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.765047:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881261201408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7530us (7823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.765054:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5575 00000100:00100000:0.0:1746065127.765771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.765868:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261202176 00000100:00100000:1.0:1746065127.765873:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261202176 00002000:00100000:1.0:1746065127.765891:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2420736->2424831) req@ffff88009fb10a80 x1830881261202176/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.765899:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10a80 with x1830881261202176 ext(2420736->2424831) 00002000:00010000:1.0:1746065127.765903:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10a80 00000100:00100000:1.0:1746065127.765928:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5151 00000100:00100000:1.0:1746065127.765933:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881261202176:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065127.766005:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881261202176:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 72us (235us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065127.766011:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5151 00002000:00100000:1.0:1746065127.766016:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2420736->2424831) req@ffff88009fb10a80 x1830881261202176/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065127.766022:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10a80 with x1830881261202176 ext(2420736->2424831) 00002000:00010000:1.0:1746065127.766025:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10a80 00000100:00100000:3.0:1746065127.770545:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881261201920:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 5687us (7164us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.770554:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5150 00002000:00100000:3.0:1746065127.770563:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009fb10000 x1830881261201920/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.770572:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10000 with x1830881261201920 ext(3145728->4194303) 00002000:00010000:3.0:1746065127.770576:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10000 00000100:00100000:0.0:1746065127.771853:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.772023:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261202432 00000100:00100000:2.0:1746065127.772030:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261202432 00000100:00100000:2.0:1746065127.772074:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3745 00000100:00100000:2.0:1746065127.772081:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009badd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+27:29186:x1830881261202432:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065127.772243:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009badd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:29186:x1830881261202432:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 162us (393us total) trans 8589943200 rc 0/0 00000100:00100000:2.0:1746065127.772249:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3745 00000100:00100000:2.0:1746065127.778147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.778194:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261202560 00000100:00100000:1.0:1746065127.778206:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261202560 00000100:00100000:1.0:1746065127.778255:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11169 00000100:00100000:1.0:1746065127.778263:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:29182:x1830881261202560:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.778278:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.778303:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9e1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.778328:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.778334:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065127.778335:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065127.778339:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.778365:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.778375:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 27 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065127.778384:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259792896:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.779160:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065127.780544:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259792896:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065127.780566:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.780578:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f3c00, rc 0) 00000100:00100000:1.0:1746065127.780621:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:29182:x1830881261202560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2358us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.780628:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11169 00000100:00100000:0.0:1746065127.781504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.781565:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261202688 00000100:00100000:3.0:1746065127.781569:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261202688 00002000:00100000:3.0:1746065127.781594:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3309567) req@ffff88009fb11500 x1830881261202688/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.781603:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881261202688 ext(3145728->3309567) 00010000:00010000:3.0:1746065127.781609:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 28 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.781617:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 28 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065127.781621:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb11500 00000100:00100000:3.0:1746065127.781639:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1564 00000100:00100000:3.0:1746065127.781643:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261202688:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065127.783657:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261202688:12345-192.168.202.46@tcp:4:cat.0 Request processed in 2007us (2148us total) trans 21474840123 rc 0/0 00000100:00100000:3.0:1746065127.783665:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1564 00002000:00100000:3.0:1746065127.783675:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3309567) req@ffff88009fb11500 x1830881261202688/t21474840123(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.783682:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881261202688 ext(3145728->3309567) 00010000:00010000:3.0:1746065127.783690:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 30 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.783702:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 30 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065127.783708:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb11500 00000100:00100000:0.0:1746065127.785059:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.785128:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261202816 00000100:00100000:2.0:1746065127.785134:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261202816 00010000:00010000:2.0:1746065127.785157:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 30 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.785175:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5576 00000100:00100000:2.0:1746065127.785182:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261202816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.785191:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.785205:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 30 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.785214:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 30 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.785234:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133083800/0x14b4f8542d4f420a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a2 expref: 30 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.785390:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.785393:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.785400:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.785413:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.785441:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.785450:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259793024:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065127.786249:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065127.787226:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259793024:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065127.787240:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.787265:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261202816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2083us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.787274:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5576 00000100:00100000:0.0:1746065127.791399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.791953:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261203072 00000100:00100000:3.0:1746065127.791962:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261203072 00002000:00100000:3.0:1746065127.791997:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009fb10700 x1830881261203072/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.792005:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881261203072 ext(3145728->4194303) 00002000:00010000:3.0:1746065127.792009:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10700 00000100:00100000:3.0:1746065127.792037:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5152 00000100:00100000:3.0:1746065127.792044:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261203072:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065127.798689:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261203072:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 6637us (7290us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065127.798699:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5152 00002000:00100000:3.0:1746065127.798709:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009fb10700 x1830881261203072/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.798716:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881261203072 ext(3145728->4194303) 00002000:00010000:3.0:1746065127.798722:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10700 00000100:00100000:0.0:1746065127.801611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.801676:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261203200 00000100:00100000:1.0:1746065127.801685:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261203200 00000100:00100000:1.0:1746065127.801731:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11170 00000100:00100000:1.0:1746065127.801752:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881261203200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.801799:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.801855:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f426c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9e8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.801890:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f426c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e8 expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.801900:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2000/0x14b4f8542d4f426c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e8 expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.801927:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2000, rc 0) 00000100:00100000:1.0:1746065127.801977:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1959:x1830881261203200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 238us (373us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065127.801982:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11170 00000100:00100000:0.0:1746065127.807465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.807560:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261203456 00000100:00100000:3.0:1746065127.807567:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261203456 00002000:00100000:3.0:1746065127.807603:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff8801363a1180 x1830881261203456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.807611:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801363a1180 with x1830881261203456 ext(4194304->5029887) 00002000:00010000:3.0:1746065127.807615:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801363a1180 00000100:00100000:3.0:1746065127.807646:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5153 00000100:00100000:3.0:1746065127.807653:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261203456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065127.815493:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261203456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7831us (8026us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065127.815507:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5153 00002000:00100000:3.0:1746065127.815518:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff8801363a1180 x1830881261203456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/440 e 0 to 0 dl 1746065138 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.815527:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801363a1180 with x1830881261203456 ext(4194304->5029887) 00002000:00010000:3.0:1746065127.815533:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801363a1180 00000100:00100000:0.0:1746065127.817937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.818001:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261203584 00000100:00100000:1.0:1746065127.818008:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261203584 00000100:00100000:1.0:1746065127.818054:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11171 00000100:00100000:1.0:1746065127.818061:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261203584:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065127.818075:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.818089:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2400/0x14b4f8542d4f4273 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9ef expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.818111:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2400/0x14b4f8542d4f4273 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9ef expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.818122:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2400/0x14b4f8542d4f4273 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9ef expref: 26 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.818143:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2400, rc 0) 00000100:00100000:1.0:1746065127.818184:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261203584:12345-192.168.202.46@tcp:101:cat.0 Request processed in 123us (253us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065127.818189:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11171 00000100:00100000:0.0:1746065127.819678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.819849:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261203712 00000100:00100000:2.0:1746065127.819854:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261203712 00000100:00100000:2.0:1746065127.819882:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11172 00000100:00100000:2.0:1746065127.819887:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261203712:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.819896:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.819904:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133082000/0x14b4f8542d4f427a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9f6 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.819920:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133082000/0x14b4f8542d4f427a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9f6 expref: 26 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.819929:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133082000/0x14b4f8542d4f427a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9f6 expref: 26 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.819943:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133082000, rc 0) 00000100:00100000:2.0:1746065127.819972:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261203712:12345-192.168.202.46@tcp:101:cat.0 Request processed in 84us (296us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065127.819977:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11172 00010000:00010000:3.0:1746065127.834742:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065127.849710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.849808:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261203840 00000100:00100000:2.0:1746065127.849846:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261203840 00000100:00100000:2.0:1746065127.849896:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9121 00000100:00100000:2.0:1746065127.849903:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29190:x1830881261203840:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065127.849924:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.849940:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5b9fd expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.849989:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.850000:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.850009:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.850021:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.850026:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.850032:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.850131:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.850141:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b96a expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.850147:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.850172:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b96a expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.850182:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b96a expref: 264 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.850192:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259793152:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.850300:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065127.851690:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259793152:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.851707:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065127.855219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.855336:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261204096 00000100:00100000:3.0:1746065127.855345:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261204096 00000100:00100000:3.0:1746065127.855395:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3746 00000100:00100000:3.0:1746065127.855402:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:7711:x1830881261204096:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065127.855590:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:7711:x1830881261204096:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 187us (377us total) trans 8589943201 rc 0/0 00000100:00100000:3.0:1746065127.855595:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3746 00000100:00100000:0.0:1746065127.856857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.856961:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261204224 00000100:00100000:2.0:1746065127.856967:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261204224 00010000:00010000:2.0:1746065127.856990:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b96a expref: 266 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.857011:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5577 00000100:00100000:2.0:1746065127.857017:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:1961:x1830881261204224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.857027:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.857032:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b96a expref: 266 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.857040:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b96a expref: 266 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.857057:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f41af lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b96a expref: 266 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.857605:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.857610:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.857618:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.857623:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.857768:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.857806:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:1961:x1830881261204224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 788us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.857830:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5577 00010000:00010000:3.0:1746065127.857884:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857890:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065127.857921:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065127.857924:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065127.857936:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857944:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857951:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857957:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857962:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857966:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.857969:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857974:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857982:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065127.857984:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065127.857987:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857991:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082e00/0x14b4f8542d4f4288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.857999:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.858003:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.858007:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.858010:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.858012:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.858019:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.858023:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205100) 00010000:00010000:3.0:1746065127.858025:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065127.858027:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.858031:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f428f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.858055:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9fd expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.858065:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9fd expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.858070:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.858072:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065127.858074:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083800, rc 0) 00000100:00100000:3.0:1746065127.858107:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29190:x1830881261203840:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 8204us (8407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.858113:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9121 00000100:00100000:0.0:1746065127.866362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.866394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.866411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.866427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.866444:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261204480 00000100:00100000:0.0:1746065127.866452:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261204480 00000100:00100000:0.0:1746065127.866482:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261204352 00000100:00100000:0.0:1746065127.866483:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261204352 00000100:00100000:0.0:1746065127.866492:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261204736 00000100:00100000:0.0:1746065127.866494:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261204736 00000100:00100000:1.0:1746065127.866499:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261204992 00000100:00100000:1.0:1746065127.866503:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261204992 00000100:00100000:0.0:1746065127.866504:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11173 00000100:00100000:0.0:1746065127.866510:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261204480:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:1.0:1746065127.866524:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11174 00010000:00010000:0.0:1746065127.866525:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065127.866529:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261204352:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065127.866537:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.866539:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba0b expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.866546:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3200/0x14b4f8542d4f42a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba04 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.866559:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.866560:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.866569:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba0b expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.866582:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba0b expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.866590:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094614800, rc 0) 00000100:00100000:1.0:1746065127.866594:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259793280:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065127.866626:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261204480:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.866632:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11173 00000100:00100000:1.0:1746065127.866646:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.866650:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11175 00000100:00100000:0.0:1746065127.866655:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261204736:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065127.866661:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065127.866662:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11176 00000100:00100000:1.0:1746065127.866667:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261204992:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065127.866667:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba19 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.866672:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.866677:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.866678:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba27 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.866678:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.866683:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba19 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.866687:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.866689:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.866691:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba19 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.866694:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba27 expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.866698:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094614a00, rc 0) 00000100:00100000:0.0:1746065127.866713:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261204736:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 58us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.866721:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11175 00000100:00100000:0.0:1746065127.866747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.866758:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261204608 00000100:00100000:0.0:1746065127.866760:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261204608 00010000:00010000:1.0:1746065127.866773:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba27 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065127.866773:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11177 00000100:00100000:0.0:1746065127.866778:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261204608:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065127.866781:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2400, rc 0) 00010000:00010000:0.0:1746065127.866783:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.866789:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba12 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065127.866796:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261204992:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 129us (368us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065127.866798:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.866800:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065127.866801:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11176 00010000:00010000:0.0:1746065127.866803:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba12 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.866811:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba12 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.866843:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094615000, rc 0) 00000100:00100000:0.0:1746065127.866929:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261204608:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 149us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.866934:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11177 00000100:00100000:0.0:1746065127.866986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.867045:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261204864 00000100:00100000:3.0:1746065127.867050:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261204864 00000100:00100000:3.0:1746065127.867080:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11178 00000100:00100000:3.0:1746065127.867085:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261204864:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065127.867092:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.867100:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f42c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba20 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.867116:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f42c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba20 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.867125:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f42c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba20 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.867134:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0040a00, rc 0) 00000100:00100000:3.0:1746065127.867243:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261204864:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 157us (256us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065127.867247:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11178 00000100:00100000:1.0:1746065127.870622:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259793280:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065127.870650:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3200/0x14b4f8542d4f42a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba04 expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.870661:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3200/0x14b4f8542d4f42a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba04 expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065127.870681:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f3200, rc 0) 00000100:00100000:1.0:1746065127.870715:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261204352:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4185us (4319us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065127.870721:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11174 00000100:00100000:0.0:1746065127.872309:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.874533:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261205248 00000100:00100000:3.0:1746065127.874544:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261205248 00000100:00100000:3.0:1746065127.874586:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9122 00000100:00100000:3.0:1746065127.874592:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29190:x1830881261205248:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065127.874606:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.874623:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f42c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba2e expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.874699:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.874710:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9fd expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.874716:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.874749:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9fd expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.874758:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9fd expref: 10 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.874768:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259793408:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.874872:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.879448:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259793408:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.879470:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065127.880135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.880260:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261205376 00000100:00100000:2.0:1746065127.880267:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261205376 00010000:00010000:2.0:1746065127.880314:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9fd expref: 11 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.880352:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5578 00000100:00100000:2.0:1746065127.880360:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261205376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.880374:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.880380:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9fd expref: 11 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.880390:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9fd expref: 11 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.880410:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f4296 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9fd expref: 11 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.880434:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.880438:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.880447:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.880453:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.880474:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065127.880508:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065127.880508:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261205376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 149us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.880515:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5578 00010000:00010000:3.0:1746065127.880516:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065127.880533:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065127.880647:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f42c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba2e expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.880663:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba2e expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.880669:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.880671:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065127.880673:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0040600, rc 0) 00000100:00100000:3.0:1746065127.880709:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29190:x1830881261205248:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6117us (8405us total) trans 8589943202 rc 0/0 00000100:00100000:3.0:1746065127.880715:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9122 00000100:00100000:0.0:1746065127.884683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.884756:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261205504 00000100:00100000:3.0:1746065127.884765:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261205504 00000100:00100000:3.0:1746065127.884842:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9123 00000100:00100000:3.0:1746065127.884851:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29190:x1830881261205504:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065127.884872:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.884888:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040400/0x14b4f8542d4f42dc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba35 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.884957:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.884970:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba2e expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.884977:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.885002:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba2e expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.885011:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba2e expref: 11 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.885022:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259793536:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.885114:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.887400:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259793536:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.887424:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065127.888798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.889054:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261205632 00000100:00100000:2.0:1746065127.889063:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261205632 00010000:00010000:2.0:1746065127.889094:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba2e expref: 12 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.889117:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5579 00000100:00100000:2.0:1746065127.889124:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261205632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.889135:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.889139:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba2e expref: 12 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.889149:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba2e expref: 12 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.889167:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040600/0x14b4f8542d4f42ce lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba2e expref: 12 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.890627:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.890638:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.890650:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.890657:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065127.890697:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.890760:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261205632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1633us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.890767:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5579 00010000:00010000:3.0:1746065127.891166:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.891176:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065127.891215:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065127.891219:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065127.891234:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.891265:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040400/0x14b4f8542d4f42dc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba35 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.891279:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba35 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.891285:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.891302:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065127.891304:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0040200, rc 0) 00000100:00100000:3.0:1746065127.891330:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29190:x1830881261205504:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6480us (6654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.891336:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9123 00000100:00100000:0.0:1746065127.894626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.894668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.894689:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261205760 00000100:00100000:1.0:1746065127.894697:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261205760 00000100:00100000:3.0:1746065127.894724:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261205888 00000100:00100000:3.0:1746065127.894728:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261205888 00000100:00100000:1.0:1746065127.894732:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11179 00000100:00100000:1.0:1746065127.894739:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261205760:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:3.0:1746065127.894761:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11180 00000100:00100000:3.0:1746065127.894766:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261205888:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065127.894777:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.894791:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0040000/0x14b4f8542d4f42ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba43 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.894806:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.894833:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f42f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba3c expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.894835:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0040000/0x14b4f8542d4f42ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba43 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.894844:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0040000/0x14b4f8542d4f42ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba43 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.894852:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0040000, rc 0) 00000100:00100000:1.0:1746065127.894870:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259793664:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065127.894889:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261205888:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 122us (220us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065127.894895:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11180 00000100:00100000:1.0:1746065127.894962:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065127.897185:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133089500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259793664:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065127.897214:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f42f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba3c expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.897225:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2a00/0x14b4f8542d4f42f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba3c expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.897249:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2a00, rc 0) 00000100:00100000:2.0:1746065127.897304:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261205760:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2564us (2685us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065127.897537:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11179 00000100:00100000:0.0:1746065127.900407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.900479:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261206144 00000100:00100000:3.0:1746065127.900487:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261206144 00000100:00100000:3.0:1746065127.900523:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9124 00000100:00100000:3.0:1746065127.900530:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29190:x1830881261206144:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065127.900545:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.900559:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040a00/0x14b4f8542d4f42f8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba4a expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.900633:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.900644:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.900657:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065127.900665:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065127.900755:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040a00/0x14b4f8542d4f42f8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba4a expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.900767:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba4a expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.900774:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.900776:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065127.900778:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0040e00, rc 0) 00000100:00100000:3.0:1746065127.900845:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29190:x1830881261206144:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 314us (445us total) trans 8589943203 rc 0/0 00000100:00100000:3.0:1746065127.900851:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9124 00000100:00100000:0.0:1746065127.905589:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.905664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.906370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.906399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.906834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.906857:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261206272 00000100:00100000:0.0:1746065127.906862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.906865:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261206272 00000100:00100000:0.0:1746065127.906879:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261206400 00000100:00100000:0.0:1746065127.906882:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261206400 00000100:00100000:3.0:1746065127.907043:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261206528 00000100:00100000:3.0:1746065127.907046:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261206528 00000100:00100000:3.0:1746065127.907065:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261206656 00000100:00100000:3.0:1746065127.907067:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261206656 00000100:00100000:3.0:1746065127.907077:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261206784 00000100:00100000:3.0:1746065127.907079:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261206784 00000100:00100000:3.0:1746065127.907085:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261206912 00000100:00100000:3.0:1746065127.907087:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261206912 00000100:00100000:2.0:1746065127.907092:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11181 00000100:00100000:2.0:1746065127.907103:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261206272:12345-192.168.202.46@tcp:1:lfs.0 00000100:00100000:3.0:1746065127.907107:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11182 00000100:00100000:3.0:1746065127.907113:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261206400:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065127.907141:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.907141:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.907158:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.907158:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.907164:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065127.907166:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba0b expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.907166:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065127.907169:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.907173:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a9 expref: 20 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.907178:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.907180:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.907182:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.907193:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.907196:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a9 expref: 20 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.907204:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 24 pid: 8428 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.907205:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a9 expref: 20 pid: 4545 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065127.907216:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259793920:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.907216:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259793792:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065127.907267:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11183 00000100:00100000:0.0:1746065127.907273:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261206528:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065127.907301:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.907310:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 28 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.907316:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba12 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.907322:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b86e expref: 20 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.907327:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.907328:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.907330:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.907344:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b86e expref: 20 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.907351:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b86e expref: 20 pid: 21998 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065127.907358:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259794048:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.907412:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065127.907429:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11184 00000100:00100000:2.0:1746065127.907435:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261206656:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065127.907451:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.907459:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.907465:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba19 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.907471:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8f3 expref: 45 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.907476:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.907477:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.907479:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.907494:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8f3 expref: 45 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.907501:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8f3 expref: 45 pid: 8429 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065127.907509:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259794176:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.907555:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11185 00000100:00100000:1.0:1746065127.907563:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261206784:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065127.907580:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.907588:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 24 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.907595:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.907601:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 5025792->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b986 expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.907607:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746065127.907608:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746065127.907610:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.907624:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 5025792->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b986 expref: 45 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.907631:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 5025792->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b986 expref: 45 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065127.907640:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259794304:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.907763:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba0b expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.907772:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba0b expref: 11 pid: 4545 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065127.907785:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259794432:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.907808:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.908569:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 28 pid: 8428 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.908584:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259794560:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.908611:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.908629:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11186 00000100:00100000:3.0:1746065127.908637:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261206912:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065127.908657:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.908667:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.908674:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba27 expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.908681:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.908687:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b89f expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.908693:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065127.908695:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065127.908697:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 7/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.908723:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b89f expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.908731:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b89f expref: 20 pid: 8851 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.908739:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259794688:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.908763:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.908770:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 28 pid: 8851 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.908777:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259794816:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.908794:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba27 expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.908802:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba27 expref: 11 pid: 21235 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065127.908830:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259794944:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.908852:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.908859:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 20 pid: 8429 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.908866:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259795072:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.908879:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00010000:00010000:0.0:1746065127.910614:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba12 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065127.910627:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba12 expref: 11 pid: 4545 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065127.910636:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259795200:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065127.910666:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 28 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.910673:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 28 pid: 4545 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065127.910680:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259795328:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065127.910692:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065127.910898:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba19 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.910907:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba19 expref: 8 pid: 4545 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065127.910915:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259795456:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.910942:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.910950:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 24 pid: 8429 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.910957:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259795584:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.910973:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6780 going to sleep for 11 seconds 00010000:00010000:1.0:1746065127.911100:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.911109:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 24 pid: 8429 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065127.911116:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259795712:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065127.911140:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 24 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.911147:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 24 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065127.911154:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133088a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259795840:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.911183:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.911486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.911641:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207168 00000100:00100000:3.0:1746065127.911648:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207168 00000100:00100000:3.0:1746065127.911679:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9125 00000100:00100000:3.0:1746065127.911684:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:29193:x1830881261207168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.911699:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.911712:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173200/0x14b4f8542d4f4337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba51 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.911787:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911796:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911804:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911830:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911835:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911840:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911915:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911921:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911925:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065127.911932:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065127.911985:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911989:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911994:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.911998:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d173800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.912001:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912006:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912013:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.912016:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065127.912018:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912022:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173800/0x14b4f8542d4f434c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912032:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912036:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912041:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912045:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d173400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.912047:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912051:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912056:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065127.912058:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065127.912060:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912064:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173400/0x14b4f8542d4f433e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912070:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912074:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912079:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912082:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d173600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.912084:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912088:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912092:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a54e6c00) 00010000:00010000:3.0:1746065127.912093:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065127.912094:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912098:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173600/0x14b4f8542d4f4345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065127.912121:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173200/0x14b4f8542d4f4337 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba51 expref: 267 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.912127:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d173200/0x14b4f8542d4f4337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba51 expref: 267 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.912133:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d173200, rc 0) 00000100:00100000:3.0:1746065127.912167:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:29193:x1830881261207168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 482us (682us total) trans 8589943204 rc 301/301 00000100:00100000:3.0:1746065127.912172:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9125 00000100:00100000:2.0:1746065127.917245:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259793792:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.917267:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.917312:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259794688:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.917319:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259794816:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.917328:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259794944:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.917333:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259795072:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065127.917347:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.917932:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259793920:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.917942:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259794432:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.917948:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259794560:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.917960:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065127.918382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.918446:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259794176:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065127.918455:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259795456:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.918504:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207296 00000100:00100000:3.0:1746065127.918509:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207296 00002000:00100000:3.0:1746065127.918541:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (16384->921599) req@ffff88008fd05180 x1830881261207296/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065127.918550:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05180 with x1830881261207296 ext(16384->921599) 00010000:00010000:3.0:1746065127.918556:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 25 pid: 8428 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.918566:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 25 pid: 8428 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065127.918572:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd05180 00000100:00100000:1.0:1746065127.918659:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259794048:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.918667:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259795200:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.918673:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259795328:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065127.918687:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.919051:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1565 00000100:00100000:3.0:1746065127.919058:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261207296:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065127.922170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.922201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.922226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.922247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.922258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.922268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.922278:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.922305:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207424 00000100:00100000:0.0:1746065127.922312:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207424 00010000:00010000:0.0:1746065127.922340:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba0b expref: 12 pid: 4545 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065127.922356:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207808 00000100:00100000:0.0:1746065127.922357:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207808 00010000:00010000:0.0:1746065127.922364:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 29 pid: 8428 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065127.922370:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261208064 00000100:00100000:0.0:1746065127.922372:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261208064 00010000:00010000:0.0:1746065127.922378:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 30 pid: 8851 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065127.922385:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261208320 00000100:00100000:0.0:1746065127.922386:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261208320 00010000:00010000:0.0:1746065127.922392:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba12 expref: 13 pid: 4545 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065127.922397:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261208704 00000100:00100000:0.0:1746065127.922399:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261208704 00010000:00010000:0.0:1746065127.922406:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8f3 expref: 46 pid: 8429 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065127.922413:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207552 00000100:00100000:0.0:1746065127.922415:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207552 00010000:00010000:0.0:1746065127.922422:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a9 expref: 21 pid: 4545 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065127.922429:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5580 00000100:00100000:0.0:1746065127.922435:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881261207424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.922445:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.922460:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba0b expref: 13 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922469:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba0b expref: 13 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922486:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094614800/0x14b4f8542d4f429d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba0b expref: 13 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922501:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.922528:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261207424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.922533:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5580 00000100:00100000:0.0:1746065127.922548:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5581 00000100:00100000:0.0:1746065127.922551:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261207808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.922557:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.922563:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 30 pid: 8428 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.922571:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 30 pid: 8428 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.922580:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091103c00/0x14b4f8542d4f41a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b963 expref: 30 pid: 8428 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.922597:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.922607:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261207808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.922611:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5581 00000100:00100000:0.0:1746065127.922642:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5582 00000100:00100000:0.0:1746065127.922646:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261208064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.922651:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.922658:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 28 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.922665:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 28 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.922673:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0dec00/0x14b4f8542d4f400b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b891 expref: 28 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.922679:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.922691:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261208064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 44us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.922695:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5582 00000100:00100000:0.0:1746065127.922704:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5583 00000100:00100000:0.0:1746065127.922708:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261208320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.922713:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.922719:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba12 expref: 11 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922726:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba12 expref: 11 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922735:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094615000/0x14b4f8542d4f42b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba12 expref: 11 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922741:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.922751:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261208320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 43us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.922755:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5583 00000100:00100000:0.0:1746065127.922763:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5584 00000100:00100000:0.0:1746065127.922767:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881261208704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.922772:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.922781:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8f3 expref: 46 pid: 8429 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922787:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8f3 expref: 46 pid: 8429 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922801:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f76aa00/0x14b4f8542d4f40dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8f3 expref: 46 pid: 8429 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922809:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.922847:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881261208704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.922852:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5584 00000100:00100000:0.0:1746065127.922861:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5585 00000100:00100000:0.0:1746065127.922865:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261207552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.922871:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.922878:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a9 expref: 21 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922885:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a9 expref: 21 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.922894:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2800/0x14b4f8542d4f4211 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9a9 expref: 21 pid: 4545 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065127.923162:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261208448 00000100:00100000:2.0:1746065127.923166:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261208448 00000100:00100000:2.0:1746065127.923191:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9126 00000100:00100000:2.0:1746065127.923198:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:29193:x1830881261208448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.923265:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.923280:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f435a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba58 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.923503:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.923577:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.924065:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065127.924089:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065127.924092:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065127.924104:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.924124:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082000/0x14b4f8542d4f435a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba58 expref: 268 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.924675:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba58 expref: 267 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.924682:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.924685:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065127.924687:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133082c00, rc 0) 00000100:00100000:2.0:1746065127.925032:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:29193:x1830881261208448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1834us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.925039:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9126 00010000:00010000:0.0:1746065127.925087:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.925090:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.925095:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.925103:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.926028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.926051:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207680 00000100:00100000:2.0:1746065127.926058:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207680 00010000:00010000:2.0:1746065127.926081:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b89f expref: 21 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.926237:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.926244:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.926272:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.926279:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.926285:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.926299:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0041a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065127.926302:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.926308:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.926319:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.926359:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261206400:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 19246us (20694us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.926366:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11182 00000100:00100000:3.0:1746065127.926401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065127.926663:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0041a00/0x14b4f8542d4f430d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.926681:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.926700:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261207552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3833us (4420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.926706:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5585 00000100:00100000:0.0:1746065127.927460:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207936 00000100:00100000:0.0:1746065127.927465:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207936 00010000:00010000:0.0:1746065127.927479:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba27 expref: 9 pid: 21235 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065127.927498:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5586 00000100:00100000:0.0:1746065127.927503:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261207680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065127.927517:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065127.927524:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5587 00010000:00010000:0.0:1746065127.927529:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b89f expref: 20 pid: 8851 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.927531:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261207936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.927537:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.927538:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b89f expref: 20 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.927544:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba27 expref: 9 pid: 21235 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.927551:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f4019 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b89f expref: 20 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.927552:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba27 expref: 9 pid: 21235 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065127.927563:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065127.927568:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2400/0x14b4f8542d4f42b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba27 expref: 9 pid: 21235 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065127.927575:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.927575:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261207680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.927579:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5586 00000100:00100000:2.0:1746065127.927583:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261207936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.927588:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5587 00000100:00100000:2.0:1746065127.927650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.927662:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261208192 00000100:00100000:2.0:1746065127.927666:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261208192 00010000:00010000:2.0:1746065127.927680:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b86e expref: 19 pid: 21998 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065127.927700:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5588 00000100:00100000:2.0:1746065127.927704:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261208192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.927710:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.927717:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b86e expref: 19 pid: 21998 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065127.927725:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b86e expref: 19 pid: 21998 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065127.927734:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f3fcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b86e expref: 19 pid: 21998 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065127.927745:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.927755:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261208192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.927759:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5588 00000100:00100000:2.0:1746065127.927805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.927828:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261208576 00000100:00100000:2.0:1746065127.927831:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261208576 00010000:00010000:2.0:1746065127.927840:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 27 pid: 4545 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.927857:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5589 00000100:00100000:2.0:1746065127.927860:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261208576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.927865:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.927871:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 27 pid: 4545 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.927877:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 27 pid: 4545 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.927887:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133083200/0x14b4f8542d4f3f24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b836 expref: 27 pid: 4545 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.927895:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.927896:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.927900:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.927911:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.927926:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.927936:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261208576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 75us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.927941:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5589 00000100:00100000:2.0:1746065127.927974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.927982:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261208832 00000100:00100000:2.0:1746065127.927984:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261208832 00010000:00010000:2.0:1746065127.927992:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba19 expref: 9 pid: 4545 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065127.928010:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5590 00000100:00100000:2.0:1746065127.928018:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261208832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.928024:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.928034:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba19 expref: 9 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065127.928041:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba19 expref: 9 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065127.928052:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094614a00/0x14b4f8542d4f42ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba19 expref: 9 pid: 4545 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065127.928060:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065127.928065:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.928069:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261208832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (95us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065127.928072:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.928074:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5590 00010000:00010000:1.0:1746065127.928086:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.928092:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.928099:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.928104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065127.928104:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094614400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065127.928107:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.928113:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261208960 00010000:00010000:1.0:1746065127.928113:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.928115:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261208960 00010000:00010000:1.0:1746065127.928122:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.928123:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 18 pid: 8429 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065127.928128:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094614400/0x14b4f8542d4f431b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.928142:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5591 00000100:00100000:2.0:1746065127.928146:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881261208960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.928151:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.928157:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 18 pid: 8429 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065127.928163:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261206528:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 20891us (21795us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065127.928164:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 18 pid: 8429 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065127.928169:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11183 00010000:00010000:2.0:1746065127.928174:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3c00/0x14b4f8542d4f4265 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9e1 expref: 18 pid: 8429 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.928180:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.928182:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065127.928184:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.928189:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.928204:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.928213:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261208960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (108us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065127.929556:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.929570:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.929588:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.929593:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.929599:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.929604:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe49400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065127.929607:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.929612:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.929622:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.929631:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe49400/0x14b4f8542d4f4330 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065127.929663:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261206912:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 21026us (22799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.929670:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11186 00000100:00100000:0.0:1746065127.929812:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259795584:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065127.929846:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065127.930132:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259794304:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065127.930169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.930188:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.930198:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261209088 00000100:00100000:1.0:1746065127.930202:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261209088 00000100:00100000:3.0:1746065127.930205:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261209216 00000100:00100000:3.0:1746065127.930209:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261209216 00010000:00010000:3.0:1746065127.930219:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 5025792->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b986 expref: 45 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065127.930219:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 27 pid: 8429 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.930235:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5592 00000100:00100000:3.0:1746065127.930246:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881261209216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065127.930256:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.930268:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 5025792->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b986 expref: 45 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065127.930271:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5593 00000100:00100000:1.0:1746065127.930276:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881261209088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065127.930277:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 5025792->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b986 expref: 45 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065127.930281:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065127.930296:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 27 pid: 8429 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.930298:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f41d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 5025792->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b986 expref: 45 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065127.930304:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 27 pid: 8429 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.930310:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065127.930314:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f76b000/0x14b4f8542d4f40d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b8ec expref: 27 pid: 8429 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.930321:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881261209216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (133us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065127.930321:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.930323:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065127.930326:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5592 00010000:00010000:1.0:1746065127.930327:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.930333:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.930347:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065127.930356:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261209088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.930359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.930360:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5593 00010000:00010000:0.0:1746065127.930418:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.930425:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.930438:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.930443:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.930448:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.930457:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133082800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065127.930459:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.930464:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.930471:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.930476:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133082800/0x14b4f8542d4f4322 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065127.930501:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261206656:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 23067us (24102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.930506:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11184 00000100:00100000:0.0:1746065127.930527:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259795712:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065127.930533:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133088a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259795840:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065127.930546:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.931993:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5591 00000100:00100000:2.0:1746065127.932025:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261209344 00000100:00100000:2.0:1746065127.932030:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261209344 00002000:00100000:2.0:1746065127.932055:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2154496->2424831) req@ffff88009f469180 x1830881261209344/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/0 e 0 to 0 dl 1746065138 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.932062:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469180 with x1830881261209344 ext(2154496->2424831) 00010000:00010000:2.0:1746065127.932068:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 26 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.932076:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 26 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065127.932081:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f469180 00000100:00100000:2.0:1746065127.932178:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1566 00000100:00100000:2.0:1746065127.932184:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261209344:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065127.939187:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.939260:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261209472 00000100:00100000:3.0:1746065127.939267:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261209472 00010000:00010000:3.0:1746065127.939310:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 28 pid: 8429 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.939340:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5594 00000100:00100000:3.0:1746065127.939348:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261209472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065127.939363:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.939380:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 28 pid: 8429 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.939391:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 28 pid: 8429 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.939410:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f425e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9da expref: 28 pid: 8429 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065127.939423:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065127.939457:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881261209472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.939463:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5594 00000100:00100000:3.0:1746065127.940329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.940344:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261209600 00000100:00100000:0.0:1746065127.940349:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261209600 00000100:00100000:0.0:1746065127.940370:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11187 00000100:00100000:0.0:1746065127.940375:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1958:x1830881261209600:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065127.940388:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.940398:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4368 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba5f expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065127.940432:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259795968:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065127.940492:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941b1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065127.940713:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.940737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.940748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.940760:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261209728 00000100:00100000:3.0:1746065127.940763:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261209728 00000100:00100000:3.0:1746065127.940778:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261209856 00000100:00100000:3.0:1746065127.940779:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261209856 00000100:00100000:3.0:1746065127.940787:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261209984 00000100:00100000:3.0:1746065127.940788:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261209984 00000100:00100000:3.0:1746065127.940799:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11188 00000100:00100000:3.0:1746065127.940804:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881261209728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.940811:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.940840:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba66 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065127.940857:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6e8, atime: 0x6812d6e8, ctime: 0x6812d6e8, blocks: 0x821 00010000:00010000:3.0:1746065127.940866:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.940868:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.940875:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba66 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.940885:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba66 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065127.940888:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11189 00010000:00010000:3.0:1746065127.940893:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d173600, rc 0) 00000100:00100000:0.0:1746065127.940894:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881261209856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065127.940899:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.940906:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba6d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065127.940911:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881261209728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 107us (199us total) trans 0 rc 0/0 00002000:00010000:0.0:1746065127.940915:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6e7, atime: 0x6812d6e7, ctime: 0x6812d6e7, blocks: 0x81d 00000100:00100000:3.0:1746065127.940916:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11188 00010000:00010000:0.0:1746065127.940921:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.940923:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065127.940925:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11190 00010000:00010000:0.0:1746065127.940927:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba6d expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065127.940929:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1958:x1830881261209984:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.940934:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.940936:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba6d expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.940940:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba74 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.940941:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094615200, rc 0) 00002000:00010000:3.0:1746065127.940951:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6e8, atime: 0x6812d6e7, ctime: 0x6812d6e8, blocks: 0x821 00000100:00100000:0.0:1746065127.940954:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881261209856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 61us (217us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065127.940957:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.940958:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065127.940959:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11189 00010000:00010000:3.0:1746065127.940961:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba74 expref: 47 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.940974:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba74 expref: 47 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.940980:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d173e00, rc 0) 00000100:00100000:3.0:1746065127.940993:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1958:x1830881261209984:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.940997:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11190 00000100:00100000:3.0:1746065127.941021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.941031:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261210112 00000100:00100000:3.0:1746065127.941033:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261210112 00000100:00100000:3.0:1746065127.941044:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11191 00000100:00100000:3.0:1746065127.941047:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1958:x1830881261210112:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.941052:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.941057:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d173400/0x14b4f8542d4f4384 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba7b expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.941070:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d173400/0x14b4f8542d4f4384 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba7b expref: 48 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.941077:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d173400/0x14b4f8542d4f4384 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba7b expref: 48 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.941083:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d173400, rc 0) 00000100:00100000:3.0:1746065127.941097:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1958:x1830881261210112:12345-192.168.202.46@tcp:101:cat.0 Request processed in 49us (75us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065127.941104:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11191 00000100:00100000:3.0:1746065127.941139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.941149:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261210240 00000100:00100000:3.0:1746065127.941151:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261210240 00000100:00100000:3.0:1746065127.941163:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11192 00000100:00100000:3.0:1746065127.941167:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881261210240:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.941172:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.941179:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba82 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065127.941188:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6e8, atime: 0x6812d6e7, ctime: 0x6812d6e8, blocks: 0x102b 00010000:00010000:3.0:1746065127.941194:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.941195:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065127.941199:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba82 expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.941206:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba82 expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065127.941212:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d172c00, rc 0) 00000100:00100000:3.0:1746065127.941224:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261210240:12345-192.168.202.46@tcp:101:cat.0 Request processed in 57us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065127.941228:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11192 00000100:00100000:2.0:1746065127.941972:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261209344:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9786us (11609us total) trans 17179872906 rc 0/0 00000100:00100000:2.0:1746065127.941980:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1566 00002000:00100000:2.0:1746065127.941987:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (2154496->2424831) req@ffff88009f469180 x1830881261209344/t17179872906(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065127.941995:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469180 with x1830881261209344 ext(2154496->2424831) 00010000:00010000:2.0:1746065127.942001:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 27 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.942009:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 27 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065127.942014:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f469180 00000100:00100000:0.0:1746065127.943946:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261207296:12345-192.168.202.46@tcp:4:cat.0 Request processed in 24883us (25559us total) trans 17179872907 rc 0/0 00000100:00100000:0.0:1746065127.943956:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1565 00002000:00100000:0.0:1746065127.943963:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37d:0x0] (16384->921599) req@ffff88008fd05180 x1830881261207296/t17179872907(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:43/0 lens 488/448 e 0 to 0 dl 1746065138 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065127.943971:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05180 with x1830881261207296 ext(16384->921599) 00010000:00010000:0.0:1746065127.943977:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 27 pid: 8428 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.943987:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 27 pid: 8428 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065127.943994:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd05180 00000100:00100000:2.0:1746065127.946894:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259795968:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065127.946924:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4368 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba5f expref: 46 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.946936:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4368 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba5f expref: 46 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065127.946945:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094615e00, rc 0) 00000100:00100000:2.0:1746065127.947109:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1958:x1830881261209600:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6731us (6778us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065127.947116:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11187 00000100:00100000:0.0:1746065127.948783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.948884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.949593:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261210496 00000100:00100000:3.0:1746065127.949601:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261210496 00000100:00100000:3.0:1746065127.949651:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9127 00000100:00100000:3.0:1746065127.949658:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:29198:x1830881261210496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065127.949678:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065127.949692:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172e00/0x14b4f8542d4f4392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba89 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.949776:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.949787:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.949796:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.949807:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.949835:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.949841:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.949928:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.949937:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.949942:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065127.949949:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065127.950012:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950021:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950026:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950031:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d172400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.950034:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950039:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950047:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.950049:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065127.950052:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950056:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172400/0x14b4f8542d4f43a7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950068:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950072:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950076:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950080:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d172800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.950082:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950090:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950095:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065127.950096:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065127.950099:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950108:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172800/0x14b4f8542d4f4399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950115:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950120:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950124:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950127:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d172a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065127.950129:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950134:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950138:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129d38600) 00010000:00010000:3.0:1746065127.950140:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065127.950142:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950146:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f43a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.950174:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172e00/0x14b4f8542d4f4392 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba89 expref: 30 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.950181:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172e00/0x14b4f8542d4f4392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba89 expref: 30 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.950187:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d172e00, rc 0) 00000100:00100000:3.0:1746065127.950220:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+29:29198:x1830881261210496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 562us (1441us total) trans 8589943205 rc 301/301 00000100:00100000:3.0:1746065127.950226:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9127 00000100:00100000:2.0:1746065127.950419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.950474:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261210624 00000100:00100000:0.0:1746065127.950478:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261210624 00010000:00010000:0.0:1746065127.950494:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 27 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065127.950520:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261210752 00000100:00100000:0.0:1746065127.950523:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261210752 00010000:00010000:0.0:1746065127.950532:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 28 pid: 8428 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065127.950542:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5595 00000100:00100000:0.0:1746065127.950546:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5596 00000100:00100000:1.0:1746065127.950548:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261210624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065127.950550:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881261210752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065127.950556:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065127.950556:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065127.950569:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 28 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.950569:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 28 pid: 8428 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065127.950578:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 28 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.950578:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 28 pid: 8428 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065127.950590:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133083000/0x14b4f8542d4f4257 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2154496->3145727] (req 2154496->2424831) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b9d3 expref: 28 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065127.950590:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091103400/0x14b4f8542d4f419a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->921599) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b95c expref: 28 pid: 8428 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065127.950599:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.950600:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065127.950604:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950607:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.950608:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.950611:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.950615:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950616:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.950632:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065127.950639:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065127.950657:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881261210752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (238us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065127.950661:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065127.950662:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5596 00010000:00010000:2.0:1746065127.950667:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950685:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.950689:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950691:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.950696:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.950701:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950701:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.950705:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133083c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065127.950708:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950710:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.950714:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950716:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950720:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d4f3000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065127.950722:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950722:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.950727:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133083c00/0x14b4f8542d4f4314 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950727:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950734:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.950738:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3000/0x14b4f8542d4f4329 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065127.950758:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261206272:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 43658us (45176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.950758:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261206784:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 43197us (43925us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.950765:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11181 00000100:00100000:1.0:1746065127.950831:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261210624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 282us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065127.950836:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5595 00000100:00100000:0.0:1746065127.952323:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11185 00000100:00100000:1.0:1746065127.952507:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.952561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.952716:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261211136 00000100:00100000:3.0:1746065127.952721:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261211136 00000100:00100000:3.0:1746065127.952746:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9128 00000100:00100000:3.0:1746065127.952751:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29190:x1830881261211136:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:3.0:1746065127.952784:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065127.952801:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f42e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba35 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.952827:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065127.952831:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065127.952850:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.952861:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 266 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.952867:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b1 expref: 28 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.952874:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b99b expref: 28 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.952879:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba58 expref: 266 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.952884:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.952907:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba58 expref: 266 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.952916:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba58 expref: 266 pid: 16767 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.952927:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259796096:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065127.953070:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261210880 00000100:00100000:0.0:1746065127.953073:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261210880 00000100:00100000:0.0:1746065127.953089:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11193 00000100:00100000:0.0:1746065127.953093:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:29193:x1830881261210880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065127.953101:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065127.953111:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba90 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065127.953123:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e8, atime: 0x6812d6e8, ctime: 0x6812d6e8, blocks: 0x7f1 00010000:00010000:0.0:1746065127.953132:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.953134:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065127.953138:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba90 expref: 46 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.953147:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba90 expref: 46 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065127.953153:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0df400, rc 0) 00000100:00100000:0.0:1746065127.953177:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:29193:x1830881261210880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 83us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065127.953182:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11193 00000100:00100000:2.0:1746065127.953302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.953614:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261211392 00000100:00100000:0.0:1746065127.953617:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261211392 00010000:00010000:3.0:1746065127.954147:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b99b expref: 29 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.954155:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b99b expref: 29 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.954163:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259796224:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.954183:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b1 expref: 29 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.954189:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b1 expref: 29 pid: 16767 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.954195:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259796352:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.954209:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 266 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065127.954215:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 266 pid: 16767 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065127.954220:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259796480:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.954230:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065127.954344:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3747 00000100:00100000:0.0:1746065127.954350:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+29:29198:x1830881261211392:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065127.954461:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+30:29198:x1830881261211392:12345-192.168.202.46@tcp:35:cat.0 Request processed in 110us (1158us total) trans 8589943206 rc 0/0 00000100:00100000:0.0:1746065127.954465:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3747 00000100:00100000:0.0:1746065127.955003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065127.955286:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261211648 00000100:00100000:1.0:1746065127.955299:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261211648 00000100:00100000:1.0:1746065127.955335:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9129 00000100:00100000:1.0:1746065127.955341:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:29195:x1830881261211648:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065127.955349:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.955361:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fcc00/0x14b4f8542d4f43c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba97 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.955430:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.955439:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.955448:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.955457:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.955466:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065127.955470:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065127.958341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065127.958418:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259796096:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.958428:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259796224:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.958434:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259796352:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065127.958440:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881259796480:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065127.958467:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065127.958520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.958547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.958559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.958577:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261211904 00000100:00100000:0.0:1746065127.958582:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261211904 00010000:00010000:0.0:1746065127.958607:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 269 pid: 16767 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065127.958625:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212160 00000100:00100000:0.0:1746065127.958628:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212160 00010000:00010000:0.0:1746065127.958636:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba58 expref: 270 pid: 16767 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065127.959185:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261211776 00000100:00100000:0.0:1746065127.959189:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261211776 00010000:00010000:0.0:1746065127.959201:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b99b expref: 30 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.959241:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212032 00000100:00100000:2.0:1746065127.959244:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212032 00010000:00010000:2.0:1746065127.959259:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b1 expref: 31 pid: 16767 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065127.959272:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5597 00000100:00100000:2.0:1746065127.959279:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:1960:x1830881261211904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.959301:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.959306:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 270 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959314:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 270 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959333:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbcee00/0x14b4f8542d4f3e52 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7aa expref: 270 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959345:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.959349:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.959356:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.959391:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:1960:x1830881261211904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 112us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.959397:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5597 00000100:00100000:2.0:1746065127.959414:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5598 00000100:00100000:2.0:1746065127.959419:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:1960:x1830881261212160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.959425:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.959429:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba58 expref: 268 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959440:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba58 expref: 268 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959449:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082c00/0x14b4f8542d4f4361 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba58 expref: 268 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959457:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.959460:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.959464:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.959478:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:1960:x1830881261212160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.959482:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5598 00000100:00100000:2.0:1746065127.959494:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5599 00000100:00100000:2.0:1746065127.959498:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881261211776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.959505:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.959509:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b99b expref: 31 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959516:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b99b expref: 31 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959525:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083600/0x14b4f8542d4f41fc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b99b expref: 31 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959532:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.959536:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.959540:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.959552:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261211776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.959557:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5599 00000100:00100000:2.0:1746065127.959567:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5600 00000100:00100000:2.0:1746065127.959572:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881261212032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065127.959577:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065127.959580:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b1 expref: 29 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959588:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b1 expref: 29 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959596:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4f3e59 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5b7b1 expref: 29 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065127.959606:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.959609:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.959614:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.959620:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.959634:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065127.959647:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261212032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 75us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.959651:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5600 00000100:00100000:2.0:1746065127.959681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.959696:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212288 00000100:00100000:2.0:1746065127.959699:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212288 00000100:00100000:2.0:1746065127.959715:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9130 00000100:00100000:2.0:1746065127.959719:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+28:29198:x1830881261212288:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.959736:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.959743:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f43d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ba9e expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.959799:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065127.959806:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065127.959811:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065127.959849:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065127.959853:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065127.959866:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065127.959884:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083a00/0x14b4f8542d4f43d8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba9e expref: 30 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.959895:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba9e expref: 29 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.959904:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.959906:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065127.959908:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133082200, rc 0) 00000100:00100000:2.0:1746065127.959930:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+29:29198:x1830881261212288:12345-192.168.202.46@tcp:101:cat.0 Request processed in 209us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.959934:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9130 00000100:00100000:2.0:1746065127.960034:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.960047:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212416 00000100:00100000:2.0:1746065127.960050:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212416 00000100:00100000:2.0:1746065127.960063:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9131 00000100:00100000:2.0:1746065127.960067:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:29193:x1830881261212416:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.960073:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.960078:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5baa5 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.960095:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.960101:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baa5 expref: 268 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.960110:0:14643:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065127.960116:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baa5 expref: 268 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.960127:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.960129:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065127.960131:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baa5 expref: 268 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.960136:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133082a00, rc 0) 00000100:00100000:2.0:1746065127.960151:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:29193:x1830881261212416:12345-192.168.202.46@tcp:101:cat.0 Request processed in 83us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.960156:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9131 00010000:00010000:3.0:1746065127.961220:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065127.961229:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00000040:00080000:3.0:1746065127.961922:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2602, 88 off218800 00000004:00080000:3.0:1746065127.961930:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727253113851ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065127.961982:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2534, 88 off212632 00000004:00080000:3.0:1746065127.961988:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727253172121ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065127.962015:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2535, 88 off212720 00000004:00080000:3.0:1746065127.962018:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727253202351ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065127.962025:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2603, 88 off218888 00000004:00080000:3.0:1746065127.962027:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727253212144ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065127.962034:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2604, 88 off218976 00000004:00080000:3.0:1746065127.962037:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727253221259ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065127.962043:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2536, 88 off212808 00000004:00080000:3.0:1746065127.962046:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727253230548ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065127.962052:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2537, 88 off212896 00000004:00080000:3.0:1746065127.962054:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727253239074ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065127.962083:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2539, 88 off213080 00000004:00080000:3.0:1746065127.962086:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727253270713ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065127.962094:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2605, 88 off219064 00000004:00080000:3.0:1746065127.962097:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727253281258ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065127.962102:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2540, 88 off213168 00000004:00080000:3.0:1746065127.962105:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727253289591ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065127.962111:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2606, 88 off219152 00000004:00080000:3.0:1746065127.962113:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727253297654ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065127.962119:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2541, 88 off213256 00000004:00080000:3.0:1746065127.962121:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727253305734ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065127.962127:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2607, 88 off219240 00000004:00080000:3.0:1746065127.962129:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727253314126ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065127.962135:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2608, 88 off219328 00000004:00080000:3.0:1746065127.962138:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727253322988ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065127.962145:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2609, 88 off219416 00000004:00080000:3.0:1746065127.962147:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727253332063ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065127.962154:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2610, 88 off219504 00000004:00080000:3.0:1746065127.962156:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727253340761ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065127.962162:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2542, 88 off213344 00000004:00080000:3.0:1746065127.962164:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727253348683ns, next at 666938887344ns, rc = 0 00000100:00100000:1.0:1746065127.964102:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065127.964185:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212544 00000100:00100000:2.0:1746065127.964191:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212544 00000100:00100000:2.0:1746065127.964225:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9132 00000100:00100000:2.0:1746065127.964232:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+29:29198:x1830881261212544:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065127.964246:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065127.964260:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5baac expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.964308:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 30 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.964318:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 30 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.964327:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065127.964330:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065127.964333:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baa5 expref: 267 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065127.964339:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083800, rc 0) 00000100:00100000:2.0:1746065127.964371:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+30:29198:x1830881261212544:12345-192.168.202.46@tcp:101:cat.0 Request processed in 140us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065127.964376:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9132 00000100:00100000:1.0:1746065127.996450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065127.996879:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212800 00000100:00100000:0.0:1746065127.996888:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212800 00000100:00100000:1.0:1746065127.997044:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9133 00000100:00100000:1.0:1746065127.997051:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+30:29200:x1830881261212800:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065127.997064:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065127.997077:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc200/0x14b4f8542d4f43f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bab3 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065127.997149:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065127.997157:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065127.997163:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065127.997170:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065127.997173:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065127.997177:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000001:00080000:2.0:1746065128.000047:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943206 is committed 00000001:00080000:2.0:1746065128.000057:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943183 is committed 00000001:00080000:2.0:1746065128.000065:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943188 is committed 00000001:00080000:2.0:1746065128.000082:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943198 is committed 00000001:00080000:2.0:1746065128.000092:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943191 is committed 00000001:00080000:2.0:1746065128.000111:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943207 is committed 00000004:00080000:2.0:1746065128.000113:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1834 committed 00000004:00080000:2.0:1746065128.000119:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1903 committed 00000004:00080000:2.0:1746065128.000129:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1902 committed 00000004:00080000:2.0:1746065128.000130:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1901 committed 00000004:00080000:2.0:1746065128.000131:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1900 committed 00000004:00080000:2.0:1746065128.000133:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1833 committed 00000004:00080000:2.0:1746065128.000134:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1899 committed 00000004:00080000:2.0:1746065128.000135:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1832 committed 00000004:00080000:2.0:1746065128.000137:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1898 committed 00000004:00080000:2.0:1746065128.000138:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1831 committed 00000004:00080000:2.0:1746065128.000139:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1830 committed 00000004:00080000:2.0:1746065128.000141:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1829 committed 00000004:00080000:2.0:1746065128.000142:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1897 committed 00000004:00080000:2.0:1746065128.000143:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1896 committed 00000004:00080000:2.0:1746065128.000145:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1828 committed 00000004:00080000:2.0:1746065128.000146:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1827 committed 00000004:00080000:2.0:1746065128.000148:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1895 committed 00000001:00080000:2.0:1746065128.000158:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943204 is committed 00000004:00010000:2.0:1746065128.000195:0:16767:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880133089880 reply state ffff88012dc2ec00 transno 8589943207 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065128.000205:0:16767:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065128.000237:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259796992:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746065128.000285:0:16767:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065128.000300:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.000305:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29190:x1830881261211136:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 47552us (47742us total) trans 8589943207 rc 0/0 00000100:00100000:2.0:1746065128.000312:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9128 00000100:00100000:1.0:1746065128.000334:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259797504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.000335:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259796736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.000352:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.000370:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065128.000375:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259796864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.000388:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.000398:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259797376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.000409:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065128.000435:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065128.000447:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba4a expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.000453:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065128.000472:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba4a expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.000483:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba4a expref: 7 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065128.000491:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133088700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259797632:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065128.000518:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065128.000530:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259796992 00000100:00100000:1.0:1746065128.000536:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259796992 00000100:00100000:0.0:1746065128.000560:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259797504 00000100:00100000:0.0:1746065128.000564:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259797504 00000100:00100000:1.0:1746065128.000570:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259796864 00000100:00100000:1.0:1746065128.000572:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259796864 00000100:00100000:0.0:1746065128.000580:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259797376 00000100:00100000:0.0:1746065128.000582:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259797376 00000100:00100000:1.0:1746065128.000585:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11194 00000100:00100000:1.0:1746065128.000591:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881259796992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.000594:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11195 00000100:00100000:0.0:1746065128.000601:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881259797504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.000627:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013308ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259796608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.000633:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11196 00000100:00100000:1.0:1746065128.000636:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881259796864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.000646:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.000658:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259797120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.000669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.000677:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259797760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.000689:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.000695:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259798272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.000705:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259796608 00000100:00100000:3.0:1746065128.000706:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.000707:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259796608 00000100:00100000:3.0:1746065128.000713:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065128.000716:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259797888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.000717:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259797120 00000100:00100000:1.0:1746065128.000718:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259797120 00000100:00100000:1.0:1746065128.000724:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259797760 00000100:00100000:1.0:1746065128.000725:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259797760 00000100:00100000:3.0:1746065128.000726:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.000732:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259798400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.000733:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259798272 00000100:00100000:1.0:1746065128.000735:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259798272 00000100:00100000:1.0:1746065128.000740:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259797888 00000100:00100000:1.0:1746065128.000742:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259797888 00000100:00100000:3.0:1746065128.000743:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.000748:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259798400 00000100:00100000:1.0:1746065128.000750:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259798400 00000100:00100000:1.0:1746065128.000758:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11197 00000100:00100000:1.0:1746065128.000763:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3298:x1830881259797376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.000766:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3298:x1830881259797504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (412us total) trans 17179872908 rc 0/0 00000100:00100000:1.0:1746065128.000865:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3298:x1830881259797376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (454us total) trans 17179872910 rc 0/0 00000100:00100000:3.0:1746065128.000911:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11198 00000100:00100000:0.0:1746065128.000916:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11195 00000100:00100000:3.0:1746065128.000918:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881259796608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.000921:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11197 00000100:00100000:0.0:1746065128.000932:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11199 00000100:00100000:1.0:1746065128.000936:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11200 00000100:00100000:0.0:1746065128.000938:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3295:x1830881259797120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.000940:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881259797760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065128.001002:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065128.001004:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:3.0:1746065128.001006:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00002000:00010000:3.0:1746065128.001008:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:3.0:1746065128.001010:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00002000:00010000:0.0:1746065128.001010:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065128.001013:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.001015:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.001016:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.001017:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746065128.001026:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065128.001029:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00000100:00100000:3.0:1746065128.001031:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881259796608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (384us total) trans 17179872911 rc 0/0 00002000:00010000:1.0:1746065128.001031:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00002000:00010000:1.0:1746065128.001033:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00000100:00100000:0.0:1746065128.001033:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881259797120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (363us total) trans 17179872912 rc 0/0 00002000:00010000:1.0:1746065128.001035:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065128.001036:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11198 00000100:00100000:0.0:1746065128.001039:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11199 00000100:00100000:0.0:1746065128.001051:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11201 00000100:00100000:1.0:1746065128.001053:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881259797760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (363us total) trans 21474840124 rc 0/0 00000100:00100000:3.0:1746065128.001054:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11202 00000100:00100000:0.0:1746065128.001054:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881259798272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.001058:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881259797888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.001058:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11200 00000100:00100000:1.0:1746065128.001067:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11203 00000100:00100000:1.0:1746065128.001071:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881259798400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065128.001109:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065128.001111:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065128.001112:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.001113:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065128.001114:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:1.0:1746065128.001125:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3298:x1830881259796864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 487us (735us total) trans 17179872909 rc 0/0 00002000:00010000:3.0:1746065128.001127:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065128.001129:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065127 -> 1746065127 00002000:00010000:3.0:1746065128.001130:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00000100:00100000:1.0:1746065128.001130:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11196 00000100:00100000:0.0:1746065128.001131:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3295:x1830881259798272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (424us total) trans 21474840125 rc 0/0 00002000:00010000:3.0:1746065128.001132:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065127 -> 1746065127 00002000:00010000:3.0:1746065128.001133:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065128.001135:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11201 00000100:00080000:0.0:1746065128.001151:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065128.001152:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881259797888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (424us total) trans 21474840126 rc 0/0 00000100:00080000:0.0:1746065128.001154:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065128.001157:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11202 00000100:00100000:0.0:1746065128.001165:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259798016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.001184:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065128.001185:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001187:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00000004:00080000:3.0:1746065128.001189:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f469c00/2, rc 0, transno 21474840126 00002000:00010000:1.0:1746065128.001189:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001190:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001192:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065128.001193:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259797888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.001197:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259798528:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065128.001201:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013308ad80/2, rc 0, transno 17179872911 00000100:00100000:3.0:1746065128.001208:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259796608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.001210:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3298:x1830881259796992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 619us (910us total) trans 17179872913 rc 0/0 00000100:00100000:0.0:1746065128.001212:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065128.001214:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880133089f80/2, rc 0, transno 17179872912 00000100:00100000:1.0:1746065128.001214:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11194 00000100:00100000:3.0:1746065128.001216:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259797120:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065128.001221:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f469880/2, rc 0, transno 21474840124 00000100:00100000:1.0:1746065128.001222:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259798016 00000100:00100000:3.0:1746065128.001223:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259797760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.001224:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259798016 00000100:00100000:0.0:1746065128.001225:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000004:00080000:3.0:1746065128.001228:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46b800/2, rc 0, transno 21474840125 00000100:00100000:3.0:1746065128.001230:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259798272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.001230:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259798144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.001235:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259798528 00000100:00100000:1.0:1746065128.001237:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259798528 00000100:00100000:3.0:1746065128.001244:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11204 00000100:00100000:0.0:1746065128.001244:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.001247:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11205 00000100:00100000:3.0:1746065128.001249:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3297:x1830881259798016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.001251:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3297:x1830881259798528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.001254:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259798656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.001266:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065128.001277:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880133089180/2, rc 0, transno 17179872909 00000100:00100000:3.0:1746065128.001280:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259796864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.001280:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259798144 00000100:00100000:0.0:1746065128.001283:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259798144 00000004:00080000:3.0:1746065128.001286:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013308bb80/2, rc 0, transno 17179872910 00000100:00100000:3.0:1746065128.001297:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259797376:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065128.001304:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880133089c00/2, rc 0, transno 17179872913 00000100:00100000:3.0:1746065128.001306:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259796992:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065128.001310:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013308b100/2, rc 0, transno 17179872908 00000100:00100000:3.0:1746065128.001312:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013308b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259797504:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065128.001333:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001335:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001337:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001339:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001340:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065128.001360:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881259798528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (146us total) trans 21474840127 rc 0/0 00000100:00100000:1.0:1746065128.001365:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11205 00000100:00100000:1.0:1746065128.001372:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259798656 00000100:00100000:1.0:1746065128.001374:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259798656 00002000:00010000:3.0:1746065128.001376:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065128.001378:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:3.0:1746065128.001380:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:3.0:1746065128.001381:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:3.0:1746065128.001383:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746065128.001384:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11206 00000100:00100000:1.0:1746065128.001388:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881259798656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.001402:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881259798016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (216us total) trans 21474840128 rc 0/0 00000100:00100000:3.0:1746065128.001406:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11204 00000100:00100000:1.0:1746065128.001462:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881259798656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (194us total) trans 21474840129 rc 0/0 00000100:00100000:1.0:1746065128.001468:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11206 00010000:00010000:1.0:1746065128.001501:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.001508:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.001514:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00002000:00010000:1.0:1746065128.001564:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001566:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001567:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001568:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.001570:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065128.001587:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881259798400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 515us (843us total) trans 21474840130 rc 0/0 00010000:00010000:2.0:1746065128.001589:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065128.001592:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11203 00010000:00010000:2.0:1746065128.001596:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065128.001601:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065128.001606:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d172600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065128.001609:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065128.001615:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40218400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065128.001627:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.001629:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065128.001634:0:3282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baa5 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.001642:0:3282:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baa5 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.001653:0:3282:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baa5 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.001661:0:3282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.001667:0:3282:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.001672:0:3282:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.001689:0:3282:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.001697:0:3282:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830881259798912:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065128.001735:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11207 00000100:00100000:0.0:1746065128.001740:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881259798144:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065128.001750:0:3282:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baa5 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.001756:0:3282:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830881259799040:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065128.001772:0:3282:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.001787:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.001799:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259797248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.001828:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.001842:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065128.001843:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881259798144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (598us total) trans 21474840131 rc 0/0 00000100:00100000:2.0:1746065128.001846:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259798784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.001849:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11207 00000100:00100000:0.0:1746065128.001858:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259796736 00000100:00100000:0.0:1746065128.001860:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259796736 00000100:00100000:2.0:1746065128.001861:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065128.001870:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259797248 00000100:00100000:0.0:1746065128.001872:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259797248 00000100:00100000:2.0:1746065128.001878:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259798784 00000100:00100000:2.0:1746065128.001880:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259798784 00000100:00100000:0.0:1746065128.001880:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11208 00000100:00100000:0.0:1746065128.001884:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3296:x1830881259796736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.001894:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11209 00000100:00100000:2.0:1746065128.001898:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3296:x1830881259797248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065128.001951:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065128.001953:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.001955:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:0.0:1746065128.001957:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.001959:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746065128.001969:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065128.001971:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065128.001973:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065128.001975:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065128.001976:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065128.001980:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:3296:x1830881259796736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (192us total) trans 17179872914 rc 0/0 00000100:00100000:0.0:1746065128.001985:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11208 00000100:00100000:2.0:1746065128.001995:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3296:x1830881259797248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (180us total) trans 17179872915 rc 0/0 00000100:00100000:2.0:1746065128.002001:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11209 00000100:00100000:2.0:1746065128.002012:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11210 00000100:00100000:2.0:1746065128.002016:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3296:x1830881259798784:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065128.002092:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46a300/2, rc 0, transno 21474840131 00000100:00100000:0.0:1746065128.002097:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259798144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065128.002104:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9b8a80/2, rc 0, transno 21474840129 00000100:00100000:0.0:1746065128.002230:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259798656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065128.002238:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f468700/2, rc 0, transno 21474840128 00000100:00100000:0.0:1746065128.002240:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259798016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065128.002243:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9bbb80/2, rc 0, transno 21474840127 00000100:00100000:0.0:1746065128.002245:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259798528:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065128.002252:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f468000/2, rc 0, transno 21474840130 00000100:00100000:3.0:1746065128.002256:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259798400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065128.002488:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3296:x1830881259798784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 471us (625us total) trans 17179872916 rc 0/0 00000100:00100000:2.0:1746065128.002493:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11210 00000004:00080000:2.0:1746065128.002513:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095355c00/2, rc 0, transno 17179872916 00000100:00100000:2.0:1746065128.002516:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259798784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065128.002522:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880133088e00/2, rc 0, transno 17179872914 00000100:00100000:2.0:1746065128.002524:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259796736:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065128.002529:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880133088a80/2, rc 0, transno 17179872915 00000100:00100000:2.0:1746065128.002531:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259797248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.005147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.005195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.005347:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133088700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259797632:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065128.005367:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065128.005433:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212928 00000100:00100000:2.0:1746065128.005439:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212928 00000100:00100000:2.0:1746065128.005468:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9134 00000100:00100000:2.0:1746065128.005474:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29190:x1830881261212928:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065128.005493:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.005506:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5baba expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.005547:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baba expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.005558:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baba expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.005573:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.005576:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065128.005578:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133083e00, rc 0) 00000100:00100000:2.0:1746065128.005611:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29190:x1830881261212928:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 136us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.005616:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9134 00000100:00100000:1.0:1746065128.005837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.005882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.005897:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261213184 00000100:00100000:1.0:1746065128.005900:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261213184 00000100:00100000:1.0:1746065128.005923:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261213312 00000100:00100000:1.0:1746065128.005926:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261213312 00000100:00100000:1.0:1746065128.005937:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3748 00000100:00100000:1.0:1746065128.005941:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:29198:x1830881261213184:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:1.0:1746065128.005989:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+11:29198:x1830881261213184:12345-192.168.202.46@tcp:49:cat.0 Request processed in 47us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.005994:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3748 00000100:00100000:1.0:1746065128.006005:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3749 00000100:00100000:1.0:1746065128.006009:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29193:x1830881261213312:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:1.0:1746065128.006037:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29193:x1830881261213312:12345-192.168.202.46@tcp:49:cat.0 Request processed in 28us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.006041:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3749 00000100:00080000:1.0:1746065128.006054:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065128.006217:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261213056 00000100:00100000:3.0:1746065128.006220:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261213056 00010000:00010000:3.0:1746065128.006237:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba4a expref: 9 pid: 14644 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.006255:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5601 00000100:00100000:3.0:1746065128.006260:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261213056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.006267:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.006271:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba4a expref: 9 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.006280:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba4a expref: 9 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.006305:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f42ff lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba4a expref: 9 pid: 14644 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.006315:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.006319:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006326:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006331:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006336:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.006340:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.006344:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.006360:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.006378:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261213056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 118us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.006386:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5601 00010000:00010000:3.0:1746065128.006403:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006409:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065128.006420:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065128.006538:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006544:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006550:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006555:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0de200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.006558:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006564:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006570:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.006573:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065128.006575:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006579:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f4409 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006591:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006595:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006600:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006604:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801350fce00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.006606:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006610:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006617:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065128.006618:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.006621:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006625:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fce00/0x14b4f8542d4f43ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006634:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006638:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006643:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006646:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801350fd000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.006648:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006656:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006661:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715000) 00010000:00010000:3.0:1746065128.006663:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.006664:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006668:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fd000/0x14b4f8542d4f43d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065128.006707:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fcc00/0x14b4f8542d4f43c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba97 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.006714:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fcc00/0x14b4f8542d4f43c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba97 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.006720:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350fcc00, rc 0) 00000100:00100000:3.0:1746065128.006737:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29195:x1830881261211648:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 51397us (51735us total) trans 8589943208 rc 301/301 00000100:00100000:3.0:1746065128.006742:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9129 00000100:00100000:2.0:1746065128.007145:0:3282:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830881259798912:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065128.007153:0:3282:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830881259799040:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065128.007166:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065128.007171:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d172600/0x14b4f8542d4f43b5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065128.007592:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007598:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065128.007608:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065128.007661:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007667:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007672:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007675:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094614a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065128.007677:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007682:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007691:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065128.007693:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065128.007696:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007700:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4410 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007710:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007715:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007720:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007723:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801350fc000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065128.007725:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007729:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.007738:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065128.007740:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065128.007742:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.008074:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc000/0x14b4f8542d4f43fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.008084:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.008089:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.008093:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.008097:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801350fc400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065128.008099:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.008104:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.008111:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715000) 00010000:00010000:1.0:1746065128.008113:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065128.008115:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.008119:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f4402 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.008150:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc200/0x14b4f8542d4f43f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bab3 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.008156:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801350fc200/0x14b4f8542d4f43f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bab3 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.008162:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350fc200, rc 0) 00000100:00100000:1.0:1746065128.008196:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:29200:x1830881261212800:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11145us (11751us total) trans 8589943209 rc 301/301 00000100:00100000:1.0:1746065128.008203:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9133 00000100:00100000:0.0:1746065128.009692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.009923:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261213568 00000100:00100000:1.0:1746065128.009930:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261213568 00000100:00100000:1.0:1746065128.009960:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3750 00000100:00100000:1.0:1746065128.009966:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009badf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29190:x1830881261213568:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1746065128.010105:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009badf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29190:x1830881261213568:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 138us (417us total) trans 8589943210 rc 0/0 00000100:00100000:1.0:1746065128.010111:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3750 00000100:00100000:0.0:1746065128.011487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.011513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.014972:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261213824 00000100:00100000:3.0:1746065128.014982:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261213824 00000100:00100000:0.0:1746065128.015017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.015150:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261214080 00000100:00100000:3.0:1746065128.015151:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261214080 00000100:00100000:3.0:1746065128.015159:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261214336 00000100:00100000:3.0:1746065128.015160:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261214336 00000100:00100000:0.0:1746065128.015169:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.015170:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11211 00000100:00100000:3.0:1746065128.015175:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1961:x1830881261213824:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065128.015184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065128.015190:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.015201:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bac8 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.015206:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065128.015217:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.015218:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065128.015222:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261213696 00010000:00010000:3.0:1746065128.015223:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac8 expref: 19 pid: 8851 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065128.015225:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261213696 00010000:00010000:3.0:1746065128.015232:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac8 expref: 19 pid: 8851 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065128.015241:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261213952 00000100:00100000:0.0:1746065128.015243:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261213952 00010000:00010000:3.0:1746065128.015248:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133084c00, rc 0) 00000100:00100000:0.0:1746065128.015250:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261214208 00000100:00100000:0.0:1746065128.015251:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261214208 00000100:00100000:0.0:1746065128.015259:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11212 00000100:00100000:0.0:1746065128.015263:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261214080:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065128.015272:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065128.015278:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261213824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 104us (3796us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065128.015281:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bad6 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.015282:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11211 00000100:00100000:3.0:1746065128.015306:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11213 00010000:00010000:0.0:1746065128.015306:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.015307:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.015312:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bad6 expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065128.015313:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261214336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.015319:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.015321:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bad6 expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.015327:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bae4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.015328:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76a600, rc 0) 00010000:00010000:3.0:1746065128.015335:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.015336:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.015339:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bae4 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.015345:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bae4 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065128.015345:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261214080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 81us (3831us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065128.015351:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133084e00, rc 0) 00000100:00100000:0.0:1746065128.015351:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11212 00000100:00100000:0.0:1746065128.015362:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11214 00000100:00100000:3.0:1746065128.015365:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261214336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.015366:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261213696:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065128.015369:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11213 00010000:00010000:0.0:1746065128.015371:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.015377:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bac1 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.015378:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11215 00000100:00100000:3.0:1746065128.015382:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+19:1961:x1830881261213952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065128.015386:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.015387:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.015387:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.015391:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac1 expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.015392:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bacf expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.015398:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac1 expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.015400:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.015401:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.015405:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bacf expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.015408:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76bc00, rc 0) 00010000:00010000:3.0:1746065128.015412:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bacf expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.015418:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085000, rc 0) 00000100:00100000:0.0:1746065128.015421:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261213696:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.015426:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11214 00000100:00100000:3.0:1746065128.015432:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261213952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.015436:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11215 00000100:00100000:0.0:1746065128.015439:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11216 00000100:00100000:0.0:1746065128.015443:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261214208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065128.015448:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.015455:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5badd expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065128.015472:0:21235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6e8, atime: 0x6812d6e8, ctime: 0x6812d6e8, blocks: 0x16a9 00010000:00010000:0.0:1746065128.015479:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.015480:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.015484:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5badd expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.015493:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5badd expref: 28 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.015499:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76a400, rc 0) 00000100:00100000:0.0:1746065128.015514:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261214208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.015518:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11216 00000100:00100000:0.0:1746065128.020784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.020842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.020863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.020882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.020910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.020932:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261214976 00000100:00100000:3.0:1746065128.020940:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261214976 00000100:00100000:2.0:1746065128.020969:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261215360 00000100:00100000:2.0:1746065128.020973:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261215360 00002000:00100000:3.0:1746065128.020981:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f46a680 x1830881261214976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.020989:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46a680 with x1830881261214976 ext(0->1048575) 00002000:00100000:2.0:1746065128.020991:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f46aa00 x1830881261215360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746065128.020993:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46a680 00002000:00100000:2.0:1746065128.020999:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46aa00 with x1830881261215360 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.021002:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46aa00 00000100:00100000:3.0:1746065128.021004:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261215488 00000100:00100000:3.0:1746065128.021005:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261215488 00002000:00100000:3.0:1746065128.021011:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f468e00 x1830881261215488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065128.021014:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261215104 00002000:00100000:3.0:1746065128.021015:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468e00 with x1830881261215488 ext(1048576->2097151) 00000100:00100000:2.0:1746065128.021016:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261215104 00002000:00010000:3.0:1746065128.021017:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f468e00 00000100:00100000:3.0:1746065128.021024:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5154 00002000:00100000:2.0:1746065128.021027:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880133088700 x1830881261215104/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065128.021029:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261214976:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:2.0:1746065128.021033:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133088700 with x1830881261215104 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.021036:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133088700 00000100:00100000:2.0:1746065128.021046:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5155 00000100:00100000:2.0:1746065128.021050:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261215360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.021409:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5156 00000100:00100000:2.0:1746065128.021414:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261215488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065128.021963:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5157 00000100:00100000:3.0:1746065128.021969:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1961:x1830881261215104:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.022311:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261214592 00000100:00100000:2.0:1746065128.022316:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261214592 00000100:00100000:2.0:1746065128.022340:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3751 00000100:00100000:2.0:1746065128.022345:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29190:x1830881261214592:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:2.0:1746065128.022474:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29190:x1830881261214592:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 128us (1698us total) trans 8589943211 rc 0/0 00000100:00100000:2.0:1746065128.022480:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3751 00000100:00080000:3.0:1746065128.022883:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746065128.022886:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065128.032225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.032258:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261215872 00000100:00100000:1.0:1746065128.032264:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261215872 00000100:00100000:1.0:1746065128.032320:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9135 00000100:00100000:1.0:1746065128.032329:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29195:x1830881261215872:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065128.032350:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065128.032354:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065128.032378:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082a00/0x14b4f8542d4f43e6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baa5 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.032394:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065128.032399:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065128.032411:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f4456 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5baeb expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.032455:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.032467:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.032474:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baba expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.032479:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba9e expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.032484:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 6/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.032510:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba9e expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.032521:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba9e expref: 9 pid: 24350 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065128.032532:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095356d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259799168:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.033027:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baba expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.033036:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baba expref: 8 pid: 16767 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065128.033045:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095356680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259799296:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.033103:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.033111:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 9 pid: 24350 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065128.033337:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259799424:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065128.033387:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065128.038776:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095356d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259799168:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065128.039144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.040345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.040717:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261216000 00000100:00100000:3.0:1746065128.040725:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261216000 00010000:00010000:3.0:1746065128.040762:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba9e expref: 10 pid: 24350 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.040792:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261216128 00000100:00100000:3.0:1746065128.040794:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261216128 00010000:00010000:3.0:1746065128.040810:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baba expref: 9 pid: 16767 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.040849:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5602 00000100:00100000:3.0:1746065128.040855:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261216000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.040866:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.040871:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba9e expref: 10 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.040879:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba9e expref: 10 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.040895:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133082200/0x14b4f8542d4f43df lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba9e expref: 10 pid: 24350 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.041423:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5603 00000100:00100000:2.0:1746065128.041431:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881261216128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.041441:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.041446:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baba expref: 9 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.041455:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baba expref: 9 pid: 16767 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.041466:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.041470:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.041476:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.041481:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.041516:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881261216128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.041521:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5603 00010000:00010000:0.0:1746065128.042102:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083e00/0x14b4f8542d4f4417 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baba expref: 8 pid: 16767 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.042121:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095356680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259799296:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.042826:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.042832:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.042839:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.042844:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.042887:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261216000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2031us (3743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.042895:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5602 00000100:00100000:0.0:1746065128.048003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.048036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.048065:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261216512 00000100:00100000:0.0:1746065128.048068:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.048073:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261216512 00002000:00100000:1.0:1746065128.048112:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88013308a300 x1830881261216512/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065128.048121:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013308a300 with x1830881261216512 ext(0->1048575) 00002000:00010000:1.0:1746065128.048126:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013308a300 00000100:00100000:0.0:1746065128.048197:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.048341:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261216640 00000100:00100000:2.0:1746065128.048342:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261217024 00000100:00100000:1.0:1746065128.048345:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261216640 00000100:00100000:3.0:1746065128.048346:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261216896 00000100:00100000:2.0:1746065128.048347:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261217024 00000100:00100000:3.0:1746065128.048350:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261216896 00000100:00100000:0.0:1746065128.048353:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5158 00002000:00100000:1.0:1746065128.048358:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880133089500 x1830881261216640/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065128.048360:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261216512:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065128.048366:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880133088380 x1830881261216896/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065128.048366:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133089500 with x1830881261216640 ext(1048576->2097151) 00002000:00100000:2.0:1746065128.048367:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88013308b480 x1830881261217024/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746065128.048369:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133089500 00002000:00100000:3.0:1746065128.048373:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133088380 with x1830881261216896 ext(1048576->2097151) 00002000:00100000:2.0:1746065128.048374:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013308b480 with x1830881261217024 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.048376:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133088380 00002000:00010000:2.0:1746065128.048378:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013308b480 00000100:00100000:1.0:1746065128.048383:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5159 00000100:00100000:3.0:1746065128.048387:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5160 00000100:00100000:1.0:1746065128.048388:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261216640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065128.048392:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261216896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.048396:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5161 00000100:00100000:2.0:1746065128.048401:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261217024:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065128.049926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.050436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.050682:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259799424:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065128.050716:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:1.0:1746065128.050794:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261217408 00000100:00100000:1.0:1746065128.050798:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261217408 00000100:00100000:1.0:1746065128.050855:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9136 00000100:00100000:1.0:1746065128.050861:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:29200:x1830881261217408:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065128.050878:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065128.050891:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f4464 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5baf2 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.050930:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065128.050938:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.050944:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065128.050956:0:14643:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.050962:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:2.0:1746065128.051995:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1960:x1830881261214976:12345-192.168.202.46@tcp:3:cat.0 Request processed in 30961us (31148us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.052004:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5154 00002000:00100000:2.0:1746065128.052012:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009f46a680 x1830881261214976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.052020:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46a680 with x1830881261214976 ext(0->1048575) 00002000:00010000:2.0:1746065128.052024:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46a680 00000100:00100000:3.0:1746065128.052452:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261217536 00000100:00100000:3.0:1746065128.052457:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261217536 00010000:00010000:3.0:1746065128.052475:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 11 pid: 24350 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.052494:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5604 00000100:00100000:3.0:1746065128.052499:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261217536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.052507:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.052511:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 11 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.052520:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 11 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.052534:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133083800/0x14b4f8542d4f43ed lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baac expref: 11 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.052650:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.052655:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.052662:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.052667:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.052673:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.052678:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.052690:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.052707:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261217536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 208us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.052713:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5604 00010000:00010000:3.0:1746065128.052727:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.052732:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00000040:00080000:3.0:1746065128.053303:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2611, 88 off219592 00000004:00080000:3.0:1746065128.053310:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727344494462ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.053569:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2543, 88 off213432 00000004:00080000:3.0:1746065128.053575:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727344759480ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.053620:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2544, 88 off213520 00000004:00080000:3.0:1746065128.053624:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727344808262ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.053637:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2612, 88 off219680 00000004:00080000:3.0:1746065128.053640:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727344824281ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.053646:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2613, 88 off219768 00000004:00080000:3.0:1746065128.053649:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727344834012ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.053656:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2545, 88 off213608 00000004:00080000:3.0:1746065128.053659:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727344843509ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.053670:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2546, 88 off213696 00000004:00080000:3.0:1746065128.053673:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727344857639ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.053683:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2547, 88 off213784 00000004:00080000:3.0:1746065128.053686:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727344870729ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.053696:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2614, 88 off219856 00000004:00080000:3.0:1746065128.053699:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727344883876ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.053706:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2548, 88 off213872 00000004:00080000:3.0:1746065128.053708:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727344892872ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.053719:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2615, 88 off219944 00000004:00080000:3.0:1746065128.053721:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727344905996ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.053728:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2549, 88 off213960 00000004:00080000:3.0:1746065128.053730:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727344915162ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.053740:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2616, 88 off220032 00000004:00080000:3.0:1746065128.053743:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727344927707ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.053749:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2617, 88 off220120 00000004:00080000:3.0:1746065128.053752:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727344936369ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.053758:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2618, 88 off220208 00000004:00080000:3.0:1746065128.053761:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727344945364ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.053767:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2619, 88 off220296 00000004:00080000:3.0:1746065128.053770:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727344954442ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.053776:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2550, 88 off214048 00000004:00080000:3.0:1746065128.053778:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727344962950ns, next at 666938887344ns, rc = 0 00000100:00100000:2.0:1746065128.054377:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261215488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 32115us (32645us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.054386:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5156 00002000:00100000:2.0:1746065128.054394:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f468e00 x1830881261215488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.054403:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468e00 with x1830881261215488 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.054407:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f468e00 00000100:00100000:0.0:1746065128.058133:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881261215104:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36155us (37212us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065128.058143:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5157 00002000:00100000:0.0:1746065128.058152:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880133088700 x1830881261215104/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.058160:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133088700 with x1830881261215104 ext(1048576->2097151) 00002000:00010000:0.0:1746065128.058166:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133088700 00000100:00100000:0.0:1746065128.058393:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261215360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 37341us (37528us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065128.058399:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5155 00002000:00100000:0.0:1746065128.058404:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f46aa00 x1830881261215360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.058411:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46aa00 with x1830881261215360 ext(1048576->2097151) 00002000:00010000:0.0:1746065128.058414:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46aa00 00000100:00100000:0.0:1746065128.063625:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881261216512:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15257us (15623us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065128.063635:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5158 00002000:00100000:0.0:1746065128.063645:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88013308a300 x1830881261216512/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.063654:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013308a300 with x1830881261216512 ext(0->1048575) 00002000:00010000:0.0:1746065128.063659:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013308a300 00000100:00100000:1.0:1746065128.067103:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261217024:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18695us (19027us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065128.067112:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5161 00002000:00100000:1.0:1746065128.067122:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88013308b480 x1830881261217024/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065128.067136:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013308b480 with x1830881261217024 ext(1048576->2097151) 00002000:00010000:1.0:1746065128.067141:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013308b480 00000100:00100000:1.0:1746065128.074064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.074090:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261217664 00000100:00100000:1.0:1746065128.074097:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261217664 00000100:00100000:1.0:1746065128.074145:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9137 00000100:00100000:1.0:1746065128.074152:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29193:x1830881261217664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065128.074169:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065128.074184:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5baf9 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.074229:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065128.074236:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.074251:0:14644:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065128.074261:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.074272:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065128.074275:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065128.074277:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065128.074299:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcebc00, rc 0) 00000100:00100000:1.0:1746065128.074336:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29193:x1830881261217664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 183us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.074341:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9137 00000100:00100000:3.0:1746065128.075350:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261216896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26955us (27151us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.075358:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5160 00002000:00100000:3.0:1746065128.075365:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff880133088380 x1830881261216896/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.075374:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133088380 with x1830881261216896 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.075378:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133088380 00000100:00100000:1.0:1746065128.075801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.076310:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261217792 00000100:00100000:0.0:1746065128.076316:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261217792 00000100:00100000:0.0:1746065128.076356:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9138 00000100:00100000:0.0:1746065128.076553:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:29198:x1830881261217792:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065128.076565:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.076577:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb00 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.076615:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.076624:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.076634:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065128.076637:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065128.076639:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065128.076644:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76aa00, rc 0) 00000100:00100000:0.0:1746065128.076672:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75065d94-a855-40b7-bd64-6d6f17292955+11:29198:x1830881261217792:12345-192.168.202.46@tcp:101:cat.0 Request processed in 122us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.076676:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9138 00000100:00100000:0.0:1746065128.077326:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261216640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28936us (29288us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065128.077331:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5159 00002000:00100000:0.0:1746065128.077337:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880133089500 x1830881261216640/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.077344:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133089500 with x1830881261216640 ext(1048576->2097151) 00002000:00010000:0.0:1746065128.077348:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133089500 00000001:00080000:2.0:1746065128.091553:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943210 is committed 00000001:00080000:2.0:1746065128.091565:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943209 is committed 00000001:00080000:2.0:1746065128.091572:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943211 is committed 00000001:00080000:2.0:1746065128.091579:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943212 is committed 00000004:00080000:2.0:1746065128.091583:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1842 committed 00000004:00080000:2.0:1746065128.091587:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1912 committed 00000100:00100000:3.0:1746065128.091767:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259799936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.091830:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.091865:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259800448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.091881:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.091901:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065128.091906:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259799552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.091919:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065128.091952:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259799680:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065128.092008:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1911 committed 00000004:00080000:2.0:1746065128.092011:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1910 committed 00000004:00080000:2.0:1746065128.092012:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1909 committed 00000004:00080000:2.0:1746065128.092014:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1841 committed 00000004:00080000:2.0:1746065128.092016:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1908 committed 00000004:00080000:2.0:1746065128.092017:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1840 committed 00000004:00080000:2.0:1746065128.092018:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1907 committed 00000004:00080000:2.0:1746065128.092020:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1839 committed 00000004:00080000:2.0:1746065128.092022:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1838 committed 00000004:00080000:2.0:1746065128.092023:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1837 committed 00000004:00080000:2.0:1746065128.092025:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1906 committed 00000004:00080000:2.0:1746065128.092026:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1905 committed 00000004:00080000:2.0:1746065128.092027:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1836 committed 00000004:00080000:2.0:1746065128.092029:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1835 committed 00000004:00080000:2.0:1746065128.092033:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1904 committed 00000100:00100000:0.0:1746065128.092168:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259800576:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.092441:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259799936 00000100:00100000:2.0:1746065128.092446:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259799936 00000100:00100000:2.0:1746065128.092476:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259800448 00000100:00100000:2.0:1746065128.092478:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259800448 00000100:00100000:2.0:1746065128.092486:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259799552 00000100:00100000:2.0:1746065128.092488:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259799552 00000100:00100000:0.0:1746065128.092557:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.092593:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259800064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.092613:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259799808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.092706:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259800192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.092720:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.092746:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259799680 00000100:00100000:2.0:1746065128.092748:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259799680 00000100:00100000:2.0:1746065128.092765:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11217 00000100:00100000:2.0:1746065128.092771:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3295:x1830881259799936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065128.092933:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881259799936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (1118us total) trans 21474840132 rc 0/0 00000100:00100000:2.0:1746065128.092938:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11217 00000100:00100000:2.0:1746065128.092948:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11218 00000100:00100000:2.0:1746065128.092952:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3295:x1830881259800448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065128.093008:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881259800448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1126us total) trans 21474840133 rc 0/0 00000100:00100000:2.0:1746065128.093012:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11218 00000100:00100000:2.0:1746065128.093019:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11219 00000100:00100000:2.0:1746065128.093022:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3295:x1830881259799552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065128.093073:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065128.093076:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:2.0:1746065128.093078:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00002000:00010000:2.0:1746065128.093080:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:2.0:1746065128.093081:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065128.093095:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881259799552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1175us total) trans 21474840134 rc 0/0 00000100:00100000:2.0:1746065128.093099:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11219 00000100:00100000:2.0:1746065128.093105:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11220 00000100:00100000:2.0:1746065128.093108:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3297:x1830881259799680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065128.093155:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065128.093157:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065127 -> 1746065127 00002000:00010000:2.0:1746065128.093159:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:2.0:1746065128.093161:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065127 -> 1746065127 00002000:00010000:2.0:1746065128.093162:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746065128.093175:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3297:x1830881259799680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (618us total) trans 21474840135 rc 0/0 00000100:00100000:2.0:1746065128.093178:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11220 00010000:00010000:2.0:1746065128.093220:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.093229:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.093231:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065128.093234:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.093240:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.093249:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.093269:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.093279:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 250 pid: 24350 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.093300:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259801600:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.093342:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.093888:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259800704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.093907:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065128.093917:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259801216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.093927:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065128.093945:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9b8000/2, rc 0, transno 21474840135 00000100:00100000:0.0:1746065128.093949:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259799680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.093962:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259800192 00000100:00100000:0.0:1746065128.093964:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259800192 00000100:00100000:0.0:1746065128.093977:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259800704 00000100:00100000:0.0:1746065128.093978:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259800704 00000100:00100000:0.0:1746065128.093985:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259801216 00000100:00100000:0.0:1746065128.093986:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259801216 00000100:00100000:0.0:1746065128.093993:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11221 00000100:00100000:0.0:1746065128.093997:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3297:x1830881259800192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065128.094071:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065128.094073:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.094075:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.094076:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.094078:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065128.094095:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3297:x1830881259800192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (1374us total) trans 21474840136 rc 0/0 00000100:00100000:0.0:1746065128.094099:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11221 00000100:00100000:0.0:1746065128.094110:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11222 00000100:00100000:0.0:1746065128.094114:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:3297:x1830881259800704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065128.094182:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065128.094184:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.094185:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:0.0:1746065128.094187:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.094189:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065128.094203:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3297:x1830881259800704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (295us total) trans 17179872917 rc 0/0 00000100:00100000:0.0:1746065128.094207:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11222 00000100:00100000:0.0:1746065128.094214:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11223 00000100:00100000:0.0:1746065128.094217:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:3297:x1830881259801216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065128.094263:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065128.094264:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.094266:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.094267:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.094268:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065128.094281:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3297:x1830881259801216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (352us total) trans 17179872918 rc 0/0 00000100:00100000:0.0:1746065128.094284:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11223 00000100:00100000:3.0:1746065128.094907:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065128.094932:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9b8e00/2, rc 0, transno 21474840132 00000100:00100000:3.0:1746065128.094935:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259799936:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065128.094942:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9b9180/2, rc 0, transno 21474840133 00000100:00100000:3.0:1746065128.094945:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259800448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.094952:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259800960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.094968:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.094977:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259801472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.094987:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065128.094995:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9baa00/2, rc 0, transno 21474840134 00000100:00100000:3.0:1746065128.094997:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259799552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.095008:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.095016:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259800320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.095026:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.095032:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259800832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.095041:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.095046:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259801344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.095055:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.095069:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259800064 00000100:00100000:3.0:1746065128.095072:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259800064 00000100:00100000:3.0:1746065128.095083:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259800960 00000100:00100000:3.0:1746065128.095084:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259800960 00000100:00100000:3.0:1746065128.095089:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259801472 00000100:00100000:3.0:1746065128.095090:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259801472 00000100:00100000:3.0:1746065128.095100:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259799808 00000100:00100000:3.0:1746065128.095101:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259799808 00000100:00100000:3.0:1746065128.095106:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259800320 00000100:00100000:3.0:1746065128.095107:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259800320 00000100:00100000:3.0:1746065128.095111:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259800832 00000100:00100000:3.0:1746065128.095112:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259800832 00000100:00100000:3.0:1746065128.095116:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259801344 00000100:00100000:3.0:1746065128.095118:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259801344 00000100:00100000:3.0:1746065128.095123:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11224 00000100:00100000:3.0:1746065128.095127:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3295:x1830881259800064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065128.095198:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:3.0:1746065128.095200:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065128.095202:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.095203:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065128.095205:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:3.0:1746065128.095222:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3295:x1830881259800064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (316us total) trans 21474840137 rc 0/0 00000100:00100000:3.0:1746065128.095226:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11224 00000100:00100000:3.0:1746065128.095234:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11225 00000100:00100000:3.0:1746065128.095238:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3295:x1830881259800960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065128.095285:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065128.095298:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.095300:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.095302:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.095303:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065128.095317:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881259800960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (347us total) trans 17179872919 rc 0/0 00000100:00100000:3.0:1746065128.095321:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11225 00000100:00100000:3.0:1746065128.095328:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11226 00000100:00100000:3.0:1746065128.095332:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3295:x1830881259801472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.095390:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881259801472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (401us total) trans 17179872920 rc 0/0 00000100:00100000:3.0:1746065128.095394:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11226 00000100:00100000:3.0:1746065128.095402:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11227 00000100:00100000:3.0:1746065128.095406:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3298:x1830881259799808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.095616:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11228 00000100:00100000:0.0:1746065128.095621:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3298:x1830881259800320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065128.095672:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065128.095674:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.095675:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.095677:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.095679:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065128.095698:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3298:x1830881259800320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (670us total) trans 21474840139 rc 0/0 00000100:00100000:0.0:1746065128.095701:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11228 00000100:00100000:0.0:1746065128.095708:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11229 00000100:00100000:0.0:1746065128.095711:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3298:x1830881259800832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065128.095799:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:0.0:1746065128.095802:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.095803:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.095805:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.095807:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5801 -> 5801 00000100:00100000:0.0:1746065128.095834:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3298:x1830881259800832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (791us total) trans 17179872921 rc 0/0 00000100:00100000:0.0:1746065128.095837:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11229 00000100:00100000:0.0:1746065128.095844:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11230 00000100:00100000:0.0:1746065128.095847:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3298:x1830881259801344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.095906:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3298:x1830881259801344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (850us total) trans 17179872922 rc 0/0 00000100:00100000:0.0:1746065128.095910:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11230 00000100:00100000:0.0:1746065128.095930:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065128.095942:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259801088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.095958:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065128.095976:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259800576 00000100:00100000:0.0:1746065128.095979:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259800576 00000100:00100000:0.0:1746065128.095991:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259801088 00000100:00100000:0.0:1746065128.095993:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259801088 00000100:00100000:0.0:1746065128.096000:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11231 00000100:00100000:0.0:1746065128.096004:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3296:x1830881259800576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065128.096065:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065128.096068:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.096070:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.096071:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:0.0:1746065128.096073:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:0.0:1746065128.096091:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3296:x1830881259800576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (161us total) trans 17179872923 rc 0/0 00000100:00100000:0.0:1746065128.096096:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11231 00000100:00100000:0.0:1746065128.096104:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11232 00000100:00100000:0.0:1746065128.096107:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3296:x1830881259801088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065128.096157:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065128.096159:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.096160:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.096161:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.096162:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065128.096178:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3296:x1830881259801088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (220us total) trans 17179872924 rc 0/0 00000100:00100000:0.0:1746065128.096183:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11232 00000004:00080000:0.0:1746065128.096204:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095355500/2, rc 0, transno 17179872923 00000100:00100000:0.0:1746065128.096211:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259800576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065128.096218:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095356d80/2, rc 0, transno 17179872924 00000100:00100000:0.0:1746065128.096220:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259801088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.097330:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259801600:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.097362:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f4456 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 250 pid: 24350 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065128.097379:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 249 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.097387:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 249 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.097410:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094614e00, rc 0) 00000100:00100000:2.0:1746065128.097441:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29195:x1830881261215872:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 65114us (65229us total) trans 8589943212 rc 0/0 00000100:00100000:2.0:1746065128.097447:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9135 00002000:00010000:3.0:1746065128.097577:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065128.097580:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:3.0:1746065128.097582:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:3.0:1746065128.097584:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:3.0:1746065128.097585:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000004:00080000:3.0:1746065128.097629:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095356680/2, rc 0, transno 17179872919 00000100:00100000:3.0:1746065128.097633:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259800960:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065128.097640:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90afb80/2, rc 0, transno 17179872920 00000100:00100000:3.0:1746065128.097642:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259801472:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065128.097651:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9b9f80/2, rc 0, transno 21474840137 00000100:00100000:3.0:1746065128.097660:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259800064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.097684:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3298:x1830881259799808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2277us (2675us total) trans 21474840138 rc 0/0 00000100:00100000:3.0:1746065128.097689:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11227 00000004:00080000:1.0:1746065128.097858:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9ba680/2, rc 0, transno 21474840138 00000100:00100000:1.0:1746065128.097862:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259799808:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065128.097868:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9bad80/2, rc 0, transno 21474840139 00000100:00100000:1.0:1746065128.097871:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259800320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065128.097878:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095354380/2, rc 0, transno 17179872921 00000100:00100000:1.0:1746065128.097880:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259800832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065128.097886:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90ac000/2, rc 0, transno 17179872922 00000100:00100000:1.0:1746065128.097888:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259801344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.099866:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259801728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.099909:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065128.099923:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259801728 00000100:00100000:0.0:1746065128.099930:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259801728 00000100:00100000:0.0:1746065128.099955:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11233 00000100:00100000:0.0:1746065128.099961:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3296:x1830881259801728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.100131:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3296:x1830881259801728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (222us total) trans 17179872925 rc 0/0 00000100:00100000:0.0:1746065128.100137:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11233 00000004:00080000:0.0:1746065128.100171:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095355880/2, rc 0, transno 17179872917 00000100:00100000:0.0:1746065128.100175:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259800704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065128.100183:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095354700/2, rc 0, transno 17179872918 00000100:00100000:0.0:1746065128.100185:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259801216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065128.100194:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9ba300/2, rc 0, transno 21474840136 00000100:00100000:0.0:1746065128.100197:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259800192:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065128.100362:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90ae680/2, rc 0, transno 17179872925 00000100:00100000:1.0:1746065128.100366:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259801728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.103385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.103434:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261217920 00000100:00100000:0.0:1746065128.103441:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261217920 00010000:00010000:0.0:1746065128.103469:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 249 pid: 24350 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.103498:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5605 00000100:00100000:0.0:1746065128.103505:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:1960:x1830881261217920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.103516:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.103520:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 249 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.103530:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 249 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.103547:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614e00/0x14b4f8542d4f445d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baeb expref: 249 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.103561:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065128.103565:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065128.103573:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065128.103582:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065128.103588:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 248 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.103612:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065128.103641:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:1960:x1830881261217920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 137us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.103646:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5605 00010000:00010000:1.0:1746065128.103721:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065128.103727:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00000040:00080000:1.0:1746065128.104763:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2620, 88 off220384 00000004:00080000:1.0:1746065128.104768:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727395952503ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065128.105629:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2551, 88 off214136 00000004:00080000:1.0:1746065128.105634:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727396818678ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065128.105657:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2552, 88 off214224 00000004:00080000:1.0:1746065128.105660:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727396844504ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065128.105667:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2621, 88 off220472 00000004:00080000:1.0:1746065128.105669:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727396854168ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065128.105685:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2622, 88 off220560 00000004:00080000:1.0:1746065128.105687:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727396871980ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065128.105711:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2553, 88 off214312 00000004:00080000:1.0:1746065128.105714:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727396898568ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065128.105723:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2554, 88 off214400 00000004:00080000:1.0:1746065128.105726:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727396910534ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065128.105733:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2555, 88 off214488 00000004:00080000:1.0:1746065128.105735:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727396920220ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065128.105743:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2623, 88 off220648 00000004:00080000:1.0:1746065128.105745:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727396929380ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065128.105751:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2556, 88 off214576 00000004:00080000:1.0:1746065128.105755:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727396939505ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065128.105762:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2624, 88 off220736 00000004:00080000:1.0:1746065128.105764:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727396948769ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065128.105771:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2557, 88 off214664 00000004:00080000:1.0:1746065128.105773:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727396957739ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065128.105780:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2625, 88 off220824 00000004:00080000:1.0:1746065128.105782:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727396967135ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065128.105789:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2626, 88 off220912 00000004:00080000:1.0:1746065128.105791:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727396976213ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065128.105799:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2627, 88 off221000 00000004:00080000:1.0:1746065128.105802:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727396986464ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065128.105809:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2628, 88 off221088 00000004:00080000:1.0:1746065128.105811:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 727396995859ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065128.105832:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2558, 88 off214752 00000004:00080000:1.0:1746065128.105834:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727397018743ns, next at 666938887344ns, rc = 0 00000001:00080000:3.0:1746065128.125481:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943213 is committed 00000004:00080000:3.0:1746065128.125490:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1850 committed 00000004:00080000:3.0:1746065128.125497:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1921 committed 00000004:00080000:3.0:1746065128.125502:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1920 committed 00000004:00080000:3.0:1746065128.125504:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1919 committed 00000004:00080000:3.0:1746065128.125505:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1918 committed 00000004:00080000:3.0:1746065128.125506:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1849 committed 00000004:00080000:3.0:1746065128.125508:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1917 committed 00000004:00080000:3.0:1746065128.125509:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1848 committed 00000004:00080000:3.0:1746065128.125511:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1916 committed 00000004:00080000:3.0:1746065128.125513:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1847 committed 00000004:00080000:3.0:1746065128.125514:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1846 committed 00000004:00080000:3.0:1746065128.125515:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1845 committed 00000004:00080000:3.0:1746065128.125516:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1915 committed 00000004:00080000:3.0:1746065128.125518:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1914 committed 00000004:00080000:3.0:1746065128.125519:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1844 committed 00000004:00080000:3.0:1746065128.125520:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1843 committed 00000004:00080000:3.0:1746065128.125521:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1913 committed 00000100:00100000:1.0:1746065128.125634:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259801984:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746065128.125637:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.125649:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065128.125653:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065128.125657:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 247 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.125666:0:14643:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 247 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.125673:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 247 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.125679:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.125683:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065128.125686:0:14643:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.125692:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.125714:0:14643:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.125723:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259803008:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065128.125724:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259802496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.125738:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.125752:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259803136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.125764:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065128.125775:0:14643:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 247 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.125777:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259803648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.125783:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259804032:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065128.125785:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259801856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.125789:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065128.125801:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.125811:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259802112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.126230:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259802240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.126248:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.126317:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259802752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.126329:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.126363:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259803392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.126365:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259801984 00000100:00100000:3.0:1746065128.126371:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259801984 00000100:00100000:1.0:1746065128.126376:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.126386:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259803904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.126396:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.126400:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259802496 00000100:00100000:3.0:1746065128.126404:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259802496 00000100:00100000:3.0:1746065128.126413:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259803136 00000100:00100000:3.0:1746065128.126415:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259803136 00000100:00100000:1.0:1746065128.126416:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259803648 00000100:00100000:1.0:1746065128.126419:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259803648 00000100:00100000:3.0:1746065128.126422:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259802240 00000100:00100000:3.0:1746065128.126423:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259802240 00000100:00100000:3.0:1746065128.126429:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259802752 00000100:00100000:3.0:1746065128.126430:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259802752 00000100:00100000:1.0:1746065128.126431:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259803392 00000100:00100000:1.0:1746065128.126433:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259803392 00000100:00100000:3.0:1746065128.126435:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259803904 00000100:00100000:3.0:1746065128.126436:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259803904 00000100:00100000:1.0:1746065128.126442:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11234 00000100:00100000:1.0:1746065128.126448:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3298:x1830881259801984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065128.126582:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065128.126585:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065128.126587:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065128.126589:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065128.126591:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065128.126596:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11235 00000100:00100000:3.0:1746065128.126602:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3298:x1830881259802496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.126617:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3298:x1830881259801984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (934us total) trans 21474840140 rc 0/0 00000100:00100000:1.0:1746065128.126623:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11234 00000100:00100000:1.0:1746065128.126636:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11236 00000100:00100000:1.0:1746065128.126640:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:3298:x1830881259803136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065128.126675:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065128.126678:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.126679:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.126681:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.126682:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746065128.126722:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065128.126724:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:1.0:1746065128.126726:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:1.0:1746065128.126728:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:1.0:1746065128.126729:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065128.126834:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3298:x1830881259802496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (1094us total) trans 21474840141 rc 0/0 00000100:00100000:1.0:1746065128.126834:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:3298:x1830881259803136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (1067us total) trans 17179872926 rc 0/0 00000100:00100000:1.0:1746065128.126839:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11236 00000100:00100000:1.0:1746065128.126848:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11237 00000100:00100000:1.0:1746065128.126853:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3296:x1830881259802240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.126888:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11238 00000100:00100000:2.0:1746065128.126895:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11239 00000100:00100000:0.0:1746065128.126897:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3298:x1830881259803648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.126903:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3296:x1830881259802752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.126930:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3296:x1830881259802240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (681us total) trans 21474840142 rc 0/0 00000100:00100000:1.0:1746065128.126935:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11237 00000100:00100000:1.0:1746065128.126945:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11240 00000100:00100000:1.0:1746065128.126949:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:3296:x1830881259803392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065128.126971:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065128.126974:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.126975:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.126977:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.126979:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065128.126982:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3296:x1830881259802752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (651us total) trans 21474840143 rc 0/0 00000100:00100000:2.0:1746065128.126987:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11239 00000100:00100000:2.0:1746065128.126996:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11241 00000100:00100000:0.0:1746065128.127000:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3298:x1830881259803648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (1209us total) trans 17179872927 rc 0/0 00000100:00100000:2.0:1746065128.127001:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3296:x1830881259803904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.127005:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11238 00002000:00010000:1.0:1746065128.127006:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065128.127008:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.127010:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.127011:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.127013:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065128.127032:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:3296:x1830881259803392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (653us total) trans 17179872928 rc 0/0 00000100:00100000:1.0:1746065128.127037:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11240 00000100:00100000:3.0:1746065128.127066:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11235 00000100:00100000:2.0:1746065128.127069:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3296:x1830881259803904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (671us total) trans 17179872929 rc 0/0 00000100:00100000:2.0:1746065128.127074:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11241 00000100:00100000:3.0:1746065128.127084:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.127098:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259802624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065128.127098:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259802112 00000100:00100000:2.0:1746065128.127100:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259802112 00000100:00100000:3.0:1746065128.127114:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.127114:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11242 00000100:00100000:2.0:1746065128.127119:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881259802112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.127123:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259803264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.127131:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259802624 00000100:00100000:1.0:1746065128.127134:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259802624 00000100:00100000:3.0:1746065128.127135:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.127144:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259803776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.127146:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259803264 00000100:00100000:1.0:1746065128.127148:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259803264 00000100:00100000:3.0:1746065128.127154:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.127156:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11243 00000100:00100000:1.0:1746065128.127159:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3295:x1830881259802624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.127172:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259803776 00000100:00100000:3.0:1746065128.127175:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259803776 00000100:00100000:3.0:1746065128.127187:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11244 00000100:00100000:3.0:1746065128.127191:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3295:x1830881259803264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065128.127218:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065128.127220:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.127222:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.127223:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.127224:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065128.127245:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3295:x1830881259802624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (130us total) trans 21474840144 rc 0/0 00000100:00100000:1.0:1746065128.127250:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11243 00000100:00100000:1.0:1746065128.127258:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11245 00002000:00010000:3.0:1746065128.127259:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:3.0:1746065128.127261:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00000100:00100000:1.0:1746065128.127262:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3295:x1830881259803776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065128.127263:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00002000:00010000:3.0:1746065128.127264:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:3.0:1746065128.127265:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5801 -> 5801 00000100:00100000:3.0:1746065128.127284:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3295:x1830881259803264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (148us total) trans 17179872930 rc 0/0 00000100:00100000:3.0:1746065128.127308:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11244 00000004:00080000:3.0:1746065128.127336:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cdf80/2, rc 0, transno 21474840144 00000100:00100000:3.0:1746065128.127340:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259802624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.127346:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3295:x1830881259803776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (190us total) trans 17179872931 rc 0/0 00000004:00080000:3.0:1746065128.127348:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cf800/2, rc 0, transno 17179872930 00000100:00100000:1.0:1746065128.127351:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11245 00000100:00100000:3.0:1746065128.127355:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259803264:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065128.127362:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cd500/2, rc 0, transno 17179872931 00000100:00100000:3.0:1746065128.127364:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259803776:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065128.127418:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130446a00/2, rc 0, transno 21474840142 00000100:00100000:1.0:1746065128.127422:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259802240:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065128.127428:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cea00/2, rc 0, transno 21474840143 00000100:00100000:1.0:1746065128.127431:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259802752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065128.127533:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cd880/2, rc 0, transno 17179872928 00000100:00100000:1.0:1746065128.127537:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259803392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065128.127545:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cc700/2, rc 0, transno 17179872929 00000100:00100000:1.0:1746065128.127547:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259803904:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065128.127562:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cf480/2, rc 0, transno 17179872927 00000100:00100000:1.0:1746065128.127565:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259803648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.127566:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065128.127570:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cce00/2, rc 0, transno 21474840141 00000100:00100000:1.0:1746065128.127573:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259802496:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065128.127578:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9ce680/2, rc 0, transno 17179872926 00000100:00100000:1.0:1746065128.127580:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259803136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.127582:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259802368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065128.127585:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130444380/2, rc 0, transno 21474840140 00000100:00100000:1.0:1746065128.127588:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259801984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.127596:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.127600:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259801856 00000100:00100000:1.0:1746065128.127602:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259801856 00000100:00100000:3.0:1746065128.127605:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259802880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.127614:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259802368 00000100:00100000:3.0:1746065128.127616:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.127616:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259802368 00000100:00100000:3.0:1746065128.127622:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259803520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.127622:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259802880 00000100:00100000:1.0:1746065128.127624:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259802880 00000100:00100000:1.0:1746065128.127631:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11246 00000100:00100000:3.0:1746065128.127632:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.127635:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3297:x1830881259801856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.127646:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259803520 00000100:00100000:3.0:1746065128.127649:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259803520 00000100:00100000:3.0:1746065128.127659:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11247 00000100:00100000:3.0:1746065128.127663:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3297:x1830881259802368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065128.127703:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065128.127705:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:1.0:1746065128.127707:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00002000:00010000:1.0:1746065128.127708:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:1.0:1746065128.127710:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065128.127731:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+63:3297:x1830881259801856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (165us total) trans 21474840146 rc 0/0 00002000:00010000:3.0:1746065128.127734:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:3.0:1746065128.127736:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00000100:00100000:1.0:1746065128.127736:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11246 00002000:00010000:3.0:1746065128.127738:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.127740:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065128.127741:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:1.0:1746065128.127745:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11248 00000100:00100000:1.0:1746065128.127749:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3297:x1830881259802880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065128.127759:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3297:x1830881259802368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (161us total) trans 21474840147 rc 0/0 00000100:00100000:3.0:1746065128.127764:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11247 00000100:00100000:3.0:1746065128.127774:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11249 00000100:00100000:3.0:1746065128.127778:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3297:x1830881259803520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065128.127785:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065128.127788:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:2.0:1746065128.127789:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:2.0:1746065128.127791:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:2.0:1746065128.127792:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00002000:00010000:1.0:1746065128.127809:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065128.127811:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065128 -> 1746065128 00002000:00010000:1.0:1746065128.127812:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00000100:00100000:2.0:1746065128.127828:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3295:x1830881259802112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 695us (729us total) trans 21474840145 rc 0/0 00002000:00010000:1.0:1746065128.127830:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065128 -> 1746065128 00002000:00010000:1.0:1746065128.127831:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:2.0:1746065128.127833:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11242 00000100:00100000:1.0:1746065128.127848:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3297:x1830881259802880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (231us total) trans 17179872932 rc 0/0 00002000:00010000:3.0:1746065128.127851:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1746065128.127852:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11248 00002000:00010000:3.0:1746065128.127853:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.127855:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.127856:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.127857:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065128.127874:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3297:x1830881259803520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (242us total) trans 17179872933 rc 0/0 00000100:00100000:3.0:1746065128.127879:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11249 00000004:00080000:3.0:1746065128.127895:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130446300/2, rc 0, transno 21474840146 00000100:00100000:3.0:1746065128.127898:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259801856:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065128.127902:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cf100/2, rc 0, transno 21474840147 00000100:00100000:3.0:1746065128.127905:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259802368:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065128.127910:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cca80/2, rc 0, transno 17179872932 00000100:00100000:3.0:1746065128.127912:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259802880:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065128.127918:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9ce300/2, rc 0, transno 17179872933 00000100:00100000:3.0:1746065128.127920:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259803520:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065128.127929:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130445c00/2, rc 0, transno 21474840145 00000100:00100000:3.0:1746065128.127932:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259802112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.127950:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259804160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065128.127968:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.127982:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259804160 00000100:00100000:2.0:1746065128.127985:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259804160 00000100:00100000:2.0:1746065128.127998:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11250 00000100:00100000:2.0:1746065128.128002:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3297:x1830881259804160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.128086:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3297:x1830881259804160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (116us total) trans 17179872934 rc 0/0 00000004:00080000:0.0:1746065128.128124:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cfb80/2, rc 0, transno 17179872934 00000100:00100000:0.0:1746065128.128128:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259804160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.128159:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11250 00000100:00100000:0.0:1746065128.132030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.132067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.132104:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259803008:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065128.132115:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259804032:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065128.132126:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261218048 00000100:00100000:1.0:1746065128.132133:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261218048 00010000:00010000:2.0:1746065128.132151:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f4464 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 11 pid: 14643 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1746065128.132169:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3752 00010000:00010000:2.0:1746065128.132170:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.132176:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:29198:x1830881261218048:12345-192.168.202.46@tcp:49:cat.0 00010000:00010000:2.0:1746065128.132198:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002400, rc 0) 00000100:00100000:2.0:1746065128.132237:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:29200:x1830881261217408:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 81370us (82308us total) trans 8589943213 rc 0/0 00000100:00100000:1.0:1746065128.132237:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:29198:x1830881261218048:12345-192.168.202.46@tcp:49:cat.0 Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.132243:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9136 00000100:00100000:1.0:1746065128.132246:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3752 00000100:00100000:2.0:1746065128.132258:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261218304 00000100:00100000:2.0:1746065128.132260:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261218304 00000100:00100000:2.0:1746065128.132302:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9139 00000100:00100000:0.0:1746065128.132307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.132308:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29195:x1830881261218304:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065128.132317:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.132327:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800900fc200/0x14b4f8542d4f4480 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb07 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.132351:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800900fc200/0x14b4f8542d4f4480 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb07 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.132364:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900fc200/0x14b4f8542d4f4480 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb07 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.132372:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.132375:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065128.132378:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900fc200, rc 0) 00000100:00100000:2.0:1746065128.132396:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29195:x1830881261218304:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 89us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.132400:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9139 00000100:00100000:1.0:1746065128.132411:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261218176 00000100:00100000:1.0:1746065128.132414:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261218176 00000100:00100000:1.0:1746065128.132441:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3753 00000100:00100000:1.0:1746065128.132446:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29193:x1830881261218176:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:1.0:1746065128.132481:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29193:x1830881261218176:12345-192.168.202.46@tcp:49:cat.0 Request processed in 35us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.132485:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3753 00000100:00100000:0.0:1746065128.135061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.135179:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261218432 00000100:00100000:3.0:1746065128.135187:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261218432 00000100:00100000:3.0:1746065128.135278:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3754 00000100:00100000:3.0:1746065128.135296:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:29200:x1830881261218432:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:3.0:1746065128.135385:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:29200:x1830881261218432:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.135392:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3754 00000100:00100000:0.0:1746065128.135977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.136011:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261218560 00000100:00100000:2.0:1746065128.136016:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261218560 00000100:00100000:2.0:1746065128.136051:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 630 00000100:00100000:2.0:1746065128.136056:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:1959:x1830881261218560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.136065:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.136081:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900fc200/0x14b4f8542d4f4480 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb07 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.136094:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.136097:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.136125:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:1959:x1830881261218560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.136130:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 630 00000100:00100000:0.0:1746065128.138668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.138712:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.138763:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261218688 00000100:00100000:2.0:1746065128.138769:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261218688 00000100:00100000:2.0:1746065128.138796:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261218816 00000100:00100000:2.0:1746065128.138797:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261218816 00000100:00100000:2.0:1746065128.138843:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11251 00000100:00100000:2.0:1746065128.138849:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:29195:x1830881261218688:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065128.138863:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.138876:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb0e expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.138897:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba6d expref: 30 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.138904:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bacf expref: 19 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.138909:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.138911:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.138914:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1130496->1355775] (req 1130496->1355775) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.138931:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11252 00010000:00010000:2.0:1746065128.138937:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bacf expref: 19 pid: 8851 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065128.138939:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+28:29200:x1830881261218816:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065128.138946:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.138947:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bacf expref: 19 pid: 8851 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746065128.138956:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb15 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.138958:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259804288:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.138969:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5badd expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.138975:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.138976:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.138978:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.138992:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5badd expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.138999:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5badd expref: 29 pid: 21235 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746065128.139007:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259804416:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.139019:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba6d expref: 30 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065128.139029:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065128.139031:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba6d expref: 30 pid: 8427 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065128.139038:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259804544:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.139054:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.139603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.139799:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261219072 00000100:00100000:2.0:1746065128.139803:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261219072 00002000:00100000:2.0:1746065128.139844:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f46ed80 x1830881261219072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.139853:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46ed80 with x1830881261219072 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.139861:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46ed80 00000100:00100000:2.0:1746065128.139901:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5162 00000100:00100000:2.0:1746065128.139908:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261219072:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065128.141926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.142049:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259804288:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.142071:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261219328 00000100:00100000:3.0:1746065128.142075:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261219328 00000100:00100000:1.0:1746065128.142081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065128.142104:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a5880000 x1830881261219328/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.142111:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880000 with x1830881261219328 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.142115:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880000 00000100:00100000:1.0:1746065128.142129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.142133:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5163 00000100:00100000:3.0:1746065128.142140:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261219328:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065128.142205:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259804416:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065128.142227:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.142241:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f455e00, rc 0) 00000100:00100000:0.0:1746065128.142278:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+29:29200:x1830881261218816:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3340us (3565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.142284:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11252 00000100:00100000:2.0:1746065128.142639:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261219456 00000100:00100000:2.0:1746065128.142643:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261219456 00010000:00010000:2.0:1746065128.142658:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bacf expref: 21 pid: 8851 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065128.142675:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261219712 00000100:00100000:2.0:1746065128.142677:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261219712 00010000:00010000:2.0:1746065128.142686:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba6d expref: 33 pid: 8427 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065128.142699:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5606 00000100:00100000:2.0:1746065128.142704:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261219456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.142712:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.142726:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bacf expref: 21 pid: 8851 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.142734:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bacf expref: 21 pid: 8851 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.142750:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133085000/0x14b4f8542d4f4448 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bacf expref: 21 pid: 8851 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.142759:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.142776:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261219456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.142782:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5606 00000100:00100000:2.0:1746065128.142793:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5607 00000100:00100000:2.0:1746065128.142797:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261219712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.142804:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.142810:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba6d expref: 33 pid: 8427 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.142836:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba6d expref: 33 pid: 8427 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.142851:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.142853:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.142858:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.142867:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.142891:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 33 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.142901:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259804672:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065128.142948:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746065128.143310:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094615200/0x14b4f8542d4f4376 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba6d expref: 33 pid: 8427 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.143321:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259804544:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.143337:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 32 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.143345:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085600, rc 0) 00000100:00100000:3.0:1746065128.144055:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:29195:x1830881261218688:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5203us (5389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.144062:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11251 00000100:00100000:0.0:1746065128.146319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.146664:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261219584 00000100:00100000:3.0:1746065128.146671:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261219584 00010000:00010000:3.0:1746065128.146699:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5badd expref: 29 pid: 21235 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.146842:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5608 00000100:00100000:3.0:1746065128.146852:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881261219584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.146862:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.146880:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5badd expref: 29 pid: 21235 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746065128.146891:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5badd expref: 29 pid: 21235 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746065128.146907:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f76a400/0x14b4f8542d4f444f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5badd expref: 29 pid: 21235 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746065128.146919:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.146920:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.146926:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.146934:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.146960:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.146970:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259804800:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065128.147044:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.149490:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259804672:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065128.149510:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.149555:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881261219712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6755us (7424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.149564:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5607 00000100:00100000:3.0:1746065128.149997:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261219072:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10089us (10393us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.150006:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5162 00002000:00100000:3.0:1746065128.150016:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88009f46ed80 x1830881261219072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.150024:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46ed80 with x1830881261219072 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.150029:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46ed80 00000100:00100000:3.0:1746065128.154753:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+19:1960:x1830881261219328:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12605us (12823us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.154764:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5163 00002000:00100000:3.0:1746065128.154774:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff8800a5880000 x1830881261219328/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.154782:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880000 with x1830881261219328 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.154787:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880000 00000100:00100000:1.0:1746065128.158200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.158246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.158269:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259804800:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065128.158298:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.158323:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261219968 00000100:00100000:2.0:1746065128.158328:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261219968 00000100:00100000:3.0:1746065128.158342:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881261219584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 11492us (12030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.158350:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5608 00002000:00100000:2.0:1746065128.158360:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (4165632->4169727) req@ffff8800a5880a80 x1830881261219968/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.158368:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880a80 with x1830881261219968 ext(4165632->4169727) 00002000:00010000:2.0:1746065128.158372:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5880a80 00000100:00100000:2.0:1746065128.158384:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261220224 00000100:00100000:2.0:1746065128.158386:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261220224 00002000:00100000:2.0:1746065128.158401:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37a:0x0] (1130496->1134591) req@ffff8800a5883480 x1830881261220224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065128.158403:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5164 00002000:00100000:2.0:1746065128.158407:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883480 with x1830881261220224 ext(1130496->1134591) 00000100:00100000:3.0:1746065128.158409:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261219968:12345-192.168.202.46@tcp:3:multiop.0 00002000:00010000:2.0:1746065128.158411:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5883480 00000100:00100000:2.0:1746065128.158427:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5165 00000100:00100000:2.0:1746065128.158431:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261220224:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065128.158685:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261220224:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 251us (437us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065128.158691:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5165 00002000:00100000:2.0:1746065128.158696:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37a:0x0] (1130496->1134591) req@ffff8800a5883480 x1830881261220224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.158703:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883480 with x1830881261220224 ext(1130496->1134591) 00002000:00010000:2.0:1746065128.158706:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5883480 00000100:00100000:3.0:1746065128.158752:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261219968:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 342us (559us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065128.158758:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5164 00002000:00100000:3.0:1746065128.158763:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (4165632->4169727) req@ffff8800a5880a80 x1830881261219968/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.158769:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880a80 with x1830881261219968 ext(4165632->4169727) 00002000:00010000:3.0:1746065128.158772:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5880a80 00000100:00100000:0.0:1746065128.159675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.159763:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261220480 00000100:00100000:3.0:1746065128.159768:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261220480 00002000:00100000:3.0:1746065128.159787:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f46c000 x1830881261220480/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 504/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.159794:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46c000 with x1830881261220480 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.159797:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46c000 00000100:00100000:3.0:1746065128.159838:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5166 00000100:00100000:3.0:1746065128.159843:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261220480:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065128.161412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.161570:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261220608 00000100:00100000:2.0:1746065128.161576:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261220608 00000100:00100000:2.0:1746065128.161601:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11253 00000100:00100000:2.0:1746065128.161606:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:29200:x1830881261220608:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065128.161616:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.161629:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb1c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.161648:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba82 expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.161655:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bae4 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.161660:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.161662:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.161665:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->3579903] (req 3145728->3579903) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.161685:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bae4 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.161694:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bae4 expref: 20 pid: 8851 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065128.161703:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259804928:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.161776:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba82 expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.161784:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba82 expref: 30 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065128.161791:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259805056:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.161808:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.163925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.163963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.164375:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261220736 00000100:00100000:3.0:1746065128.164382:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261220736 00010000:00010000:3.0:1746065128.164413:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bae4 expref: 21 pid: 8851 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.164434:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261220864 00000100:00100000:3.0:1746065128.164437:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261220864 00010000:00010000:3.0:1746065128.164446:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba82 expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.164459:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5609 00000100:00100000:3.0:1746065128.164466:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261220736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.164477:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.164496:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bae4 expref: 21 pid: 8851 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746065128.164506:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bae4 expref: 21 pid: 8851 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746065128.164526:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.164569:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261220736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.164575:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5609 00000100:00100000:3.0:1746065128.164589:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5610 00000100:00100000:3.0:1746065128.164594:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261220864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.164599:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.164606:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba82 expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746065128.164618:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba82 expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746065128.164630:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.164632:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.164637:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.164644:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.164790:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.164801:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259805184:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065128.165204:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb540 going to sleep for 11 seconds 00010000:00010000:3.0:1746065128.165771:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133084e00/0x14b4f8542d4f443a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bae4 expref: 20 pid: 8851 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.165799:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259804928:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.165811:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d172c00/0x14b4f8542d4f438b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba82 expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.165838:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259805056:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.165859:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.165867:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f231a00, rc 0) 00000100:00100000:3.0:1746065128.165904:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:29200:x1830881261220608:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4296us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.165910:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11253 00000100:00100000:0.0:1746065128.167457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.168144:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259805184:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065128.168159:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.168198:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261220864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3602us (4233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.168206:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5610 00000100:00100000:3.0:1746065128.168232:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261220992 00000100:00100000:3.0:1746065128.168236:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261220992 00000100:00100000:3.0:1746065128.168267:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11254 00000100:00100000:3.0:1746065128.168273:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+19:29198:x1830881261220992:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.168300:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.168314:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb23 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.168335:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.168464:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261220480:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8620us (8790us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746065128.168471:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5166 00002000:00100000:2.0:1746065128.168479:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88009f46c000 x1830881261220480/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 504/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.168487:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46c000 with x1830881261220480 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.168490:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46c000 00010000:00010000:3.0:1746065128.168717:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065128.168719:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065128.168723:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.168753:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.168765:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 27 pid: 4544 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.168775:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259805312:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.169130:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.170501:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.170570:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261221248 00000100:00100000:2.0:1746065128.170576:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261221248 00000100:00100000:3.0:1746065128.170668:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259805312:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.170694:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065128.170696:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3575808->3579903) req@ffff880094d95880 x1830881261221248/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.170705:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95880 with x1830881261221248 ext(3575808->3579903) 00010000:00010000:3.0:1746065128.170707:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0132600, rc 0) 00002000:00010000:2.0:1746065128.170708:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95880 00000100:00100000:2.0:1746065128.170736:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5167 00000100:00100000:2.0:1746065128.170742:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261221248:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065128.170749:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+21:29198:x1830881261220992:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2477us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.170754:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11254 00000100:00100000:2.0:1746065128.171030:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+20:1960:x1830881261221248:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 288us (532us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065128.171036:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5167 00002000:00100000:2.0:1746065128.171042:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3575808->3579903) req@ffff880094d95880 x1830881261221248/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.171048:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95880 with x1830881261221248 ext(3575808->3579903) 00002000:00010000:2.0:1746065128.171050:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95880 00000100:00100000:0.0:1746065128.172120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.172176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.172359:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261221760 00000100:00100000:3.0:1746065128.172364:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261221760 00002000:00100000:3.0:1746065128.172387:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1130496->1355775) req@ffff880094d95500 x1830881261221760/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.172393:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95500 with x1830881261221760 ext(1130496->1355775) 00010000:00010000:3.0:1746065128.172400:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 28 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.172413:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 28 pid: 4544 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065128.172419:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d95500 00000100:00100000:3.0:1746065128.172430:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1567 00000100:00100000:3.0:1746065128.172435:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881261221760:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065128.172660:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261221632 00000100:00100000:2.0:1746065128.172663:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261221632 00000100:00100000:2.0:1746065128.172682:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3755 00000100:00100000:2.0:1746065128.172686:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29195:x1830881261221632:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065128.172913:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29195:x1830881261221632:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 226us (796us total) trans 8589943214 rc 0/0 00000100:00100000:2.0:1746065128.172919:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3755 00000100:00100000:3.0:1746065128.178451:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881261221760:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 6007us (6266us total) trans 21474840148 rc 0/0 00000100:00100000:3.0:1746065128.178463:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1567 00002000:00100000:3.0:1746065128.178472:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1130496->1355775) req@ffff880094d95500 x1830881261221760/t21474840148(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.178481:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95500 with x1830881261221760 ext(1130496->1355775) 00010000:00010000:3.0:1746065128.178489:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 30 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.178502:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 30 pid: 4544 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065128.178508:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d95500 00000100:00100000:0.0:1746065128.181915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.181965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.181973:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261222016 00000100:00100000:3.0:1746065128.181980:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261222016 00002000:00100000:3.0:1746065128.182014:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d96d80 x1830881261222016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.182021:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96d80 with x1830881261222016 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.182026:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d96d80 00000100:00100000:3.0:1746065128.182043:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5168 00000100:00100000:3.0:1746065128.182049:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881261222016:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065128.182763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.182776:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261222144 00000100:00100000:2.0:1746065128.182781:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261222144 00000100:00100000:3.0:1746065128.182786:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261222400 00000100:00100000:3.0:1746065128.182790:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261222400 00010000:00010000:2.0:1746065128.182801:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 30 pid: 4544 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.182842:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3756 00000100:00100000:2.0:1746065128.182843:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5611 00000100:00100000:3.0:1746065128.182848:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:29200:x1830881261222400:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065128.182849:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881261222144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.182860:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065128.182872:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065127 -> 1746065129 00002000:00010000:2.0:1746065128.182875:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065127 -> 1746065129 00010000:00010000:2.0:1746065128.182880:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 30 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.182890:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 30 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.182908:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4487 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->1355775) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb0e expref: 30 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.182937:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.182939:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.182944:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.182951:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.182977:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.182991:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259805440:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065128.183041:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.183159:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+10:29200:x1830881261222400:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 311us (396us total) trans 8589943215 rc 0/0 00000100:00100000:3.0:1746065128.183166:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3756 00000100:00100000:2.0:1746065128.184800:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259805440:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065128.184832:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.184853:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881261222144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2004us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.184860:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5611 00000100:00100000:0.0:1746065128.190174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.190209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.190403:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261222656 00000100:00100000:2.0:1746065128.190411:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261222656 00002000:00100000:2.0:1746065128.190445:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094d94a80 x1830881261222656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.190455:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94a80 with x1830881261222656 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.190460:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94a80 00000100:00100000:2.0:1746065128.190473:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261222912 00000100:00100000:2.0:1746065128.190476:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261222912 00002000:00100000:2.0:1746065128.190487:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d95f80 x1830881261222912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.190493:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95f80 with x1830881261222912 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.190496:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95f80 00000100:00100000:2.0:1746065128.190507:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5169 00000100:00100000:2.0:1746065128.190514:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261222656:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065128.190531:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5170 00000100:00100000:1.0:1746065128.190539:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261222912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065128.191694:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881261222016:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 9641us (9781us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.191701:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5168 00002000:00100000:3.0:1746065128.191708:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d96d80 x1830881261222016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.191715:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96d80 with x1830881261222016 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.191719:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d96d80 00000100:00100000:0.0:1746065128.201247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.201620:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261222912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11080us (11407us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065128.201630:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5170 00002000:00100000:1.0:1746065128.201639:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff880094d95f80 x1830881261222912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065128.201648:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95f80 with x1830881261222912 ext(1048576->2097151) 00002000:00010000:1.0:1746065128.201653:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95f80 00000100:00100000:2.0:1746065128.201764:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+20:1961:x1830881261222656:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11249us (11597us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.201775:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5169 00002000:00100000:2.0:1746065128.201780:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff880094d94a80 x1830881261222656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.201787:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94a80 with x1830881261222656 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.201790:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94a80 00000100:00100000:0.0:1746065128.202125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.202640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.202971:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261223040 00000100:00100000:3.0:1746065128.202977:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261223040 00000100:00100000:3.0:1746065128.203005:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261223168 00000100:00100000:3.0:1746065128.203007:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261223168 00000100:00100000:3.0:1746065128.203021:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261223296 00000100:00100000:3.0:1746065128.203022:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261223296 00000100:00100000:3.0:1746065128.203032:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11255 00000100:00100000:3.0:1746065128.203038:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881261223040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.203052:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.203065:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb2a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.203081:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.203083:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.203089:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb2a expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.203101:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb2a expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.203109:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900fc800, rc 0) 00000100:00100000:3.0:1746065128.203129:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881261223040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 91us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.203134:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11255 00000100:00100000:3.0:1746065128.203143:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11256 00000100:00100000:3.0:1746065128.203147:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1959:x1830881261223168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.203152:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.203159:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb31 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.203185:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259805568:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065128.203225:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.203238:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11257 00000100:00100000:3.0:1746065128.203243:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881261223296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.203249:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.203255:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f44b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb38 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.203275:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259805696:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065128.203305:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5840 going to sleep for 11 seconds 00002000:00010000:2.0:1746065128.204842:0:4544:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065128 -> 1746065129 00002000:00010000:2.0:1746065128.204847:0:4544:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065127 -> 1746065129 00002000:00010000:2.0:1746065128.204849:0:4544:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065128 -> 1746065129 00002000:00010000:3.0:1746065128.204851:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065128 -> 1746065129 00002000:00010000:3.0:1746065128.204854:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065128 -> 1746065129 00002000:00010000:3.0:1746065128.204856:0:8428:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065128 -> 1746065129 00000100:00100000:3.0:1746065128.204866:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881259805568:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065128.204866:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259805696:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065128.204885:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb31 expref: 47 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.204885:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f44b1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb38 expref: 31 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.204895:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb31 expref: 47 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.204895:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d172a00/0x14b4f8542d4f44b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb38 expref: 31 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.204905:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d172a00, rc 0) 00010000:00010000:3.0:1746065128.204918:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900fcc00, rc 0) 00000100:00100000:3.0:1746065128.204941:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1959:x1830881261223168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1792us (2816us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065128.204947:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11256 00000100:00100000:2.0:1746065128.205108:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881261223296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1863us (2467us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065128.205113:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11257 00000100:00100000:0.0:1746065128.207128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.207504:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261223424 00000100:00100000:2.0:1746065128.207513:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261223424 00000100:00100000:2.0:1746065128.207563:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11258 00000100:00100000:2.0:1746065128.207570:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:29193:x1830881261223424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065128.207586:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.207603:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb3f expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.207631:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.207638:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.207640:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.207642:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 47 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.207671:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 27 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.207682:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 27 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.207693:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259805824:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.207777:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.210663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.210713:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881259805824:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.210741:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 47 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.210755:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f231600, rc 0) 00000100:00100000:2.0:1746065128.210930:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:29193:x1830881261223424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3359us (3806us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.210938:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11258 00000100:00100000:0.0:1746065128.211229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.211319:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261223552 00000100:00100000:3.0:1746065128.211326:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261223552 00000100:00100000:2.0:1746065128.211343:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261223680 00000100:00100000:2.0:1746065128.211346:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261223680 00002000:00100000:3.0:1746065128.211356:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (4165632->4194303) req@ffff880094d96680 x1830881261223552/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.211365:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96680 with x1830881261223552 ext(4165632->4194303) 00000100:00100000:2.0:1746065128.211365:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11259 00000100:00100000:2.0:1746065128.211369:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+29:29198:x1830881261223680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.211372:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 29 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.211379:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.211383:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 29 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065128.211389:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d96680 00010000:00010000:2.0:1746065128.211390:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb46 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.211400:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1568 00000100:00100000:3.0:1746065128.211405:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881261223552:12345-192.168.202.46@tcp:4:multiop.0 00010000:00010000:2.0:1746065128.211406:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.211410:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.211418:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.211424:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900fcc00, rc 0) 00000100:00100000:2.0:1746065128.211445:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+30:29198:x1830881261223680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.211449:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11259 00000100:00100000:3.0:1746065128.213024:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:75065d94-a855-40b7-bd64-6d6f17292955+31:1961:x1830881261223552:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 1614us (2365us total) trans 17179872935 rc 0/0 00000100:00100000:3.0:1746065128.213033:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1568 00002000:00100000:3.0:1746065128.213040:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (4165632->4194303) req@ffff880094d96680 x1830881261223552/t17179872935(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.213048:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96680 with x1830881261223552 ext(4165632->4194303) 00010000:00010000:3.0:1746065128.213054:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 31 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.213066:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 31 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065128.213071:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d96680 00000100:00100000:0.0:1746065128.214931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.214979:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261223808 00000100:00100000:2.0:1746065128.214986:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261223808 00010000:00010000:2.0:1746065128.215011:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 31 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.215037:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5612 00000100:00100000:2.0:1746065128.215047:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+31:1958:x1830881261223808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.215057:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.215075:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 31 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.215085:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 31 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.215105:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f455e00/0x14b4f8542d4f448e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb15 expref: 31 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.215126:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.215128:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.215134:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 46 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.215141:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 46 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.215149:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.215150:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.215153:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.215159:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.215185:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.215194:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259805952:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065128.215272:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 46 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.215280:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259806080:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065128.215311:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.216862:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259805952:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065128.216872:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259806080:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065128.216892:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.216926:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881261223808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1879us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.216935:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5612 00000100:00100000:0.0:1746065128.221785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.221909:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261224064 00000100:00100000:3.0:1746065128.221917:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261224064 00002000:00100000:3.0:1746065128.221957:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880134d86300 x1830881261224064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.221970:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86300 with x1830881261224064 ext(2097152->3145727) 00002000:00010000:3.0:1746065128.221975:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d86300 00000100:00100000:3.0:1746065128.221998:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5171 00000100:00100000:3.0:1746065128.222004:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261224064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065128.227743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.227777:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.227839:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261224448 00000100:00100000:2.0:1746065128.227847:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261224448 00002000:00100000:2.0:1746065128.227881:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800a5883800 x1830881261224448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.227890:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883800 with x1830881261224448 ext(3145728->4194303) 00002000:00010000:2.0:1746065128.227894:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5883800 00000100:00100000:2.0:1746065128.228585:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261224320 00000100:00100000:2.0:1746065128.228589:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261224320 00002000:00100000:2.0:1746065128.228602:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a5882300 x1830881261224320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.228608:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882300 with x1830881261224320 ext(2097152->3145727) 00002000:00010000:2.0:1746065128.228611:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882300 00000100:00100000:0.0:1746065128.228664:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5172 00000100:00100000:0.0:1746065128.228674:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881261224448:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.229019:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5173 00000100:00100000:2.0:1746065128.229025:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881261224320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.231261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.231312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.232179:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261224832 00000100:00100000:3.0:1746065128.232187:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261224832 00002000:00100000:3.0:1746065128.232218:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009f9cdc00 x1830881261224832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.232228:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cdc00 with x1830881261224832 ext(2097152->3145727) 00002000:00010000:3.0:1746065128.232232:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cdc00 00000100:00100000:3.0:1746065128.232247:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261224960 00000100:00100000:3.0:1746065128.232249:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261224960 00002000:00100000:3.0:1746065128.232259:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3579904->4194303) req@ffff8800a5882d80 x1830881261224960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.232265:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881261224960 ext(3579904->4194303) 00002000:00010000:3.0:1746065128.232267:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5882d80 00000100:00100000:3.0:1746065128.232299:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5174 00000100:00100000:3.0:1746065128.232306:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261224832:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.232319:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5175 00000100:00100000:2.0:1746065128.232325:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261224960:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065128.234341:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261224064:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12331us (12557us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.234348:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5171 00002000:00100000:3.0:1746065128.234356:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff880134d86300 x1830881261224064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.234368:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86300 with x1830881261224064 ext(2097152->3145727) 00002000:00010000:3.0:1746065128.234372:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d86300 00000100:00100000:2.0:1746065128.251220:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:75065d94-a855-40b7-bd64-6d6f17292955+32:1960:x1830881261224320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22183us (23430us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.251234:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5173 00002000:00100000:2.0:1746065128.251245:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff8800a5882300 x1830881261224320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.251254:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882300 with x1830881261224320 ext(2097152->3145727) 00002000:00010000:2.0:1746065128.251259:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882300 00000100:00100000:3.0:1746065128.251871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.251966:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261225216 00000100:00100000:0.0:1746065128.251973:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261225216 00000100:00100000:0.0:1746065128.252013:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11260 00000100:00100000:0.0:1746065128.252020:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:29193:x1830881261225216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065128.252033:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.252047:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb4d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.252071:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.252078:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065128.252079:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065128.252083:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.252108:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.252119:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.252129:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259806208:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065128.253546:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.256804:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261224448:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28123us (29059us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.256829:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5172 00002000:00100000:3.0:1746065128.256838:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff8800a5883800 x1830881261224448/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.256846:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883800 with x1830881261224448 ext(3145728->4194303) 00002000:00010000:3.0:1746065128.256851:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5883800 00000100:00100000:0.0:1746065128.259371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.259438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.259998:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259806208:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.260020:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.260034:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350fc400, rc 0) 00000100:00100000:2.0:1746065128.260064:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:29193:x1830881261225216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8045us (8195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.260071:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11260 00000100:00100000:2.0:1746065128.260093:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261225472 00000100:00100000:2.0:1746065128.260097:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261225472 00000100:00100000:2.0:1746065128.260133:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11261 00000100:00100000:2.0:1746065128.260138:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+24:29198:x1830881261225472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065128.260149:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.260159:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb54 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.260174:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.260177:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.260185:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.260190:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f145c00, rc 0) 00000100:00100000:2.0:1746065128.260201:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+25:29198:x1830881261225472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 62us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.260205:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11261 00000100:00100000:2.0:1746065128.260326:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261224960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28002us (29014us total) trans 0 rc 614400/614400 00000100:00100000:2.0:1746065128.260332:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5175 00002000:00100000:2.0:1746065128.260339:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3579904->4194303) req@ffff8800a5882d80 x1830881261224960/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.260346:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881261224960 ext(3579904->4194303) 00010000:00010000:2.0:1746065128.260352:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.260361:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065128.260366:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5882d80 00000100:00100000:2.0:1746065128.260375:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261225344 00000100:00100000:2.0:1746065128.260377:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261225344 00002000:00100000:2.0:1746065128.260389:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3579903) req@ffff880134d84e00 x1830881261225344/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.260395:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84e00 with x1830881261225344 ext(3145728->3579903) 00010000:00010000:2.0:1746065128.260398:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.260404:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065128.260408:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d84e00 00000100:00100000:2.0:1746065128.260417:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1569 00000100:00100000:2.0:1746065128.260420:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1959:x1830881261225344:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065128.260840:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:1961:x1830881261224832:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28534us (29583us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.260847:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5174 00002000:00100000:3.0:1746065128.260852:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88009f9cdc00 x1830881261224832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.260858:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cdc00 with x1830881261224832 ext(2097152->3145727) 00010000:00010000:3.0:1746065128.260862:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.260871:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065128.260875:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cdc00 00000100:00100000:2.0:1746065128.266600:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+23:1959:x1830881261225344:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6171us (7227us total) trans 21474840149 rc 0/0 00000100:00100000:2.0:1746065128.266611:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1569 00002000:00100000:2.0:1746065128.266620:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3579903) req@ffff880134d84e00 x1830881261225344/t21474840149(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.266628:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84e00 with x1830881261225344 ext(3145728->3579903) 00010000:00010000:2.0:1746065128.266636:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.266648:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065128.266658:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d84e00 00000100:00100000:0.0:1746065128.269702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.269757:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261225600 00000100:00100000:2.0:1746065128.269764:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261225600 00010000:00010000:2.0:1746065128.269799:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065128.270048:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5613 00000100:00100000:1.0:1746065128.270057:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:1958:x1830881261225600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.270072:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.270093:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065128.270104:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065128.270124:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4495 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3579903) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb1c expref: 23 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065128.270203:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.270205:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.270212:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.270219:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.270226:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.270228:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.270230:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.270235:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.270262:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.270454:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259806336:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065128.270537:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.270545:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259806464:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065128.270563:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065128.273087:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259806336:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065128.276416:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.276742:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881259806464:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065128.276765:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.276802:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881261225600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6745us (7106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.276809:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5613 00000100:00100000:0.0:1746065128.276966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.277868:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261225856 00000100:00100000:3.0:1746065128.277876:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261225856 00002000:00100000:3.0:1746065128.277909:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880134d85500 x1830881261225856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.277918:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85500 with x1830881261225856 ext(2097152->3145727) 00002000:00010000:3.0:1746065128.277922:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d85500 00000100:00100000:3.0:1746065128.277944:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261226112 00000100:00100000:3.0:1746065128.277946:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261226112 00002000:00100000:3.0:1746065128.277957:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880134d85180 x1830881261226112/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.277962:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85180 with x1830881261226112 ext(3145728->4194303) 00002000:00010000:3.0:1746065128.277964:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d85180 00000100:00100000:3.0:1746065128.277976:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5176 00000100:00100000:3.0:1746065128.277981:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:1959:x1830881261225856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.278729:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5177 00000100:00100000:2.0:1746065128.278738:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881261226112:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065128.279123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.279135:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261226496 00000100:00100000:0.0:1746065128.279138:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261226496 00002000:00100000:0.0:1746065128.279152:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880134d84a80 x1830881261226496/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.279159:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84a80 with x1830881261226496 ext(2097152->3145727) 00002000:00010000:0.0:1746065128.279162:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d84a80 00000100:00100000:0.0:1746065128.279171:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5178 00000100:00100000:0.0:1746065128.279175:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261226496:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065128.279696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.279737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.279783:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261226624 00000100:00100000:2.0:1746065128.279786:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261226624 00002000:00100000:2.0:1746065128.279801:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d7fed80 x1830881261226624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.279807:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fed80 with x1830881261226624 ext(3145728->4194303) 00002000:00010000:2.0:1746065128.279810:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fed80 00000100:00100000:2.0:1746065128.279833:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261226880 00000100:00100000:2.0:1746065128.279835:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261226880 00002000:00100000:2.0:1746065128.279846:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012d7fe300 x1830881261226880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.279852:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fe300 with x1830881261226880 ext(3145728->4194303) 00000100:00100000:0.0:1746065128.279853:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5179 00002000:00010000:2.0:1746065128.279854:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fe300 00000100:00100000:0.0:1746065128.279859:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261226624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.279868:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5180 00000100:00100000:2.0:1746065128.279872:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261226880:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065128.291914:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881261225856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13924us (15495us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.291924:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5176 00002000:00100000:3.0:1746065128.291933:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880134d85500 x1830881261225856/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.291941:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85500 with x1830881261225856 ext(2097152->3145727) 00002000:00010000:3.0:1746065128.291946:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d85500 00000100:00100000:0.0:1746065128.298230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.298411:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261227136 00000100:00100000:2.0:1746065128.298419:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261227136 00000100:00100000:2.0:1746065128.298467:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9140 00000100:00100000:2.0:1746065128.298475:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29206:x1830881261227136:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065128.298496:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.298511:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f44d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb5b expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.298600:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298611:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298620:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298631:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298637:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298642:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298730:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298737:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298743:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065128.298751:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065128.298836:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298843:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298848:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298853:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6002a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065128.298856:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298863:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298872:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065128.298874:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065128.298878:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298882:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f44db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298897:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298901:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298905:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298909:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6002c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065128.298911:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298916:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298921:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205700) 00010000:00010000:2.0:1746065128.298923:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065128.298925:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298929:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f44e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.298961:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f44d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb5b expref: 252 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.298971:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb5b expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.298976:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.298978:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065128.298979:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002e00, rc 0) 00000100:00100000:2.0:1746065128.299194:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29206:x1830881261227136:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 718us (971us total) trans 8589943216 rc 0/0 00000100:00100000:2.0:1746065128.299200:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9140 00000100:00100000:2.0:1746065128.300397:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881261226112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21658us (23428us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.300405:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5177 00002000:00100000:2.0:1746065128.300413:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880134d85180 x1830881261226112/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.300426:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85180 with x1830881261226112 ext(3145728->4194303) 00002000:00010000:2.0:1746065128.300430:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d85180 00000100:00100000:2.0:1746065128.303551:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261226496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24365us (24419us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.303562:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5178 00002000:00100000:2.0:1746065128.303572:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880134d84a80 x1830881261226496/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.303580:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84a80 with x1830881261226496 ext(2097152->3145727) 00002000:00010000:2.0:1746065128.303585:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d84a80 00000100:00100000:0.0:1746065128.310442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.310619:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261227392 00000100:00100000:3.0:1746065128.310626:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261227392 00002000:00100000:3.0:1746065128.310662:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880134d86680 x1830881261227392/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.310670:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86680 with x1830881261227392 ext(4194304->5029887) 00002000:00010000:3.0:1746065128.310675:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d86680 00000100:00100000:3.0:1746065128.310699:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5181 00000100:00100000:3.0:1746065128.310707:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261227392:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.311305:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261226624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31443us (31606us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.311312:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5179 00002000:00100000:2.0:1746065128.311318:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88012d7fed80 x1830881261226624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.311326:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fed80 with x1830881261226624 ext(3145728->4194303) 00002000:00010000:2.0:1746065128.311329:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fed80 00000100:00100000:2.0:1746065128.312367:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261226880:12345-192.168.202.46@tcp:3:cat.0 Request processed in 32490us (32626us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.312374:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5180 00002000:00100000:2.0:1746065128.313745:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012d7fe300 x1830881261226880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.313764:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fe300 with x1830881261226880 ext(3145728->4194303) 00002000:00010000:2.0:1746065128.313770:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fe300 00000100:00100000:3.0:1746065128.320283:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261227392:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9568us (9842us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065128.320306:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5181 00002000:00100000:3.0:1746065128.320315:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880134d86680 x1830881261227392/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.320324:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86680 with x1830881261227392 ext(4194304->5029887) 00002000:00010000:3.0:1746065128.320329:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d86680 00000100:00100000:0.0:1746065128.330723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.334151:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261227648 00000100:00100000:3.0:1746065128.334162:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261227648 00002000:00100000:3.0:1746065128.334201:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880134d85f80 x1830881261227648/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.334210:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85f80 with x1830881261227648 ext(4194304->5029887) 00002000:00010000:3.0:1746065128.334214:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d85f80 00000100:00100000:3.0:1746065128.334251:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5182 00000100:00100000:3.0:1746065128.334257:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881261227648:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065128.344069:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881261227648:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9803us (13344us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065128.344079:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5182 00002000:00100000:3.0:1746065128.344089:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880134d85f80 x1830881261227648/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.344104:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85f80 with x1830881261227648 ext(4194304->5029887) 00002000:00010000:3.0:1746065128.344109:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d85f80 00000100:00100000:0.0:1746065128.351082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.351611:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261227904 00000100:00100000:3.0:1746065128.351620:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261227904 00000100:00100000:3.0:1746065128.351658:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3757 00000100:00100000:3.0:1746065128.351665:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29193:x1830881261227904:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065128.351956:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29193:x1830881261227904:12345-192.168.202.46@tcp:35:cat.0 Request processed in 290us (880us total) trans 8589943217 rc 0/0 00000100:00100000:3.0:1746065128.351963:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3757 00000100:00100000:0.0:1746065128.420473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.420548:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261228160 00000100:00100000:3.0:1746065128.420555:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261228160 00000100:00100000:2.0:1746065128.421029:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9141 00000100:00100000:2.0:1746065128.421038:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:29210:x1830881261228160:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065128.421057:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.421072:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f44f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb62 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.421152:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421161:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421168:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421178:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421182:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421188:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421266:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421272:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421277:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065128.421300:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065128.421366:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421372:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421377:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421382:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6003000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065128.421385:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421389:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421397:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065128.421400:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065128.421402:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421406:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003000/0x14b4f8542d4f44fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421434:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421439:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421443:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421449:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6003200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065128.421451:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421455:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421460:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205300) 00010000:00010000:2.0:1746065128.421462:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065128.421464:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421467:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f4505 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.421498:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f44f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb62 expref: 13 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.421513:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb62 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.421518:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.421520:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065128.421522:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003400, rc 0) 00000100:00100000:2.0:1746065128.421559:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:29210:x1830881261228160:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 522us (1095us total) trans 8589943218 rc 0/0 00000100:00100000:2.0:1746065128.421565:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9141 00000100:00100000:0.0:1746065128.425658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.425711:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261228288 00000100:00100000:1.0:1746065128.425717:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261228288 00000100:00100000:1.0:1746065128.425750:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11262 00000100:00100000:1.0:1746065128.425756:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+22:29210:x1830881261228288:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065128.425768:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065128.425780:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb69 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.425799:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba66 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.425805:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac8 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.425808:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.425809:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.425811:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1187840->1265663] (req 1187840->1265663) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.425854:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac8 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.425861:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac8 expref: 23 pid: 8851 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746065128.425868:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259806592:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.426201:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba66 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.426210:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba66 expref: 30 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746065128.426217:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259806720:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065128.426245:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065128.427637:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259806592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065128.427647:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259806720:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.427668:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1187840->1265663] (req 1187840->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.427683:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f454a00, rc 0) 00000100:00100000:1.0:1746065128.427707:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+23:29210:x1830881261228288:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1951us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.427713:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11262 00000100:00100000:0.0:1746065128.430410:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.430654:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261228416 00000100:00100000:1.0:1746065128.430664:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261228416 00010000:00010000:1.0:1746065128.430707:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac8 expref: 23 pid: 8851 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746065128.430745:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5614 00000100:00100000:1.0:1746065128.430752:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:1959:x1830881261228416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.430765:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.430783:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac8 expref: 23 pid: 8851 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746065128.430794:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac8 expref: 23 pid: 8851 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746065128.430812:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133084c00/0x14b4f8542d4f442c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac8 expref: 23 pid: 8851 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746065128.430862:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.430908:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+22:1959:x1830881261228416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 153us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.430915:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5614 00000100:00100000:0.0:1746065128.431482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.431582:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261228544 00000100:00100000:2.0:1746065128.431586:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261228544 00010000:00010000:2.0:1746065128.431602:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba66 expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065128.432194:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5615 00000100:00100000:2.0:1746065128.432202:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261228544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.432211:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.432223:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba66 expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.432233:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba66 expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.432247:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d173600/0x14b4f8542d4f436f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba66 expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.432266:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.432268:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.432273:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.432281:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.432318:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.432329:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259806848:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065128.433063:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.438892:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259806848:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065128.438911:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.438955:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261228544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6754us (7473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.438964:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5615 00000100:00100000:0.0:1746065128.439575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.440051:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261228800 00000100:00100000:3.0:1746065128.440059:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261228800 00002000:00100000:3.0:1746065128.440091:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1187840->1191935) req@ffff88012bd3e680 x1830881261228800/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.440100:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e680 with x1830881261228800 ext(1187840->1191935) 00002000:00010000:3.0:1746065128.440103:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3e680 00000100:00100000:3.0:1746065128.440118:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5183 00000100:00100000:3.0:1746065128.440124:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261228800:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065128.440239:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261228800:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 114us (665us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065128.440245:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5183 00002000:00100000:3.0:1746065128.440250:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1187840->1191935) req@ffff88012bd3e680 x1830881261228800/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.440261:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e680 with x1830881261228800 ext(1187840->1191935) 00002000:00010000:3.0:1746065128.440264:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3e680 00000100:00100000:0.0:1746065128.442489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.442577:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261228928 00000100:00100000:3.0:1746065128.442583:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261228928 00000100:00100000:3.0:1746065128.442914:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9142 00000100:00100000:3.0:1746065128.442922:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:29211:x1830881261228928:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065128.442940:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.442955:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1c00/0x14b4f8542d4f4521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb70 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.442998:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443007:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443016:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443026:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443042:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443048:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443137:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443148:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443154:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065128.443179:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065128.443183:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065128.443194:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443201:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443208:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443212:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443217:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443222:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2c1800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.443225:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443231:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443238:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065128.443241:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.443244:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443249:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1800/0x14b4f8542d4f4528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443271:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443276:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443280:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443298:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2c1600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.443300:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443305:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443311:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f000) 00010000:00010000:3.0:1746065128.443313:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.443315:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443838:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f452f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065128.443861:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1c00/0x14b4f8542d4f4521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb70 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.443870:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb70 expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.443879:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.443881:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065128.443883:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2c1400, rc 0) 00000100:00100000:3.0:1746065128.444413:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29211:x1830881261228928:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1489us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.444420:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9142 00000100:00100000:2.0:1746065128.445889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.445938:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261229184 00000100:00100000:0.0:1746065128.445945:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261229184 00002000:00100000:0.0:1746065128.445974:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1261568->1265663) req@ffff88009f9cc380 x1830881261229184/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.445984:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc380 with x1830881261229184 ext(1261568->1265663) 00002000:00010000:0.0:1746065128.445988:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cc380 00000100:00100000:0.0:1746065128.446016:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5184 00000100:00100000:0.0:1746065128.446023:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261229184:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065128.446160:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+22:1961:x1830881261229184:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 137us (273us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065128.446166:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5184 00002000:00100000:0.0:1746065128.446171:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1261568->1265663) req@ffff88009f9cc380 x1830881261229184/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.446178:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc380 with x1830881261229184 ext(1261568->1265663) 00002000:00010000:0.0:1746065128.446181:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cc380 00000100:00100000:0.0:1746065128.449567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.449599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.449618:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.449637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.449648:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.449655:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261229568 00000100:00100000:0.0:1746065128.449659:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261229696 00000100:00100000:2.0:1746065128.449662:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261229568 00000100:00100000:0.0:1746065128.449662:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261229696 00000100:00100000:2.0:1746065128.449687:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261229824 00000100:00100000:2.0:1746065128.449688:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261229824 00000100:00100000:0.0:1746065128.449737:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261229952 00000100:00100000:0.0:1746065128.449739:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261229952 00000100:00100000:2.0:1746065128.449741:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11263 00000100:00100000:2.0:1746065128.449747:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1959:x1830881261229568:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:0.0:1746065128.449752:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11264 00000100:00100000:0.0:1746065128.449757:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881261229696:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065128.449761:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.449764:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.449773:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4544 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb7e expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.449811:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259806976:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065128.449873:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.449893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.449974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065128.449995:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb77 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.450009:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.450010:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.450018:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb77 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.450030:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb77 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.450039:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003000, rc 0) 00000100:00100000:2.0:1746065128.450060:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881261229568:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 314us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.450067:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11263 00000100:00100000:2.0:1746065128.450077:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261230080 00000100:00100000:2.0:1746065128.450079:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261230080 00000100:00100000:2.0:1746065128.450086:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261230208 00000100:00100000:2.0:1746065128.450088:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261230208 00000100:00100000:2.0:1746065128.450094:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11265 00000100:00100000:2.0:1746065128.450098:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881261229824:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065128.450104:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.450110:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb85 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.450118:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.450119:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.450124:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb85 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.450132:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb85 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.450139:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003c00, rc 0) 00000100:00100000:2.0:1746065128.450149:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881261229824:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.450154:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11265 00000100:00100000:2.0:1746065128.450166:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11266 00000100:00100000:2.0:1746065128.450170:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881261229952:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065128.450175:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.450181:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb8c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.450188:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.450189:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.450193:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb8c expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00000100:00080000:3.0:1746065128.450194:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746065128.450201:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb8c expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.450207:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003200, rc 0) 00000100:00100000:3.0:1746065128.450209:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11267 00000100:00100000:3.0:1746065128.450216:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881261230080:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:2.0:1746065128.450216:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881261229952:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 46us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.450221:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11266 00010000:00010000:3.0:1746065128.450222:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.450229:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb93 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.450233:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11268 00000100:00100000:2.0:1746065128.450237:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881261230208:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065128.450239:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.450240:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.450241:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.450244:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb93 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.450246:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bb9a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.450252:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb93 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.450254:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.450255:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.450258:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2c1e00, rc 0) 00010000:00010000:2.0:1746065128.450259:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb9a expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.450266:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb9a expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065128.450276:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881261230080:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 61us (382us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065128.450277:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003e00, rc 0) 00000100:00100000:3.0:1746065128.450280:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11267 00000100:00100000:2.0:1746065128.450308:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1958:x1830881261230208:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 63us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.450310:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261229440 00000100:00100000:3.0:1746065128.450313:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261229440 00000100:00100000:2.0:1746065128.450313:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11268 00000100:00100000:3.0:1746065128.450334:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3758 00000100:00100000:3.0:1746065128.450338:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:29210:x1830881261229440:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065128.450471:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:29210:x1830881261229440:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 131us (908us total) trans 8589943219 rc 0/0 00000100:00100000:3.0:1746065128.450477:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3758 00002000:00010000:1.0:1746065128.451765:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065128 -> 1746065129 00002000:00010000:1.0:1746065128.451769:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime: 1746065128 -> 1746065129 00002000:00010000:1.0:1746065128.451771:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065128 -> 1746065129 00000100:00100000:1.0:1746065128.451786:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259806976:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065128.451807:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4544 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb7e expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.451836:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4544 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb7e expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.451855:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f144600, rc 0) 00000100:00100000:1.0:1746065128.451875:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881261229696:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2118us (2256us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065128.451881:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11264 00000100:00100000:0.0:1746065128.453773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.454967:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261230464 00000100:00100000:2.0:1746065128.454976:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261230464 00000100:00100000:2.0:1746065128.455012:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9143 00000100:00100000:2.0:1746065128.455019:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29211:x1830881261230464:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065128.455033:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.455049:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f4567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bba1 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.455124:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.455135:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb5b expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.455141:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb62 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.455147:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb70 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.455326:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 6/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.455355:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb70 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.455365:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb70 expref: 8 pid: 24350 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.455375:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259807104:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.455466:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb62 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.455473:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb62 expref: 12 pid: 14643 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.455480:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259807232:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.455618:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb5b expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.455629:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb5b expref: 251 pid: 14643 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.455637:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259807360:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.455652:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.458392:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259807104:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.458406:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259807232:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.458412:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881259807360:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.458434:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065128.460760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.460792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.460805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.460838:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261230720 00000100:00100000:1.0:1746065128.460846:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261230720 00010000:00010000:1.0:1746065128.460874:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb70 expref: 9 pid: 24350 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.460894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.460895:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261230592 00000100:00100000:1.0:1746065128.460896:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261230592 00010000:00010000:1.0:1746065128.460905:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb62 expref: 13 pid: 14643 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746065128.460915:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261230848 00000100:00100000:1.0:1746065128.460917:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261230848 00010000:00010000:1.0:1746065128.460926:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb5b expref: 252 pid: 14643 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.460928:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5616 00000100:00100000:0.0:1746065128.460935:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881261230720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065128.460936:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5617 00000100:00100000:1.0:1746065128.460940:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261230592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.460948:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.460948:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.460953:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb62 expref: 13 pid: 14643 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.460953:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb70 expref: 9 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.460962:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb70 expref: 9 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065128.460968:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb62 expref: 13 pid: 14643 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.461010:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5618 00000100:00100000:2.0:1746065128.461018:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:1961:x1830881261230848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.461025:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.461029:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb5b expref: 252 pid: 14643 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.461296:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261230976 00000100:00100000:3.0:1746065128.461299:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261230976 00000100:00100000:3.0:1746065128.461317:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11269 00000100:00100000:3.0:1746065128.461321:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:29206:x1830881261230976:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065128.461333:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.461375:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2c1400/0x14b4f8542d4f4536 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb70 expref: 9 pid: 24350 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.461592:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bba8 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.461613:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.461621:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb85 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.461628:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb2a expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.461633:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.461635:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.461638:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1368064->2097151] (req 1368064->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.461662:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb2a expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.461671:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb2a expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.461681:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259807488:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.461740:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb85 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.461753:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb85 expref: 7 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.461760:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259807616:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.461781:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.461788:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 21 pid: 4544 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.461794:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259807744:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.461804:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065128.462233:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f450c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb62 expref: 13 pid: 14643 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746065128.462250:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065128.462254:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.462261:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065128.462266:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.462304:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261230592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1361us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.462310:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5617 00010000:00010000:2.0:1746065128.462679:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb5b expref: 252 pid: 14643 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.462702:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f44e9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb5b expref: 252 pid: 14643 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.462719:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.462721:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.462728:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.462732:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.462746:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.462765:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1961:x1830881261230848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1749us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.462771:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5618 00010000:00010000:2.0:1746065128.462792:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.462799:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065128.462827:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065128.463611:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f4567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba1 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.463623:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba1 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.463628:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.463631:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065128.463633:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002200, rc 0) 00000100:00100000:2.0:1746065128.463674:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29211:x1830881261230464:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 8655us (9904us total) trans 8589943220 rc 0/0 00000100:00100000:2.0:1746065128.463679:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9143 00010000:00010000:0.0:1746065128.464479:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065128.464484:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065128.464508:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881261230720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3573us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.464514:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5616 00000100:00100000:2.0:1746065128.464785:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259807488:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.464794:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259807616:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.464800:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259807744:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.464836:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1368064->2097151] (req 1368064->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.464847:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2c1600, rc 0) 00000100:00100000:2.0:1746065128.464868:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:29206:x1830881261230976:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3545us (3973us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.464876:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11269 00000100:00100000:0.0:1746065128.466956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.466982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.467018:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.467033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.467051:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.467390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.467472:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261231616 00000100:00100000:2.0:1746065128.467473:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261231104 00000100:00100000:2.0:1746065128.467478:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261231104 00000100:00100000:0.0:1746065128.467478:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261231616 00010000:00010000:2.0:1746065128.467502:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb2a expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065128.467504:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261231872 00000100:00100000:0.0:1746065128.467506:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261231872 00000100:00100000:0.0:1746065128.467516:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261232128 00000100:00100000:2.0:1746065128.467517:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261231360 00000100:00100000:2.0:1746065128.467518:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261231360 00000100:00100000:0.0:1746065128.467518:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261232128 00010000:00010000:2.0:1746065128.467525:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 22 pid: 4544 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065128.467529:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9144 00000100:00100000:0.0:1746065128.467535:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:29216:x1830881261231616:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065128.467536:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261231232 00000100:00100000:2.0:1746065128.467537:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261231232 00010000:00010000:2.0:1746065128.467543:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb85 expref: 8 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065128.467552:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065128.467554:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5619 00000100:00100000:2.0:1746065128.467558:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881261231104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.467564:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f4583 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbaf expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.467567:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.467583:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb2a expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.467592:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb2a expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.467605:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900fc800/0x14b4f8542d4f44a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb2a expref: 31 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.467620:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065128.467635:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065128.467644:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881261231104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (661us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065128.467644:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065128.467649:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5619 00010000:00010000:0.0:1746065128.467652:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065128.467660:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5620 00000100:00100000:2.0:1746065128.467664:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+22:1958:x1830881261231360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.467668:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.467670:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.467674:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.467676:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 22 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.467679:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.467683:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 22 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.467692:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0132600/0x14b4f8542d4f449c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb23 expref: 22 pid: 4544 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.467699:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.467711:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+21:1958:x1830881261231360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.467715:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5620 00000100:00100000:2.0:1746065128.467724:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5621 00000100:00100000:2.0:1746065128.467727:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1958:x1830881261231232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.467733:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.467739:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb85 expref: 8 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.467746:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb85 expref: 8 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.467756:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f454b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb85 expref: 8 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065128.467759:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.467762:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.467764:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.467765:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.467769:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.467770:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.467775:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1746065128.467777:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065128.467795:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.467804:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259807872:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065128.467852:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065128.467860:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065128.467861:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065128.467865:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065128.467870:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f145a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065128.467873:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065128.467877:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9145 00010000:00010000:0.0:1746065128.467878:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065128.467882:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29218:x1830881261231872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065128.467885:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065128.467887:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065128.467889:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.467890:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.467894:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f45a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbb6 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.467894:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145a00/0x14b4f8542d4f458a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065128.467902:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065128.467906:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065128.467910:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065128.467914:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f145200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065128.467916:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065128.467923:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065128.467928:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5a36c00) 00010000:00010000:2.0:1746065128.467930:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.467930:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065128.467932:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.467936:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.467936:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145200/0x14b4f8542d4f4591 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.467941:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.467947:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.467951:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.467956:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.467960:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144c00/0x14b4f8542d4f4583 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbaf expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.467968:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbaf expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.467974:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065128.467975:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065128.467977:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f145400, rc 0) 00010000:00010000:2.0:1746065128.467996:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065128.467996:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:29216:x1830881261231616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 461us (1046us total) trans 8589943221 rc 0/0 00000100:00100000:0.0:1746065128.468001:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9144 00010000:00010000:2.0:1746065128.468002:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.468008:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065128.468012:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000100:00100000:0.0:1746065128.468014:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9146 00000100:00100000:0.0:1746065128.468018:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29211:x1830881261232128:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065128.468025:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.468026:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065128.468033:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f456e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba1 expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.468041:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065128.468043:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065128.468045:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468047:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f45c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbbd expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.468050:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.468058:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.468062:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6002600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065128.468064:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065128.468068:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468072:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.468074:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065128.468076:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065128.468078:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468078:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.468082:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f45ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468083:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.468088:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468089:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.468092:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468093:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.468097:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468098:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.468100:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6002800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065128.468101:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f144600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065128.468102:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468103:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.468106:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468107:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065128.468112:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065128.468113:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065128.468114:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205f00) 00010000:00010000:2.0:1746065128.468116:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065128.468116:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.468118:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468120:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f45d0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065128.468122:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f45b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065128.468134:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f45c9 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbbd expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.468139:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144e00/0x14b4f8542d4f45c9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbbd expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.468141:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f45a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbb6 expref: 254 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.468145:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f144e00, rc 0) 00010000:00010000:2.0:1746065128.468148:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbb6 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.468152:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.468153:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065128.468155:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002c00, rc 0) 00000100:00100000:0.0:1746065128.468159:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29211:x1830881261232128:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 140us (770us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065128.468164:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9146 00000100:00100000:2.0:1746065128.468165:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:29218:x1830881261231872:12345-192.168.202.46@tcp:101:cat.0 Request processed in 284us (1147us total) trans 8589943222 rc 0/0 00000100:00100000:2.0:1746065128.468169:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9145 00000100:00100000:0.0:1746065128.472008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.472045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.472068:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261232256 00000100:00100000:0.0:1746065128.472072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.472076:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261232256 00000100:00100000:2.0:1746065128.472104:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261232384 00000100:00100000:2.0:1746065128.472106:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261232384 00000100:00100000:2.0:1746065128.472120:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11270 00000100:00100000:2.0:1746065128.472126:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261232256:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065128.472140:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065128.472149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065128.472156:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f45d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbc4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.472216:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261232640 00000100:00100000:3.0:1746065128.472220:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261232640 00000100:00100000:3.0:1746065128.472241:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261233024 00000100:00100000:3.0:1746065128.472243:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261233024 00000100:00100000:3.0:1746065128.472272:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3759 00000100:00100000:3.0:1746065128.472277:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+14:29216:x1830881261232640:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065128.472457:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+15:29216:x1830881261232640:12345-192.168.202.46@tcp:35:cat.0 Request processed in 178us (383us total) trans 8589943223 rc 0/0 00000100:00100000:3.0:1746065128.472467:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3759 00000100:00100000:3.0:1746065128.472481:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3760 00000100:00100000:3.0:1746065128.472485:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29211:x1830881261233024:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065128.472527:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259808000:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065128.472581:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.472597:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11271 00000100:00100000:2.0:1746065128.472602:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261232384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065128.472608:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.472615:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f45de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbcb expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.472637:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259808128:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065128.472661:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.472737:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29211:x1830881261233024:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 251us (587us total) trans 8589943224 rc 0/0 00000100:00100000:3.0:1746065128.472743:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3760 00000100:00100000:3.0:1746065128.472784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.472801:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261233152 00000100:00100000:3.0:1746065128.472804:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261233152 00002000:00100000:3.0:1746065128.472852:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1368064->1372159) req@ffff8800a0086d80 x1830881261233152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.472861:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086d80 with x1830881261233152 ext(1368064->1372159) 00002000:00010000:3.0:1746065128.472864:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0086d80 00000100:00100000:3.0:1746065128.472880:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5185 00000100:00100000:3.0:1746065128.472884:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261233152:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065128.472982:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261233152:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 97us (197us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065128.472987:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5185 00002000:00100000:3.0:1746065128.472992:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1368064->1372159) req@ffff8800a0086d80 x1830881261233152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.472997:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086d80 with x1830881261233152 ext(1368064->1372159) 00002000:00010000:3.0:1746065128.473000:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0086d80 00000100:00100000:3.0:1746065128.473117:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881259807872:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065128.473129:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.473148:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1958:x1830881261231232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5420us (6097us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.473155:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5621 00000100:00100000:2.0:1746065128.474301:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259808000:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065128.474319:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f45d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbc4 expref: 33 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.474328:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f45d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbc4 expref: 33 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.474336:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8df600, rc 0) 00000100:00100000:2.0:1746065128.474357:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261232256:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2231us (2358us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065128.474362:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11270 00002000:00010000:3.0:1746065128.474650:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime: 1746065127 -> 1746065129 00000100:00100000:3.0:1746065128.474664:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259808128:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065128.474678:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f45de lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbcb expref: 31 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.474685:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0de200/0x14b4f8542d4f45de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbcb expref: 31 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.474692:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0de200, rc 0) 00000100:00100000:3.0:1746065128.474892:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261232384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2289us (2845us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065128.474897:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11271 00000100:00100000:0.0:1746065128.475786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.475931:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261233280 00000100:00100000:3.0:1746065128.475936:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261233280 00000100:00100000:3.0:1746065128.475960:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11272 00000100:00100000:3.0:1746065128.475965:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261233280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.475978:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.475987:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1c00/0x14b4f8542d4f45e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbd2 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.476020:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259808256:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065128.476588:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.480925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.480984:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261233536 00000100:00100000:2.0:1746065128.480992:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261233536 00002000:00100000:2.0:1746065128.481031:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012b4b0000 x1830881261233536/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.481040:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0000 with x1830881261233536 ext(0->1048575) 00002000:00010000:2.0:1746065128.481044:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4b0000 00000100:00100000:2.0:1746065128.481074:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5186 00000100:00100000:2.0:1746065128.481081:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261233536:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065128.481941:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.482167:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259808256:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065128.482195:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1c00/0x14b4f8542d4f45e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd2 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.482206:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1c00/0x14b4f8542d4f45e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd2 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.482216:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2c1c00, rc 0) 00000100:00100000:3.0:1746065128.482266:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261233280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6299us (6480us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065128.482276:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11272 00000100:00100000:3.0:1746065128.482362:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261233664 00000100:00100000:3.0:1746065128.482366:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261233664 00000100:00100000:3.0:1746065128.482384:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11273 00000100:00100000:3.0:1746065128.482389:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:29206:x1830881261233664:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065128.482398:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.482410:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbd9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.482427:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba74 expref: 50 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.482434:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb8c expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.482441:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bad6 expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.482445:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.482447:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.482450:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 50 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.482471:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bad6 expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.482480:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bad6 expref: 29 pid: 21235 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.482489:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259808384:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.482543:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb8c expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.482550:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb8c expref: 7 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.482557:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259808512:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.483034:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba74 expref: 50 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.483043:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba74 expref: 50 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.483051:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259808640:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.483065:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.492087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.492117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.492573:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234048 00000100:00100000:1.0:1746065128.492582:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234048 00002000:00100000:1.0:1746065128.492616:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88013667c000 x1830881261234048/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 504/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065128.492624:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667c000 with x1830881261234048 ext(1048576->2097151) 00002000:00010000:1.0:1746065128.492629:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013667c000 00000100:00100000:1.0:1746065128.494470:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234176 00000100:00100000:2.0:1746065128.494473:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1960:x1830881261233536:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13387us (13549us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065128.494476:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234176 00000100:00100000:2.0:1746065128.494482:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5186 00002000:00100000:2.0:1746065128.494490:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88012b4b0000 x1830881261233536/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065128.494497:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88013667ca80 x1830881261234176/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.494498:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4b0000 with x1830881261233536 ext(0->1048575) 00002000:00010000:2.0:1746065128.494502:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4b0000 00002000:00100000:1.0:1746065128.494504:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667ca80 with x1830881261234176 ext(0->1048575) 00002000:00010000:1.0:1746065128.494506:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013667ca80 00000100:00100000:3.0:1746065128.494659:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5187 00000100:00100000:3.0:1746065128.494667:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261234048:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.495110:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5188 00000100:00100000:2.0:1746065128.495118:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881261234176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065128.495240:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.495523:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234304 00000100:00100000:3.0:1746065128.495527:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234304 00010000:00010000:3.0:1746065128.495546:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb8c expref: 8 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746065128.495568:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5622 00000100:00100000:3.0:1746065128.495573:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261234304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.495581:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.495594:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb8c expref: 8 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746065128.495603:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb8c expref: 8 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746065128.495620:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.495649:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261234304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.495654:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5622 00000100:00100000:2.0:1746065128.499456:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259808384:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.499472:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f4552 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb8c expref: 7 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065128.499506:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259808512:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.499517:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259808640:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.499542:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 48 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.499560:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2c0a00, rc 0) 00000100:00100000:2.0:1746065128.502234:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:29206:x1830881261233664:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 19835us (20286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.502243:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11273 00000100:00100000:0.0:1746065128.502332:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.502486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.502553:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234432 00000100:00100000:2.0:1746065128.502559:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234432 00010000:00010000:2.0:1746065128.502588:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba74 expref: 48 pid: 8428 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065128.502615:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234560 00000100:00100000:2.0:1746065128.502617:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234560 00010000:00010000:2.0:1746065128.502629:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bad6 expref: 32 pid: 21235 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746065128.502644:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5623 00000100:00100000:2.0:1746065128.502651:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1960:x1830881261234432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.502662:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.502680:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba74 expref: 48 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.502689:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba74 expref: 48 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.502707:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d173e00/0x14b4f8542d4f437d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba74 expref: 48 pid: 8428 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.502723:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.502751:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261234432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 101us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.502757:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5623 00000100:00100000:2.0:1746065128.502767:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5624 00000100:00100000:2.0:1746065128.502772:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+32:1958:x1830881261234560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.502778:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.502785:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bad6 expref: 32 pid: 21235 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.502793:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bad6 expref: 32 pid: 21235 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.502803:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f76a600/0x14b4f8542d4f4433 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bad6 expref: 32 pid: 21235 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746065128.502811:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.502827:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.502834:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 46 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.502841:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 46 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.502868:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 46 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.502879:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259808768:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065128.502926:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.507968:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+21:1961:x1830881261234048:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13293us (15879us total) trans 0 rc 970752/970752 00000100:00100000:3.0:1746065128.507979:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5187 00002000:00100000:3.0:1746065128.507991:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88013667c000 x1830881261234048/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 504/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 970752/970752 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.507998:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667c000 with x1830881261234048 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.508003:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013667c000 00000100:00100000:0.0:1746065128.510997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.511131:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259808768:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065128.511148:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.511180:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+31:1958:x1830881261234560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8407us (8693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.511189:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5624 00000100:00100000:2.0:1746065128.511294:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234688 00000100:00100000:2.0:1746065128.511299:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234688 00000100:00100000:2.0:1746065128.511334:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11274 00000100:00100000:2.0:1746065128.511340:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:29218:x1830881261234688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065128.511354:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.511366:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbe0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.511389:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.511395:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.511396:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.511400:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 31 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.511421:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.511431:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 20 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.511441:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259808896:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.511936:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.512373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.512407:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234944 00000100:00100000:3.0:1746065128.512411:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234944 00002000:00100000:3.0:1746065128.512434:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1314816->1318911) req@ffff88013667c380 x1830881261234944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.512442:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667c380 with x1830881261234944 ext(1314816->1318911) 00002000:00010000:3.0:1746065128.512445:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013667c380 00000100:00100000:3.0:1746065128.512457:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5189 00000100:00100000:3.0:1746065128.512461:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881261234944:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065128.513217:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881261234944:12345-192.168.202.46@tcp:3:cat.0 Request processed in 753us (843us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065128.513226:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5189 00002000:00100000:3.0:1746065128.513231:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1314816->1318911) req@ffff88013667c380 x1830881261234944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.513238:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667c380 with x1830881261234944 ext(1314816->1318911) 00002000:00010000:3.0:1746065128.513241:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013667c380 00000100:00100000:2.0:1746065128.513588:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261234176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18470us (21467us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.513594:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5188 00002000:00100000:2.0:1746065128.513599:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88013667ca80 x1830881261234176/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.513606:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667ca80 with x1830881261234176 ext(0->1048575) 00002000:00010000:2.0:1746065128.513609:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013667ca80 00000100:00100000:2.0:1746065128.516150:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259808896:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.516176:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 31 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.516191:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0df000, rc 0) 00000100:00100000:2.0:1746065128.516235:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:29218:x1830881261234688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4894us (5243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.516243:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11274 00000100:00100000:0.0:1746065128.516834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.517991:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235072 00000100:00100000:2.0:1746065128.517998:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235072 00002000:00100000:2.0:1746065128.518034:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1187840->1265663) req@ffff88013667d180 x1830881261235072/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.518042:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667d180 with x1830881261235072 ext(1187840->1265663) 00010000:00010000:2.0:1746065128.518050:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 21 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.518061:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 21 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065128.518068:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013667d180 00000100:00100000:2.0:1746065128.518099:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1570 00000100:00100000:2.0:1746065128.518107:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+21:1960:x1830881261235072:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065128.519942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.520006:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235328 00000100:00100000:3.0:1746065128.520013:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235328 00000100:00100000:3.0:1746065128.520043:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3761 00000100:00100000:3.0:1746065128.520049:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009badd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:29206:x1830881261235328:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065128.520228:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009badd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:29206:x1830881261235328:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 177us (290us total) trans 8589943225 rc 0/0 00000100:00100000:3.0:1746065128.520234:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3761 00000100:00100000:2.0:1746065128.526931:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013667d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261235072:12345-192.168.202.46@tcp:4:cat.0 Request processed in 8818us (10091us total) trans 21474840150 rc 0/0 00000100:00100000:2.0:1746065128.526940:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1570 00002000:00100000:2.0:1746065128.526949:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1187840->1265663) req@ffff88013667d180 x1830881261235072/t21474840150(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.526958:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013667d180 with x1830881261235072 ext(1187840->1265663) 00010000:00010000:2.0:1746065128.526966:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 23 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.526979:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 23 pid: 21998 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065128.526985:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013667d180 00000100:00100000:0.0:1746065128.527176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.527231:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235456 00000100:00100000:2.0:1746065128.527238:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235456 00000100:00100000:2.0:1746065128.527273:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11275 00000100:00100000:2.0:1746065128.527279:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:29216:x1830881261235456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065128.527300:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.527311:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbe7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.527397:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.527402:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.527412:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.527420:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0df600, rc 0) 00000100:00100000:2.0:1746065128.527559:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:29216:x1830881261235456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 279us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.527564:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11275 00000100:00100000:0.0:1746065128.532808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.532877:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235584 00000100:00100000:3.0:1746065128.532884:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235584 00010000:00010000:3.0:1746065128.532914:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 24 pid: 21998 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.532938:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5625 00000100:00100000:3.0:1746065128.532945:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881261235584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.532957:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.532976:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 24 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.532987:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 24 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.533006:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f454a00/0x14b4f8542d4f451a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1187840->1265663) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb69 expref: 24 pid: 21998 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.533026:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.533028:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.533034:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.533041:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.533049:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.533050:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.533052:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.533058:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.533089:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.533102:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259809024:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065128.533421:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.533536:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259809152:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065128.533789:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.535408:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259809024:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065128.538588:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259809152:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065128.538605:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.538636:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+23:1959:x1830881261235584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5691us (5833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.538644:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5625 00000100:00100000:0.0:1746065128.541125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.541320:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235840 00000100:00100000:2.0:1746065128.541327:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235840 00002000:00100000:2.0:1746065128.541363:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b45d180 x1830881261235840/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.541372:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d180 with x1830881261235840 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.541376:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45d180 00000100:00100000:2.0:1746065128.541400:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5190 00000100:00100000:2.0:1746065128.541406:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261235840:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065128.552239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.553073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.553706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.553903:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261236352 00000100:00100000:3.0:1746065128.553911:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261236352 00002000:00100000:3.0:1746065128.553946:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1368063) req@ffff88012b45e300 x1830881261236352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.553955:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e300 with x1830881261236352 ext(1048576->1368063) 00002000:00010000:3.0:1746065128.553960:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45e300 00000100:00100000:3.0:1746065128.553978:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261236608 00000100:00100000:3.0:1746065128.553981:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261236608 00002000:00100000:3.0:1746065128.553993:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1318912->2097151) req@ffff88012b45e680 x1830881261236608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.554000:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e680 with x1830881261236608 ext(1318912->2097151) 00002000:00010000:3.0:1746065128.554002:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45e680 00000100:00100000:3.0:1746065128.554011:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261236224 00000100:00100000:3.0:1746065128.554013:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261236224 00002000:00100000:3.0:1746065128.554021:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b45ea00 x1830881261236224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.554033:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ea00 with x1830881261236224 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.554036:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ea00 00000100:00100000:3.0:1746065128.554045:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5191 00000100:00100000:3.0:1746065128.554052:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261236352:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065128.554452:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5192 00000100:00100000:3.0:1746065128.554456:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261236608:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065128.555111:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5193 00000100:00100000:3.0:1746065128.555116:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261236224:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065128.556186:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+23:1960:x1830881261235840:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14778us (15065us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.556193:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5190 00002000:00100000:2.0:1746065128.556200:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b45d180 x1830881261235840/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.556214:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d180 with x1830881261235840 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.556218:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45d180 00000100:00100000:3.0:1746065128.571868:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261236352:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17806us (19627us total) trans 0 rc 319488/319488 00000100:00100000:3.0:1746065128.571879:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5191 00002000:00100000:3.0:1746065128.571888:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1368063) req@ffff88012b45e300 x1830881261236352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 319488/319488 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.571897:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e300 with x1830881261236352 ext(1048576->1368063) 00002000:00010000:3.0:1746065128.571902:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45e300 00000100:00100000:2.0:1746065128.575022:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261236608:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20556us (21941us total) trans 0 rc 778240/778240 00000100:00100000:2.0:1746065128.575033:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5192 00002000:00100000:2.0:1746065128.575042:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1318912->2097151) req@ffff88012b45e680 x1830881261236608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.575051:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e680 with x1830881261236608 ext(1318912->2097151) 00002000:00010000:2.0:1746065128.575055:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45e680 00000100:00100000:3.0:1746065128.576957:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261236224:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21832us (23243us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.576967:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5193 00002000:00100000:3.0:1746065128.576976:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88012b45ea00 x1830881261236224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.576985:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ea00 with x1830881261236224 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.576990:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ea00 00000100:00100000:0.0:1746065128.588113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.589183:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261236736 00000100:00100000:2.0:1746065128.589193:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261236736 00000100:00100000:2.0:1746065128.589239:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11276 00000100:00100000:2.0:1746065128.589246:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+23:29216:x1830881261236736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065128.589261:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.589275:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbee expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.589307:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.589314:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.589315:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.589318:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.589344:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.589354:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 30 pid: 8851 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.589364:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259809280:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.592123:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.601042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.601672:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261236864 00000100:00100000:3.0:1746065128.601740:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261236864 00002000:00100000:3.0:1746065128.601779:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1368064->2097151) req@ffff88012b45d880 x1830881261236864/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.601789:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881261236864 ext(1368064->2097151) 00010000:00010000:3.0:1746065128.601798:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 31 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.601811:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 31 pid: 8851 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746065128.601835:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b45d880 00000100:00100000:3.0:1746065128.601854:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1571 00000100:00100000:3.0:1746065128.601861:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881261236864:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065128.602502:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259809280:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.602526:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.602541:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f231a00, rc 0) 00000100:00100000:2.0:1746065128.606683:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+24:29216:x1830881261236736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 17426us (18565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.606694:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11276 00000100:00100000:0.0:1746065128.609775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.609812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.610255:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261237120 00000100:00100000:3.0:1746065128.610263:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261237120 00000100:00100000:3.0:1746065128.612898:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9147 00000100:00100000:3.0:1746065128.612913:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+15:29222:x1830881261237120:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065128.612933:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.612949:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbf5 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.613034:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613044:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613053:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613061:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613066:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613071:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613153:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613160:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613165:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065128.613173:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065128.613238:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613244:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613248:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613253:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6002000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.613255:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613261:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613268:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065128.613270:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.613273:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613277:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002000/0x14b4f8542d4f460f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613306:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613310:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613314:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613317:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6003c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.613320:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613324:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613329:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f200) 00010000:00010000:3.0:1746065128.613331:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.613332:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613336:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4616 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.613366:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbf5 expref: 18 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.613376:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbf5 expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.613381:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.613382:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065128.613384:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002600, rc 0) 00000100:00100000:1.0:1746065128.615551:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261237248 00000100:00100000:1.0:1746065128.615560:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261237248 00000100:00100000:1.0:1746065128.615605:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9148 00000100:00100000:1.0:1746065128.615612:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29223:x1830881261237248:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065128.615626:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065128.615661:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+17:29222:x1830881261237120:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2752us (5891us total) trans 8589943226 rc 0/0 00000100:00100000:3.0:1746065128.615671:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9147 00010000:00010000:1.0:1746065128.615719:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fceb800/0x14b4f8542d4f462b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bbfc expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.616893:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.616903:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.616912:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.616921:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.616926:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.616930:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617001:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617008:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617012:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065128.617032:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065128.617035:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065128.617045:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617052:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617058:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617062:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617066:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617069:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcea400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.617072:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617077:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617084:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065128.617087:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.617090:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617094:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea400/0x14b4f8542d4f4632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617101:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617105:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617108:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617111:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6003800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.617113:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617117:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617122:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f500) 00010000:00010000:3.0:1746065128.617124:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.617126:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617129:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f4639 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.617151:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fceb800/0x14b4f8542d4f462b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbfc expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.617161:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbfc expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.617170:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.617172:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065128.617174:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002800, rc 0) 00000100:00100000:3.0:1746065128.617201:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29223:x1830881261237248:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1589us (7388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.617207:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9148 00000100:00100000:3.0:1746065128.617248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.617268:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261237376 00000100:00100000:3.0:1746065128.617272:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261237376 00000100:00100000:3.0:1746065128.617307:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11277 00000100:00100000:3.0:1746065128.617312:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881261237376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.617320:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.617329:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f4647 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc03 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.617364:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259809408:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065128.617849:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.627373:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259809408:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065128.627407:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f4647 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc03 expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.627421:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6002200/0x14b4f8542d4f4647 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc03 expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.627430:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002200, rc 0) 00000100:00100000:3.0:1746065128.627476:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881261237376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10163us (10227us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065128.627483:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11277 00000100:00100000:0.0:1746065128.627803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.627827:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.627847:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.627868:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261237504 00000100:00100000:0.0:1746065128.627873:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261237504 00000100:00100000:0.0:1746065128.627892:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261237632 00000100:00100000:0.0:1746065128.627894:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261237632 00000100:00100000:0.0:1746065128.627905:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261237760 00000100:00100000:0.0:1746065128.627907:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261237760 00000100:00100000:0.0:1746065128.627917:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11278 00000100:00100000:0.0:1746065128.627922:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261237504:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065128.627932:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.627942:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc0a expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.627957:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.627959:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.627966:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc0a expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.627976:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc0a expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.627983:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085800, rc 0) 00000100:00100000:0.0:1746065128.627998:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261237504:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.628002:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11278 00000100:00100000:0.0:1746065128.628015:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11279 00000100:00100000:0.0:1746065128.628018:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261237632:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065128.628022:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.628026:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4655 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc11 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.628051:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259809536:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065128.628088:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.628146:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11280 00000100:00100000:0.0:1746065128.628150:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261237760:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065128.628157:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.628164:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944f3400/0x14b4f8542d4f465c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc18 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.628183:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259809664:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065128.628200:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.630322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.632258:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261237888 00000100:00100000:3.0:1746065128.632268:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261237888 00002000:00010000:0.0:1746065128.633312:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065128 -> 1746065129 00002000:00010000:0.0:1746065128.633317:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065127 -> 1746065129 00002000:00010000:0.0:1746065128.633319:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065128 -> 1746065129 00000100:00100000:0.0:1746065128.633338:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259809664:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065128.633363:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944f3400/0x14b4f8542d4f465c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc18 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.633376:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944f3400/0x14b4f8542d4f465c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc18 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.633390:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f3400, rc 0) 00000100:00100000:0.0:1746065128.633425:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261237760:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 5273us (5575us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065128.633432:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11280 00000100:00100000:0.0:1746065128.633455:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11281 00000100:00100000:0.0:1746065128.633462:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261237888:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065128.633475:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.633486:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900fc200/0x14b4f8542d4f4663 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc1f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.633523:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259809792:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065128.633561:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065128.635003:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259809536:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065128.635023:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4655 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc11 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.635034:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133085600/0x14b4f8542d4f4655 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc11 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.635049:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085600, rc 0) 00000100:00100000:1.0:1746065128.635078:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261237632:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 7058us (7249us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065128.635084:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11279 00000100:00100000:2.0:1746065128.637492:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261236864:12345-192.168.202.46@tcp:4:cat.0 Request processed in 35624us (36451us total) trans 21474840151 rc 0/0 00000100:00100000:2.0:1746065128.637502:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1571 00002000:00100000:2.0:1746065128.637511:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1368064->2097151) req@ffff88012b45d880 x1830881261236864/t21474840151(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.637519:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881261236864 ext(1368064->2097151) 00010000:00010000:2.0:1746065128.637527:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 35 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.637540:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 35 pid: 8851 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065128.637546:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b45d880 00000100:00100000:2.0:1746065128.638371:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259809792:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065128.638395:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900fc200/0x14b4f8542d4f4663 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc1f expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.639164:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900fc200/0x14b4f8542d4f4663 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc1f expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.639202:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900fc200, rc 0) 00000100:00100000:2.0:1746065128.639256:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261237888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5791us (8937us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065128.639264:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11281 00000100:00100000:0.0:1746065128.640713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.640897:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261238144 00000100:00100000:3.0:1746065128.640906:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261238144 00000100:00100000:3.0:1746065128.640954:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9149 00000100:00100000:3.0:1746065128.640964:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29223:x1830881261238144:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065128.640983:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.641000:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f466a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc26 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.641088:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.641103:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbf5 expref: 16 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.641110:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbfc expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.641115:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.641145:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbfc expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.641155:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbfc expref: 10 pid: 14645 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.641170:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259809920:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.641269:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbf5 expref: 16 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.641279:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbf5 expref: 16 pid: 14643 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.641325:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259810048:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.641354:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.643460:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.643714:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261238272 00000100:00100000:3.0:1746065128.643720:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261238272 00010000:00010000:3.0:1746065128.643750:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 33 pid: 8851 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.643779:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5626 00000100:00100000:3.0:1746065128.643787:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261238272:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.643800:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.643856:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 33 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.643868:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 33 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.643888:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2c1600/0x14b4f8542d4f4575 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1368064->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bba8 expref: 33 pid: 8851 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.643908:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.643910:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.643916:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.643924:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.643955:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.643967:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259810176:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065128.645942:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.648586:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259809920:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.648603:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259810048:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.648628:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065128.650550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.650569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.650811:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.650875:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261238528 00000100:00100000:0.0:1746065128.650884:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261238528 00010000:00010000:0.0:1746065128.650909:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbfc expref: 11 pid: 14645 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.650954:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261238656 00000100:00100000:3.0:1746065128.650957:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261238656 00000100:00100000:3.0:1746065128.650981:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11282 00000100:00100000:3.0:1746065128.650987:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261238656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.650998:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.651011:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc2d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.651031:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.651033:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.651040:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc2d expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.651052:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc2d expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.651060:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003600, rc 0) 00000100:00100000:0.0:1746065128.651466:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261238400 00000100:00100000:0.0:1746065128.651472:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261238400 00010000:00010000:0.0:1746065128.651488:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbf5 expref: 17 pid: 14643 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746065128.651546:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5627 00000100:00100000:2.0:1746065128.651556:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881261238528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.651569:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.651576:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbfc expref: 11 pid: 14645 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.651585:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbfc expref: 11 pid: 14645 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.651603:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f4640 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbfc expref: 11 pid: 14645 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.651622:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.651627:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.651634:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.651638:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.651844:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261238656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 853us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.651851:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11282 00000100:00100000:0.0:1746065128.651967:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5628 00000100:00100000:0.0:1746065128.651975:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881261238400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.651984:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.651990:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbf5 expref: 17 pid: 14643 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.652000:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbf5 expref: 17 pid: 14643 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.652036:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f461d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbf5 expref: 17 pid: 14643 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065128.652052:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065128.652055:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065128.652062:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065128.652068:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065128.652091:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065128.652550:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.652558:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065128.652576:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065128.652712:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f466a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc26 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.652726:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc26 expref: 11 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.652732:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.652734:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065128.652737:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002a00, rc 0) 00000100:00100000:2.0:1746065128.653235:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881261238528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1681us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.653243:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5627 00000100:00100000:0.0:1746065128.653337:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:1959:x1830881261238400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1362us (2765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.653343:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5628 00000100:00100000:3.0:1746065128.654239:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29223:x1830881261238144:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 13276us (13527us total) trans 8589943227 rc 0/0 00000100:00100000:3.0:1746065128.654245:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9149 00000100:00100000:3.0:1746065128.654841:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259810176:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065128.654866:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.655334:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261238272:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 11547us (11877us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.655341:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5626 00000100:00100000:0.0:1746065128.657363:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.657742:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261238912 00000100:00100000:2.0:1746065128.657751:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261238912 00002000:00100000:2.0:1746065128.657787:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012b45c700 x1830881261238912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.657795:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c700 with x1830881261238912 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.657800:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45c700 00000100:00100000:2.0:1746065128.657834:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5194 00000100:00100000:2.0:1746065128.657841:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261238912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065128.663500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.663635:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261239168 00000100:00100000:3.0:1746065128.663642:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261239168 00000100:00100000:3.0:1746065128.666036:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9150 00000100:00100000:3.0:1746065128.666051:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29223:x1830881261239168:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065128.666077:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.666080:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065128.666104:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002a00/0x14b4f8542d4f4671 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc26 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.666121:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.666124:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065128.666135:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003a00/0x14b4f8542d4f4686 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc34 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.666208:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666218:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666230:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666239:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666244:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666249:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666254:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6003200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.666257:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666262:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666268:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.666270:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065128.666273:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666277:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f468d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.666310:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003a00/0x14b4f8542d4f4686 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc34 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.666316:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003a00/0x14b4f8542d4f4686 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc34 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.666326:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003a00, rc 0) 00000100:00100000:3.0:1746065128.666376:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29223:x1830881261239168:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 330us (2882us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065128.666381:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9150 00000100:00100000:1.0:1746065128.667328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.667422:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261239424 00000100:00100000:0.0:1746065128.667428:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261239424 00000100:00100000:0.0:1746065128.667468:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3762 00000100:00100000:0.0:1746065128.667477:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:29218:x1830881261239424:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065128.667856:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29218:x1830881261239424:12345-192.168.202.46@tcp:35:cat.0 Request processed in 378us (526us total) trans 8589943228 rc 0/0 00000100:00100000:0.0:1746065128.667863:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3762 00000100:00100000:2.0:1746065128.673242:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261238912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15394us (15876us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065128.673251:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5194 00002000:00100000:2.0:1746065128.673261:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012b45c700 x1830881261238912/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.673270:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c700 with x1830881261238912 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.673276:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45c700 00000100:00100000:0.0:1746065128.676036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.676109:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261239680 00000100:00100000:3.0:1746065128.676117:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261239680 00000100:00100000:3.0:1746065128.676152:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3763 00000100:00100000:3.0:1746065128.676159:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29223:x1830881261239680:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065128.676327:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29223:x1830881261239680:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 168us (298us total) trans 8589943229 rc 0/0 00000100:00100000:3.0:1746065128.676334:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3763 00000100:00100000:0.0:1746065128.678507:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.678585:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261239808 00000100:00100000:3.0:1746065128.678592:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261239808 00000100:00100000:3.0:1746065128.678624:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11283 00000100:00100000:3.0:1746065128.678630:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+29:29216:x1830881261239808:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065128.678643:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.678657:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc3b expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.678680:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 46 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.678686:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065128.678687:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065128.678690:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.678712:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 46 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.678721:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 46 pid: 8427 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.678731:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259810304:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.678809:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.681806:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259810304:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.681852:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.681867:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002200, rc 0) 00000100:00100000:3.0:1746065128.681903:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+30:29216:x1830881261239808:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3272us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.681911:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11283 00000100:00100000:0.0:1746065128.687531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.687693:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261239936 00000100:00100000:2.0:1746065128.687701:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261239936 00002000:00100000:2.0:1746065128.687745:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1318911) req@ffff88012f542680 x1830881261239936/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.687754:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f542680 with x1830881261239936 ext(1048576->1318911) 00010000:00010000:2.0:1746065128.687763:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 47 pid: 8427 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.688004:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 47 pid: 8427 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065128.688012:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f542680 00000100:00100000:2.0:1746065128.688039:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1572 00000100:00100000:2.0:1746065128.688050:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1960:x1830881261239936:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065128.692179:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1960:x1830881261239936:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4125us (4650us total) trans 17179872936 rc 0/0 00000100:00100000:2.0:1746065128.692189:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1572 00002000:00100000:2.0:1746065128.692199:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1318911) req@ffff88012f542680 x1830881261239936/t17179872936(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.692207:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f542680 with x1830881261239936 ext(1048576->1318911) 00010000:00010000:2.0:1746065128.692215:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 49 pid: 8427 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746065128.692229:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 49 pid: 8427 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746065128.692236:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f542680 00000100:00100000:0.0:1746065128.699693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.701710:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261240064 00000100:00100000:3.0:1746065128.701720:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261240064 00010000:00010000:3.0:1746065128.701751:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 49 pid: 8427 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746065128.701774:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5629 00000100:00100000:3.0:1746065128.701780:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1958:x1830881261240064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.701790:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.701807:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 49 pid: 8427 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.701855:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 49 pid: 8427 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.701873:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2c0a00/0x14b4f8542d4f45ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbd9 expref: 49 pid: 8427 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746065128.701894:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.701896:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.701901:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.701909:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.701934:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.701943:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259810432:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065128.702005:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.705449:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259810432:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065128.705468:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.705503:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1958:x1830881261240064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3720us (5816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.705512:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5629 00000100:00100000:0.0:1746065128.711578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.711696:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261240320 00000100:00100000:2.0:1746065128.711705:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261240320 00002000:00100000:2.0:1746065128.711750:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012f541f80 x1830881261240320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.711760:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f541f80 with x1830881261240320 ext(1048576->2097151) 00002000:00010000:2.0:1746065128.711765:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f541f80 00000100:00100000:2.0:1746065128.711791:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5195 00000100:00100000:2.0:1746065128.711800:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881261240320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065128.731192:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881261240320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19387us (19619us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065128.731202:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5195 00002000:00100000:3.0:1746065128.731212:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012f541f80 x1830881261240320/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/440 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.731221:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f541f80 with x1830881261240320 ext(1048576->2097151) 00002000:00010000:3.0:1746065128.731226:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f541f80 00000100:00100000:0.0:1746065128.750333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.750518:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261240448 00000100:00100000:3.0:1746065128.750525:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261240448 00000100:00100000:3.0:1746065128.750568:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11284 00000100:00100000:3.0:1746065128.750575:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+24:29222:x1830881261240448:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065128.750590:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.750606:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc42 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.750628:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 32 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.750636:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc0a expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.750642:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 25 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.750647:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.750649:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.750652:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [1429504->2097151] (req 1429504->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.750674:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 25 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.751027:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 25 pid: 8427 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.751041:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259810560:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.753651:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc0a expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.754039:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc0a expref: 7 pid: 8427 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065128.754052:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259810688:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.754711:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 32 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.754720:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 32 pid: 8427 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.754728:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259810816:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.754761:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.754779:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259810560:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065128.757527:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.759006:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261240576 00000100:00100000:3.0:1746065128.759014:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261240576 00010000:00010000:3.0:1746065128.759045:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 26 pid: 8427 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.759070:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5630 00000100:00100000:3.0:1746065128.759078:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+26:1960:x1830881261240576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.759089:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.759108:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 26 pid: 8427 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065128.759119:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 26 pid: 8427 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065128.759139:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0df600/0x14b4f8542d4f45fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe7 expref: 26 pid: 8427 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.759228:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259810688:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065128.759563:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.759578:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261240704 00000100:00100000:0.0:1746065128.759582:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261240704 00010000:00010000:0.0:1746065128.759597:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc0a expref: 8 pid: 8427 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065128.759629:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5631 00000100:00100000:0.0:1746065128.759635:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f542300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261240704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.759642:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.759651:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc0a expref: 8 pid: 8427 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065128.759659:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc0a expref: 8 pid: 8427 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065128.759671:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133085800/0x14b4f8542d4f464e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc0a expref: 8 pid: 8427 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065128.759687:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065128.759719:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f542300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261240704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.759724:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5631 00010000:00010000:3.0:1746065128.761256:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.761304:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+25:1960:x1830881261240576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2224us (3780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.761312:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5630 00000100:00100000:3.0:1746065128.763923:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259810816:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.763952:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1429504->2097151] (req 1429504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 24 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.763964:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003c00, rc 0) 00000100:00100000:3.0:1746065128.763997:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:75065d94-a855-40b7-bd64-6d6f17292955+24:29222:x1830881261240448:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 13423us (13671us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.764004:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11284 00000100:00100000:0.0:1746065128.765208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.765235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.765307:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241088 00000100:00100000:3.0:1746065128.765313:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241088 00010000:00010000:3.0:1746065128.765337:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 33 pid: 8427 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.765360:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5632 00000100:00100000:3.0:1746065128.765366:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261241088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.765376:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.765393:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 33 pid: 8427 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065128.765403:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 33 pid: 8427 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065128.765427:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0df000/0x14b4f8542d4f45f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbe0 expref: 33 pid: 8427 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065128.765439:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.765440:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.765445:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.765452:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.765478:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.765493:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259810944:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065128.765547:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.765561:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261240960 00000100:00100000:3.0:1746065128.765563:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261240960 00000100:00100000:3.0:1746065128.765586:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9151 00000100:00100000:3.0:1746065128.765591:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29227:x1830881261240960:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065128.765607:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.765618:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f46a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc49 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.765699:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765709:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765719:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765729:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765735:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765739:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765852:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765859:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765865:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065128.765871:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065128.765934:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765939:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765943:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765948:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6003800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.765950:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765956:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765963:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065128.765965:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.765969:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765972:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f46a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765983:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765987:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765991:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.765994:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6003400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.765996:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.766000:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.766004:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e864600) 00010000:00010000:3.0:1746065128.766006:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.766008:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.766012:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003400/0x14b4f8542d4f46b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065128.766038:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6003200/0x14b4f8542d4f46a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc49 expref: 258 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.766047:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc49 expref: 257 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.766052:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.766055:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065128.766056:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002800, rc 0) 00000100:00100000:3.0:1746065128.766077:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:29227:x1830881261240960:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 486us (873us total) trans 8589943230 rc 0/0 00000100:00100000:3.0:1746065128.766082:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9151 00000100:00100000:0.0:1746065128.768124:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.768710:0:14642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241216 00000100:00100000:3.0:1746065128.768717:0:14642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241216 00000100:00100000:3.0:1746065128.768758:0:14642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 175 00000100:00100000:3.0:1746065128.768765:0:14642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edf50a1e-6d84-485b-9392-04c729e87e94+15:1960:x1830881261241216:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1746065128.769883:0:14642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edf50a1e-6d84-485b-9392-04c729e87e94+15:1960:x1830881261241216:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 1113us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.769892:0:14642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 175 00000100:00100000:2.0:1746065128.770622:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.770840:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241472 00000100:00100000:0.0:1746065128.770846:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241472 00002000:00100000:0.0:1746065128.770875:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1429504->1433599) req@ffff88009f46dc00 x1830881261241472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.770883:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46dc00 with x1830881261241472 ext(1429504->1433599) 00002000:00010000:0.0:1746065128.770887:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46dc00 00000100:00100000:0.0:1746065128.770904:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5196 00000100:00100000:0.0:1746065128.770909:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261241472:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065128.771036:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+24:1961:x1830881261241472:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 125us (414us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065128.771041:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5196 00002000:00100000:0.0:1746065128.771046:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x379:0x0] (1429504->1433599) req@ffff88009f46dc00 x1830881261241472/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.771053:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46dc00 with x1830881261241472 ext(1429504->1433599) 00002000:00010000:0.0:1746065128.771055:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46dc00 00000100:00100000:3.0:1746065128.771183:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259810944:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065128.771197:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.771221:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881261241088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5854us (5984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.771229:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5632 00000100:00100000:0.0:1746065128.777993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.778069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.778440:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241600 00000100:00100000:3.0:1746065128.778448:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241600 00000100:00100000:3.0:1746065128.778491:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241728 00000100:00100000:3.0:1746065128.778493:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241728 00000100:00100000:1.0:1746065128.778523:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11285 00000100:00100000:1.0:1746065128.778530:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:29227:x1830881261241600:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065128.778544:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065128.778557:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc50 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.778580:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba90 expref: 49 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.778587:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb77 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.778593:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac1 expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.778598:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.778599:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.778602:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [622592->847871] (req 622592->847871) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 49 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.778622:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11286 00000100:00100000:0.0:1746065128.778628:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+24:29222:x1830881261241728:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065128.778635:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065128.778645:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc57 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.778657:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 25 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.778664:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc2d expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.778668:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.778670:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.778672:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->1101823] (req 1048576->1101823) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.778991:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc2d expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.779003:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc2d expref: 31 pid: 8851 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065128.779015:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259811072:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.779232:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac1 expref: 29 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.779240:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac1 expref: 29 pid: 21235 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746065128.779247:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259811200:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.780452:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 25 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.780463:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 25 pid: 8427 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.780476:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259811328:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.780516:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e300 going to sleep for 11 seconds 00010000:00010000:1.0:1746065128.781466:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb77 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.781478:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb77 expref: 6 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746065128.781487:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259811456:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.781533:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba90 expref: 49 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.781539:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba90 expref: 49 pid: 4545 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.781546:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259811584:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065128.781561:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.784028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.784151:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259811200:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065128.784160:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259811456:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065128.784167:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259811584:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.784194:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [622592->847871] (req 622592->847871) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 49 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.784244:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241856 00000100:00100000:2.0:1746065128.784249:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241856 00010000:00010000:2.0:1746065128.784271:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc2d expref: 32 pid: 8851 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065128.784304:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5633 00000100:00100000:2.0:1746065128.784313:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881261241856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.784324:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.784342:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc2d expref: 32 pid: 8851 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065128.784354:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc2d expref: 32 pid: 8851 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065128.784374:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065128.784388:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003600/0x14b4f8542d4f4678 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc2d expref: 32 pid: 8851 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065128.784398:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f540e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259811072:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.784407:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881259811328:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.784427:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->1101823] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.784436:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0040e00, rc 0) 00010000:00010000:1.0:1746065128.784440:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe49400, rc 0) 00000100:00100000:2.0:1746065128.784982:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881261241856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 670us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.784988:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5633 00000100:00100000:1.0:1746065128.785057:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:29227:x1830881261241600:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6526us (7068us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.785063:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11285 00000100:00100000:3.0:1746065128.785183:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:75065d94-a855-40b7-bd64-6d6f17292955+25:29222:x1830881261241728:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6554us (7111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.785188:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11286 00000100:00100000:0.0:1746065128.785215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.785262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.785312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.785328:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261242240 00000100:00100000:0.0:1746065128.785331:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261242240 00010000:00010000:0.0:1746065128.785343:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba90 expref: 49 pid: 4545 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065128.785357:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241984 00000100:00100000:0.0:1746065128.785359:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241984 00010000:00010000:0.0:1746065128.785366:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb77 expref: 7 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065128.785376:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261242112 00000100:00100000:0.0:1746065128.785377:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261242112 00010000:00010000:0.0:1746065128.785384:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 25 pid: 8427 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065128.785394:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5634 00000100:00100000:0.0:1746065128.785400:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1960:x1830881261242240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.785406:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.785420:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba90 expref: 49 pid: 4545 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.785428:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba90 expref: 49 pid: 4545 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.785442:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0df400/0x14b4f8542d4f43bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ba90 expref: 49 pid: 4545 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.785455:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065128.785470:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1960:x1830881261242240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.785475:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5634 00000100:00100000:0.0:1746065128.785490:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5635 00000100:00100000:0.0:1746065128.785494:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261241984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.785500:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.785506:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb77 expref: 7 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065128.785513:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb77 expref: 7 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065128.785524:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6003000/0x14b4f8542d4f453d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb77 expref: 7 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065128.785536:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065128.785549:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261241984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.785554:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5635 00000100:00100000:0.0:1746065128.785564:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5636 00000100:00100000:0.0:1746065128.785568:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1958:x1830881261242112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.785573:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.785581:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 25 pid: 8427 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.785587:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 25 pid: 8427 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.785772:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f231a00/0x14b4f8542d4f4601 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbee expref: 25 pid: 8427 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.785783:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.785785:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.785946:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.785953:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.785963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.785995:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261242368 00000100:00100000:1.0:1746065128.785998:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261242368 00010000:00010000:1.0:1746065128.786015:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac1 expref: 30 pid: 21235 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746065128.786030:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5637 00000100:00100000:1.0:1746065128.786035:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881261242368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.786040:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.786048:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac1 expref: 30 pid: 21235 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065128.786055:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac1 expref: 30 pid: 21235 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065128.786065:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f76bc00/0x14b4f8542d4f4441 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bac1 expref: 30 pid: 21235 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065128.786085:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.786087:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.786091:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 47 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.786097:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 47 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.786113:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 47 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.786123:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259811712:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065128.786168:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72d80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065128.786428:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.786437:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259811840:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065128.786457:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.789661:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881259811840:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065128.789678:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.789720:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881261242112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4149us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.789729:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5636 00000100:00100000:1.0:1746065128.789847:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259811712:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065128.789857:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.789874:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261242368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3839us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.789879:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5637 00000100:00100000:0.0:1746065128.790201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.790226:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.790450:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261242624 00000100:00100000:2.0:1746065128.790455:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261242624 00002000:00100000:2.0:1746065128.790484:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37d:0x0] (622592->626687) req@ffff880094a10380 x1830881261242624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.790493:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10380 with x1830881261242624 ext(622592->626687) 00002000:00010000:2.0:1746065128.790496:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10380 00000100:00100000:2.0:1746065128.790519:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261242880 00000100:00100000:2.0:1746065128.790521:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261242880 00002000:00100000:2.0:1746065128.790532:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1097728->1101823) req@ffff880094a10000 x1830881261242880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.790539:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10000 with x1830881261242880 ext(1097728->1101823) 00002000:00010000:2.0:1746065128.790542:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a10000 00000100:00100000:2.0:1746065128.790563:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5197 00000100:00100000:2.0:1746065128.790569:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1961:x1830881261242624:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065128.790687:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1961:x1830881261242624:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 118us (486us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065128.790692:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5197 00002000:00100000:2.0:1746065128.790697:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x37d:0x0] (622592->626687) req@ffff880094a10380 x1830881261242624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.790703:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10380 with x1830881261242624 ext(622592->626687) 00002000:00010000:2.0:1746065128.790706:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10380 00000100:00100000:2.0:1746065128.790715:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5198 00000100:00100000:2.0:1746065128.790720:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881261242880:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065128.790783:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:75065d94-a855-40b7-bd64-6d6f17292955+24:1959:x1830881261242880:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 63us (555us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065128.790788:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5198 00002000:00100000:2.0:1746065128.790792:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x37a:0x0] (1097728->1101823) req@ffff880094a10000 x1830881261242880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.790798:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10000 with x1830881261242880 ext(1097728->1101823) 00002000:00010000:2.0:1746065128.790801:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a10000 00000100:00100000:0.0:1746065128.793114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.793198:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261243136 00000100:00100000:2.0:1746065128.793205:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261243136 00000100:00100000:2.0:1746065128.793343:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3764 00000100:00100000:2.0:1746065128.793351:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+16:29222:x1830881261243136:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065128.793794:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:29222:x1830881261243136:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 442us (683us total) trans 8589943231 rc 0/0 00000100:00100000:2.0:1746065128.793801:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3764 00000100:00100000:0.0:1746065128.795555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.795616:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261243392 00000100:00100000:2.0:1746065128.795624:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261243392 00002000:00100000:2.0:1746065128.795655:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (843776->847871) req@ffff880094a11880 x1830881261243392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.795664:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11880 with x1830881261243392 ext(843776->847871) 00002000:00010000:2.0:1746065128.795669:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11880 00000100:00100000:1.0:1746065128.796057:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5199 00000100:00100000:1.0:1746065128.796065:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1961:x1830881261243392:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065128.796206:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1961:x1830881261243392:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 142us (655us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065128.796212:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5199 00002000:00100000:1.0:1746065128.796221:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (843776->847871) req@ffff880094a11880 x1830881261243392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/4536 e 0 to 0 dl 1746065139 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065128.796228:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11880 with x1830881261243392 ext(843776->847871) 00002000:00010000:1.0:1746065128.796232:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11880 00000100:00100000:0.0:1746065128.800293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.800423:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261243648 00000100:00100000:2.0:1746065128.800430:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261243648 00000100:00100000:2.0:1746065128.800785:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3765 00000100:00100000:2.0:1746065128.800793:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:29227:x1830881261243648:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065128.800966:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:29227:x1830881261243648:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 174us (689us total) trans 8589943232 rc 0/0 00000100:00100000:2.0:1746065128.800972:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3765 00000100:00100000:0.0:1746065128.817421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.817535:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261243776 00000100:00100000:3.0:1746065128.817542:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261243776 00000100:00100000:3.0:1746065128.817583:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9152 00000100:00100000:3.0:1746065128.817589:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29233:x1830881261243776:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065128.817607:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.817621:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094614200/0x14b4f8542d4f46d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc5e expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.817664:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817677:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817685:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817696:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817701:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817705:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817783:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817789:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817794:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065128.817837:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065128.817841:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065128.817851:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817858:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817863:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817870:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817875:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817879:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094614a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.817882:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817886:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817893:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065128.817896:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.817898:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.817902:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f46da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.818504:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.818510:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.818514:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.818517:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094615e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.818519:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.818526:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.818532:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f700) 00010000:00010000:3.0:1746065128.818534:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065128.818535:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.818540:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094615e00/0x14b4f8542d4f46e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.818562:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614200/0x14b4f8542d4f46d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc5e expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.818572:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc5e expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.818577:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.818578:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065128.818580:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094615200, rc 0) 00000100:00100000:3.0:1746065128.818892:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:29233:x1830881261243776:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1301us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.818898:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9152 00000100:00100000:0.0:1746065128.822078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.822108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.822128:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.822156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.822169:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261243904 00000100:00100000:2.0:1746065128.822177:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261243904 00000100:00100000:1.0:1746065128.822226:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261244032 00000100:00100000:1.0:1746065128.822230:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261244032 00000100:00100000:1.0:1746065128.822246:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261244160 00000100:00100000:1.0:1746065128.822248:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261244160 00000100:00100000:1.0:1746065128.822258:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261244288 00000100:00100000:1.0:1746065128.822259:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261244288 00000100:00100000:1.0:1746065128.822277:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11287 00000100:00100000:1.0:1746065128.822297:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013071bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261243904:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065128.822312:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065128.822316:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11288 00000100:00100000:3.0:1746065128.822324:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261244032:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065128.822324:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f46ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc65 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.822332:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.822340:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094615600/0x14b4f8542d4f46f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc6c expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.822366:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259811968:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065128.822370:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259812096:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065128.822414:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11289 00000100:00100000:3.0:1746065128.822416:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.822420:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261244160:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065128.822427:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065128.822429:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11290 00000100:00100000:3.0:1746065128.822434:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261244288:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065128.822434:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f46fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc73 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.822439:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.822445:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc7a expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.822453:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065128.822454:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259812224:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065128.822455:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.822460:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc7a expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.822471:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc7a expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.822478:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094615e00, rc 0) 00000100:00100000:1.0:1746065128.822488:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.822540:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.822673:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261244288:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 236us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.822679:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11290 00000100:00100000:2.0:1746065128.824304:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259812224:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065128.824327:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f46fd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc73 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.824341:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f2e00/0x14b4f8542d4f46fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc73 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065128.824406:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881259812096:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065128.824421:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094615600/0x14b4f8542d4f46f6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc6c expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.824433:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094615600/0x14b4f8542d4f46f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc6c expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065128.824445:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094615600, rc 0) 00002000:00010000:1.0:1746065128.824483:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime: 1746065128 -> 1746065129 00002000:00010000:1.0:1746065128.824486:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime: 1746065128 -> 1746065129 00002000:00010000:1.0:1746065128.824488:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime: 1746065128 -> 1746065129 00000100:00100000:1.0:1746065128.824498:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259811968:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065128.824511:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f46ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc65 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.824519:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f46ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc65 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.824529:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003200, rc 0) 00010000:00010000:2.0:1746065128.824577:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4f2e00, rc 0) 00000100:00100000:3.0:1746065128.824641:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261244032:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2317us (2530us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065128.824641:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013071bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261243904:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2344us (2569us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065128.824647:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11287 00000100:00100000:3.0:1746065128.824650:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11288 00000100:00100000:2.0:1746065128.824669:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261244160:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2249us (2540us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065128.824673:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11289 00000100:00100000:0.0:1746065128.827017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.827161:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261244544 00000100:00100000:3.0:1746065128.827168:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261244544 00000100:00100000:3.0:1746065128.827200:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9153 00000100:00100000:3.0:1746065128.827206:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:29233:x1830881261244544:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065128.827221:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.827234:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094614200/0x14b4f8542d4f470b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc81 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.827313:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.827327:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc49 expref: 257 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.827333:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc5e expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.827339:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.827367:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc5e expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.827378:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc5e expref: 12 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.827388:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259812352:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.827470:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc49 expref: 257 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.827478:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc49 expref: 257 pid: 14643 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.827485:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259812480:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.827501:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.829220:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259812352:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.829234:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259812480:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.829251:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065128.829409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.829804:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.830370:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261244800 00000100:00100000:1.0:1746065128.830376:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261244800 00010000:00010000:1.0:1746065128.830404:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc49 expref: 258 pid: 14643 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.830434:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261244672 00000100:00100000:1.0:1746065128.830436:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261244672 00010000:00010000:1.0:1746065128.830445:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc5e expref: 13 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.830459:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5638 00000100:00100000:1.0:1746065128.830465:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1961:x1830881261244800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.830474:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.830479:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc49 expref: 258 pid: 14643 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.830487:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc49 expref: 258 pid: 14643 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.830504:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002800/0x14b4f8542d4f46b7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc49 expref: 258 pid: 14643 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.830517:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065128.830521:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065128.830527:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065128.830533:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.830561:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1961:x1830881261244800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.830566:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5638 00000100:00100000:1.0:1746065128.830578:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5639 00000100:00100000:1.0:1746065128.830583:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1959:x1830881261244672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.830588:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.830592:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc5e expref: 13 pid: 14645 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.830600:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc5e expref: 13 pid: 14645 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.830609:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094615200/0x14b4f8542d4f46e8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc5e expref: 13 pid: 14645 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.830617:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065128.830620:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065128.830626:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065128.830632:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065128.830644:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.830656:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1959:x1830881261244672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.830661:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5639 00010000:00010000:3.0:1746065128.830755:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.830762:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065128.830777:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065128.831022:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614200/0x14b4f8542d4f470b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc81 expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.831034:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc81 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.831040:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.831042:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065128.831044:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094614a00, rc 0) 00000100:00100000:3.0:1746065128.831226:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29233:x1830881261244544:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 4018us (4214us total) trans 8589943233 rc 0/0 00000100:00100000:3.0:1746065128.831232:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9153 00000100:00100000:0.0:1746065128.835236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.835564:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245056 00000100:00100000:3.0:1746065128.835622:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245056 00000100:00100000:3.0:1746065128.835778:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9154 00000100:00100000:3.0:1746065128.835907:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29233:x1830881261245056:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065128.835951:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065128.836001:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.836004:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065128.836075:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094614a00/0x14b4f8542d4f4712 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc81 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.836093:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.836097:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065128.836108:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f4720 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc88 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.836185:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f4727 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.836201:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f4727 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.836208:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f4727 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065128.836220:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065128.836321:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133084c00/0x14b4f8542d4f4720 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc88 expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.836334:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f4727 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc88 expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.836340:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.836343:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065128.836347:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085800, rc 0) 00000100:00100000:3.0:1746065128.836387:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:29233:x1830881261245056:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 600us (1156us total) trans 8589943234 rc 0/0 00000100:00100000:3.0:1746065128.836393:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9154 00000100:00100000:0.0:1746065128.838270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.838387:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245184 00000100:00100000:3.0:1746065128.838393:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245184 00000100:00100000:3.0:1746065128.838419:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9155 00000100:00100000:3.0:1746065128.838425:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:29233:x1830881261245184:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065128.838439:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.838451:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f4735 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc8f expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.838487:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f4735 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc8f expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.838497:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f4735 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc8f expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.838510:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.838513:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065128.838515:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133085000, rc 0) 00000100:00100000:3.0:1746065128.839947:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:29233:x1830881261245184:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1515us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.839955:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9155 00000100:00100000:0.0:1746065128.843650:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.843681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.843799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.844151:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245440 00000100:00100000:2.0:1746065128.844159:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245440 00000100:00100000:2.0:1746065128.844191:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245696 00000100:00100000:2.0:1746065128.844193:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245696 00000100:00100000:2.0:1746065128.844208:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245952 00000100:00100000:2.0:1746065128.844210:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245952 00000100:00100000:2.0:1746065128.844224:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11291 00000100:00100000:2.0:1746065128.844230:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261245440:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065128.844263:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.844278:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.844294:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.844296:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.844298:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.844327:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.844338:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 23 pid: 21998 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.844351:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259812608:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.844405:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.844435:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11292 00000100:00100000:2.0:1746065128.844441:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261245696:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065128.844460:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.844469:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.844475:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc7a expref: 7 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065128.844480:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.844481:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.844483:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.844497:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc7a expref: 7 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065128.844831:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11293 00000100:00100000:0.0:1746065128.844838:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261245952:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065128.844854:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.844867:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.844873:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb9a expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.844879:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.844884:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.844885:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065128.844887:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.844899:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.844905:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 23 pid: 8428 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065128.844912:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259812864:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065128.844938:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb9a expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065128.844945:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb9a expref: 8 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065128.844957:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259812992:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065128.844978:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.844989:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 30 pid: 8428 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065128.844996:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259813120:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065128.845012:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065128.845100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065128.846350:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc7a expref: 7 pid: 4544 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065128.846480:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259812736:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.846530:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.846538:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 28 pid: 21998 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.846546:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259813248:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.846562:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065128.847388:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245312 00000100:00100000:3.0:1746065128.847394:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245312 00000100:00100000:3.0:1746065128.847424:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11294 00000100:00100000:3.0:1746065128.847429:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261245312:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065128.847450:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.847462:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 47 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.847701:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065128.847704:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065128.847707:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.847726:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 47 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.847738:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 47 pid: 8851 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.847746:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259813376:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.847910:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.848511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.848525:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245568 00000100:00100000:2.0:1746065128.848528:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245568 00000100:00100000:2.0:1746065128.848547:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11295 00000100:00100000:2.0:1746065128.848552:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261245568:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:0.0:1746065128.848555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065128.848570:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.848580:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.848585:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.848587:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065128.848589:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.848612:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259812608:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065128.848624:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.848765:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.848774:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 23 pid: 4544 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.848783:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259813504:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.848807:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065128.848835:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245824 00000100:00100000:1.0:1746065128.848839:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245824 00000100:00100000:1.0:1746065128.848855:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11296 00000100:00100000:1.0:1746065128.848860:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261245824:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065128.848876:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.849385:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 47 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.849392:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb93 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.849398:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.849403:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.849404:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.849406:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.849422:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.849558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.849582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065128.849654:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 28 pid: 4544 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.849669:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259813632:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.849713:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb93 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065128.849720:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb93 expref: 9 pid: 9716 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746065128.849727:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259813760:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.849729:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259812864:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.849735:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259812992:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.849742:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259813120:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.849749:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 47 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.849755:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 47 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.849756:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.849762:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259813888:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.849772:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259812736:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065128.849775:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.849778:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259813248:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.849786:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.849786:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246080 00000100:00100000:1.0:1746065128.849789:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246080 00002000:00100000:1.0:1746065128.849807:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1429504->2097151) req@ffff880093ba3100 x1830881261246080/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065128.849834:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3100 with x1830881261246080 ext(1429504->2097151) 00010000:00010000:1.0:1746065128.849840:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 24 pid: 21998 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.849853:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 24 pid: 21998 timeout: 828 lvb_type: 0 00002000:00010000:1.0:1746065128.849859:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ba3100 00000100:00100000:1.0:1746065128.849870:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1573 00000100:00100000:1.0:1746065128.849876:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+24:1958:x1830881261246080:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065128.850048:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246208 00000100:00100000:3.0:1746065128.850052:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246208 00010000:00010000:3.0:1746065128.850066:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb9a expref: 10 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065128.850084:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5640 00000100:00100000:3.0:1746065128.850088:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261246208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065128.850096:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.850109:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb9a expref: 10 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065128.850116:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb9a expref: 10 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065128.850129:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f4560 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb9a expref: 10 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065128.850141:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.850459:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261246208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 369us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.850469:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5640 00000100:00100000:2.0:1746065128.851079:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259813504:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.851090:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.851299:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259813376:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.851310:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.865120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.865302:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246464 00000100:00100000:2.0:1746065128.865310:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246464 00002000:00100000:2.0:1746065128.865349:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (622592->847871) req@ffff880093ba0700 x1830881261246464/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.865359:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0700 with x1830881261246464 ext(622592->847871) 00010000:00010000:2.0:1746065128.865367:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 48 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.865379:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 48 pid: 8851 timeout: 828 lvb_type: 0 00002000:00010000:2.0:1746065128.865385:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba0700 00000100:00100000:2.0:1746065128.865417:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1574 00000100:00100000:2.0:1746065128.865424:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1959:x1830881261246464:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065128.867219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.867856:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246592 00000100:00100000:3.0:1746065128.867863:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246592 00002000:00100000:3.0:1746065128.867896:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1101823) req@ffff880093ba0e00 x1830881261246592/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/0 e 0 to 0 dl 1746065139 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.867904:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0e00 with x1830881261246592 ext(1048576->1101823) 00010000:00010000:3.0:1746065128.867912:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 26 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065128.869740:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 26 pid: 4544 timeout: 828 lvb_type: 0 00002000:00010000:3.0:1746065128.869753:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ba0e00 00000100:00100000:3.0:1746065128.869794:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1575 00000100:00100000:3.0:1746065128.869804:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+26:1959:x1830881261246592:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065128.875335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.875362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.875400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.875412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.875419:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246336 00000100:00100000:3.0:1746065128.875427:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246336 00000100:00100000:0.0:1746065128.875429:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.875439:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065128.875455:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc7a expref: 10 pid: 4544 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746065128.875512:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246720 00000100:00100000:1.0:1746065128.875516:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246720 00010000:00010000:1.0:1746065128.875531:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 29 pid: 21998 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.875542:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246848 00000100:00100000:1.0:1746065128.875544:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246848 00010000:00010000:1.0:1746065128.875554:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 31 pid: 8428 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.875563:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246976 00000100:00100000:1.0:1746065128.875565:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246976 00010000:00010000:1.0:1746065128.875574:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 30 pid: 4544 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.875581:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261247104 00000100:00100000:1.0:1746065128.875583:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261247104 00010000:00010000:1.0:1746065128.875590:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 28 pid: 8428 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.875597:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261247232 00000100:00100000:1.0:1746065128.875599:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261247232 00010000:00010000:1.0:1746065128.875607:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb93 expref: 11 pid: 9716 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746065128.875615:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5641 00000100:00100000:1.0:1746065128.875620:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261246336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.875629:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.875646:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc7a expref: 11 pid: 4544 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065128.875655:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc7a expref: 11 pid: 4544 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065128.875672:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094615e00/0x14b4f8542d4f4704 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc7a expref: 11 pid: 4544 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065128.875689:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.875721:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261246336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 100us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.875727:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5641 00000100:00100000:1.0:1746065128.875739:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5642 00000100:00100000:1.0:1746065128.875744:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1961:x1830881261246720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.875749:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.875755:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 30 pid: 21998 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.875766:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 30 pid: 21998 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.875775:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6002200/0x14b4f8542d4f4694 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc3b expref: 30 pid: 21998 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.875782:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.875783:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.875787:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.875794:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.875810:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.875839:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+29:1961:x1830881261246720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.875844:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5642 00000100:00100000:1.0:1746065128.875853:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5643 00000100:00100000:1.0:1746065128.875858:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881261246848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.875864:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.875874:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 31 pid: 8428 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.875881:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 31 pid: 8428 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.875892:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350fc400/0x14b4f8542d4f44c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb4d expref: 31 pid: 8428 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.875901:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.875910:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881261246848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.875914:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5643 00000100:00100000:1.0:1746065128.875937:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5644 00000100:00100000:1.0:1746065128.875941:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881261246976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.875945:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.875952:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 28 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.875958:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 28 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.875966:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.875976:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881261246976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 35us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.875979:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5644 00000100:00100000:1.0:1746065128.875987:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5645 00000100:00100000:1.0:1746065128.875990:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261247104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.875994:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.875999:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 28 pid: 8428 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.876007:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 28 pid: 8428 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.876016:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f145c00/0x14b4f8542d4f44cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb54 expref: 28 pid: 8428 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.876023:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.876024:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065128.876026:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.876032:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.876044:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.876058:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1961:x1830881261247104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.876063:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5645 00000100:00100000:1.0:1746065128.876081:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5646 00000100:00100000:1.0:1746065128.876086:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261247232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.876091:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.876097:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb93 expref: 9 pid: 9716 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065128.876104:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb93 expref: 9 pid: 9716 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065128.876113:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.876125:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261247232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 39us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.876129:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5646 00010000:00010000:1.0:1746065128.877865:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.878195:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900fcc00/0x14b4f8542d4f44bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb46 expref: 27 pid: 4544 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.878210:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259813632:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065128.878232:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2c1e00/0x14b4f8542d4f4559 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb93 expref: 8 pid: 9716 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065128.878238:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259813760:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065128.878246:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259813888:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065128.878445:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.878470:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.878476:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.878482:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.878488:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0040200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065128.878491:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.878497:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.878514:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.878519:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f474a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.878571:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261245952:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 33732us (34770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.878579:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11293 00010000:00010000:3.0:1746065128.878644:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.878650:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.878665:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.878670:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.878676:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.878680:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d4f3600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065128.878682:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.878688:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.878697:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.878703:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4f3600/0x14b4f8542d4f4743 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.878739:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261245696:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 34299us (35057us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.878745:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11292 00010000:00010000:2.0:1746065128.878790:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065128.879757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.880645:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261247360 00000100:00100000:2.0:1746065128.880652:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261247360 00010000:00010000:2.0:1746065128.880679:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 50 pid: 4544 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.880703:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5647 00000100:00100000:2.0:1746065128.880710:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:1959:x1830881261247360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.880721:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.880735:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 50 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.880744:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 50 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.880761:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f231600/0x14b4f8542d4f44b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb3f expref: 50 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.880771:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.880774:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.880777:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.880784:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.880807:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.880846:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1959:x1830881261247360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 137us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.880852:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5647 00000100:00100000:0.0:1746065128.881300:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+27:1959:x1830881261246592:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 11497us (14084us total) trans 21474840152 rc 0/0 00000100:00100000:0.0:1746065128.881308:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1575 00002000:00100000:0.0:1746065128.881315:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1101823) req@ffff880093ba0e00 x1830881261246592/t21474840152(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065128.881323:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0e00 with x1830881261246592 ext(1048576->1101823) 00010000:00010000:0.0:1746065128.881330:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 27 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.881339:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 27 pid: 4544 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065128.881345:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ba0e00 00010000:00010000:1.0:1746065128.881870:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.881883:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.881900:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.881906:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.881912:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.881917:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6003800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065128.881920:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.881927:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.881938:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065128.881942:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6003800/0x14b4f8542d4f475f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065128.882657:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261245824:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 33793us (34099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.882666:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11296 00000100:00100000:2.0:1746065128.882914:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1959:x1830881261246464:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 17489us (17801us total) trans 17179872937 rc 0/0 00000100:00100000:2.0:1746065128.882921:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1574 00002000:00100000:2.0:1746065128.882927:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x37d:0x0] (622592->847871) req@ffff880093ba0700 x1830881261246464/t17179872937(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:44/0 lens 488/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065128.882934:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0700 with x1830881261246464 ext(622592->847871) 00010000:00010000:2.0:1746065128.882940:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 49 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.882948:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 49 pid: 8851 timeout: 828 lvb_type: 0 00002000:00010000:2.0:1746065128.882953:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba0700 00000100:00100000:3.0:1746065128.883020:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261246080:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 33143us (33462us total) trans 21474840153 rc 0/0 00000100:00100000:3.0:1746065128.883026:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1573 00002000:00100000:3.0:1746065128.883031:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1429504->2097151) req@ffff880093ba3100 x1830881261246080/t21474840153(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:44/0 lens 488/448 e 0 to 0 dl 1746065139 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065128.883037:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3100 with x1830881261246080 ext(1429504->2097151) 00010000:00010000:3.0:1746065128.883043:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 27 pid: 21998 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065128.883050:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 27 pid: 21998 timeout: 828 lvb_type: 0 00002000:00010000:3.0:1746065128.883055:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ba3100 00000100:00100000:0.0:1746065128.891704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.891731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065128.891766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.891788:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261247616 00000100:00100000:3.0:1746065128.891795:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261247616 00010000:00010000:3.0:1746065128.891846:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 49 pid: 8851 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.891872:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261247488 00000100:00100000:2.0:1746065128.891873:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261247744 00000100:00100000:3.0:1746065128.891875:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261247488 00000100:00100000:2.0:1746065128.891876:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261247744 00010000:00010000:3.0:1746065128.891886:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 28 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.891891:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 28 pid: 21998 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.891901:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5648 00000100:00100000:3.0:1746065128.891908:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+49:1959:x1830881261247616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065128.891916:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5649 00010000:00010000:3.0:1746065128.891918:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065128.891921:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881261247488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.891931:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.891937:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 49 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.891941:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 28 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065128.891946:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 49 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.891949:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 28 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065128.891963:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe49400/0x14b4f8542d4f46c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 622592->847871) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc50 expref: 49 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.891963:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040e00/0x14b4f8542d4f46cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc57 expref: 28 pid: 4544 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.891974:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.891975:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.891976:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065128.891977:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.891979:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.891980:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.891986:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.891986:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.892003:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065128.892003:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.892030:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:1959:x1830881261247488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 108us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.892035:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5649 00000100:00100000:2.0:1746065128.892046:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5650 00000100:00100000:2.0:1746065128.892050:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+26:1961:x1830881261247744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.892055:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.892061:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 26 pid: 21998 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.892072:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 26 pid: 21998 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.892080:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f469b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc42 expref: 26 pid: 21998 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.892086:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.892087:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065128.892089:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892095:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892104:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.892113:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+25:1961:x1830881261247744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 63us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.892117:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5650 00010000:00010000:2.0:1746065128.892130:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892136:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892149:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892159:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892165:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892170:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d4f3400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065128.892173:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892178:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892185:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892189:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3400/0x14b4f8542d4f4758 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.892214:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261245568:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 43663us (43705us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065128.892219:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11295 00010000:00010000:2.0:1746065128.892244:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892249:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892260:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892265:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892270:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892274:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880133084a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065128.892276:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892293:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892300:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.892305:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133084a00/0x14b4f8542d4f4751 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065128.892329:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881261245312:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 44900us (47230us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065128.892444:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.892450:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.892461:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.892465:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.892471:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.892476:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d4f3200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065128.892478:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.892483:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.892490:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065128.892495:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4f3200/0x14b4f8542d4f473c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065128.892525:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261245440:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 48296us (48882us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.892530:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11291 00000100:00100000:2.0:1746065128.892597:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11294 00000100:00100000:3.0:1746065128.893735:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+48:1959:x1830881261247616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1823us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.893742:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5648 00000100:00100000:0.0:1746065128.896519:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.896598:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248000 00000100:00100000:3.0:1746065128.896604:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248000 00000100:00100000:3.0:1746065128.897236:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9156 00000100:00100000:3.0:1746065128.897244:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:29233:x1830881261248000:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:3.0:1746065128.897295:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.897316:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085000/0x14b4f8542d4f4735 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc8f expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897330:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.897334:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065128.897356:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.897365:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 16 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897371:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 256 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897377:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 16 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897382:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbaf expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897386:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbb6 expref: 256 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897391:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.897412:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbb6 expref: 256 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897424:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbb6 expref: 256 pid: 24350 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.897434:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814016:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.897520:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbaf expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897527:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbaf expref: 16 pid: 14644 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.897533:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814144:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.897553:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 16 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897559:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 16 pid: 16767 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.897565:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814272:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.897580:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 256 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897586:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 256 pid: 14644 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.897592:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814400:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.897609:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 16 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.897614:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 16 pid: 14643 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065128.897620:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814528:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.897634:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065128.899659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.899743:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814016:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.899754:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814144:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.899760:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814272:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.899765:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814400:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065128.899774:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259814528:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065128.899795:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065128.899872:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248256 00000100:00100000:0.0:1746065128.899877:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248256 00010000:00010000:0.0:1746065128.899901:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbaf expref: 17 pid: 14644 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065128.899935:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5651 00000100:00100000:0.0:1746065128.899942:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261248256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065128.899952:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065128.899956:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbaf expref: 17 pid: 14644 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.899965:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbaf expref: 17 pid: 14644 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.900207:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f145400/0x14b4f8542d4f4598 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbaf expref: 17 pid: 14644 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065128.900218:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065128.900222:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065128.900229:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065128.900429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.900452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.900473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.900493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.900507:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248512 00000100:00100000:2.0:1746065128.900510:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248512 00010000:00010000:2.0:1746065128.900524:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 257 pid: 14644 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.900535:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248128 00000100:00100000:2.0:1746065128.900537:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248128 00010000:00010000:2.0:1746065128.900543:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbb6 expref: 258 pid: 24350 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.900550:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248384 00000100:00100000:2.0:1746065128.900551:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248384 00010000:00010000:2.0:1746065128.900557:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 17 pid: 16767 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.900564:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248640 00000100:00100000:2.0:1746065128.900565:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248640 00010000:00010000:2.0:1746065128.900572:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 18 pid: 14643 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.900581:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5652 00000100:00100000:2.0:1746065128.900585:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1960:x1830881261248512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.900592:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065128.900595:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 258 pid: 14644 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.900606:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 258 pid: 14644 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.900616:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcebc00/0x14b4f8542d4f4472 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf9 expref: 258 pid: 14644 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.900617:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5653 00010000:00010000:2.0:1746065128.900624:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.900626:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065128.900626:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1960:x1830881261248128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065128.900631:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065128.900633:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.900638:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbb6 expref: 257 pid: 24350 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.900646:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbb6 expref: 257 pid: 24350 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.900656:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1960:x1830881261248512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (226us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065128.900657:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f45bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bbb6 expref: 257 pid: 24350 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065128.900661:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5652 00000100:00100000:2.0:1746065128.900673:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5654 00010000:00010000:1.0:1746065128.900674:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00000100:00100000:2.0:1746065128.900677:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+18:1960:x1830881261248384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065128.900678:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065128.900683:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.900683:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065128.900686:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 18 pid: 16767 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.900692:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 18 pid: 16767 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065128.900700:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76aa00/0x14b4f8542d4f4479 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bb00 expref: 18 pid: 16767 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065128.900706:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1960:x1830881261248128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (253us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065128.900707:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.900710:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065128.900712:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5653 00010000:00010000:2.0:1746065128.900714:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.900724:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5655 00000100:00100000:2.0:1746065128.900726:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75065d94-a855-40b7-bd64-6d6f17292955+17:1960:x1830881261248384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.900729:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+17:1959:x1830881261248640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065128.900731:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5654 00010000:00010000:1.0:1746065128.900735:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065128.900739:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 16 pid: 14643 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.900747:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 16 pid: 14643 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.900756:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002400/0x14b4f8542d4f446b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5baf2 expref: 16 pid: 14643 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065128.900765:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065128.900768:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065128.900768:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75065d94-a855-40b7-bd64-6d6f17292955+15:1960:x1830881261248256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 826us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065128.900773:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5651 00010000:00010000:1.0:1746065128.900774:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065128.900779:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065128.900792:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065128.900807:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+14:1959:x1830881261248640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065128.900836:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5655 00010000:00010000:3.0:1746065128.901106:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.901114:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000040:00080000:3.0:1746065128.901655:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2630, 88 off221272 00000004:00080000:3.0:1746065128.901660:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728192844404ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.901694:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2559, 88 off214840 00000004:00080000:3.0:1746065128.901697:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728192881972ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.901741:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2560, 88 off214928 00000004:00080000:3.0:1746065128.901744:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728192928905ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.901758:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2631, 88 off221360 00000004:00080000:3.0:1746065128.901760:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728192945077ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.901766:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2632, 88 off221448 00000004:00080000:3.0:1746065128.901769:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728192953315ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.901775:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2561, 88 off215016 00000004:00080000:3.0:1746065128.901777:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728192961532ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.901787:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2562, 88 off215104 00000004:00080000:3.0:1746065128.901789:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728192974004ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.901797:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2563, 88 off215192 00000004:00080000:3.0:1746065128.901799:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728192983787ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.901807:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2633, 88 off221536 00000004:00080000:3.0:1746065128.901810:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728192994409ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.901832:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2564, 88 off215280 00000004:00080000:3.0:1746065128.901835:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728193019469ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.901847:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2634, 88 off221624 00000004:00080000:3.0:1746065128.901849:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728193034272ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.901855:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2565, 88 off215368 00000004:00080000:3.0:1746065128.901858:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728193042503ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065128.901867:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2635, 88 off221712 00000004:00080000:3.0:1746065128.901870:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728193054370ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.901875:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2636, 88 off221800 00000004:00080000:3.0:1746065128.901878:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728193062277ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.901887:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2637, 88 off221888 00000004:00080000:3.0:1746065128.901890:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728193074330ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.901895:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2638, 88 off221976 00000004:00080000:3.0:1746065128.901897:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728193081917ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065128.901904:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2566, 88 off215456 00000004:00080000:3.0:1746065128.901906:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728193090695ns, next at 666938887344ns, rc = 0 00000004:00010000:3.0:1746065128.953698:0:14645:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009009f800 reply state ffff88009bff2000 transno 8589943235 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:3.0:1746065128.953710:0:14645:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065128.953799:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:29233:x1830881261248000:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 56552us (57282us total) trans 8589943235 rc 0/0 00000100:00100000:3.0:1746065128.953806:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9156 00000001:00080000:2.0:1746065128.953869:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943228 is committed 00000001:00080000:2.0:1746065128.953876:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943221 is committed 00000001:00080000:2.0:1746065128.953881:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943232 is committed 00000001:00080000:2.0:1746065128.953885:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943231 is committed 00000001:00080000:2.0:1746065128.953890:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943220 is committed 00000001:00080000:2.0:1746065128.953905:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943235 is committed 00000004:00080000:2.0:1746065128.953908:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1858 committed 00000004:00080000:2.0:1746065128.953913:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1930 committed 00000004:00080000:2.0:1746065128.953918:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1929 committed 00000004:00080000:2.0:1746065128.953919:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1928 committed 00000004:00080000:2.0:1746065128.953921:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1927 committed 00000004:00080000:2.0:1746065128.953922:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1857 committed 00000004:00080000:2.0:1746065128.953923:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1926 committed 00000004:00080000:2.0:1746065128.953925:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1856 committed 00000004:00080000:2.0:1746065128.953926:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1925 committed 00000004:00080000:2.0:1746065128.953928:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1855 committed 00000004:00080000:2.0:1746065128.953929:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1854 committed 00000004:00080000:2.0:1746065128.953930:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1853 committed 00000004:00080000:2.0:1746065128.953931:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1924 committed 00000004:00080000:2.0:1746065128.953933:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1923 committed 00000004:00080000:2.0:1746065128.953934:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1852 committed 00000004:00080000:2.0:1746065128.953935:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1851 committed 00000004:00080000:2.0:1746065128.953937:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1922 committed 00000100:00100000:2.0:1746065128.954111:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259815040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.954149:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.954179:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259815552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.954192:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.954206:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065128.954210:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259814656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.954221:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.954229:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259815168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.954239:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.954256:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259815040 00000100:00100000:2.0:1746065128.954262:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259815040 00000100:00100000:2.0:1746065128.954299:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259815552 00000100:00100000:2.0:1746065128.954302:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259815552 00000100:00100000:2.0:1746065128.954310:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259814656 00000100:00100000:2.0:1746065128.954311:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259814656 00000100:00100000:2.0:1746065128.954319:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259815168 00000100:00100000:2.0:1746065128.954320:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259815168 00000100:00100000:2.0:1746065128.954329:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11297 00000100:00100000:2.0:1746065128.954334:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+71:3297:x1830881259815040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065128.954467:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065128.954469:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065128.954471:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065128.954473:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065128.954475:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065128.954494:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:3297:x1830881259815040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (344us total) trans 17179872938 rc 0/0 00000100:00100000:2.0:1746065128.954499:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11297 00000100:00100000:2.0:1746065128.954508:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11298 00000100:00100000:2.0:1746065128.954512:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+71:3297:x1830881259815552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.954574:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:3297:x1830881259815552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (380us total) trans 17179872939 rc 0/0 00000100:00100000:2.0:1746065128.954579:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11298 00000100:00100000:2.0:1746065128.954586:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11299 00000100:00100000:2.0:1746065128.954590:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+71:3297:x1830881259814656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.954658:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:3297:x1830881259814656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (435us total) trans 17179872940 rc 0/0 00000100:00100000:2.0:1746065128.954662:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11299 00000100:00100000:2.0:1746065128.954670:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11300 00000100:00100000:2.0:1746065128.954674:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+71:3297:x1830881259815168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065128.954719:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065128.954721:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065128.954723:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065128.954725:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065128.954726:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065128.954739:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:3297:x1830881259815168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (499us total) trans 17179872941 rc 0/0 00000100:00100000:2.0:1746065128.954743:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11300 00000004:00080000:2.0:1746065128.954772:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a0700/2, rc 0, transno 17179872940 00000100:00100000:2.0:1746065128.954779:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259814656:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065128.954785:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130446d80/2, rc 0, transno 17179872941 00000100:00100000:2.0:1746065128.954787:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259815168:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065128.954792:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130445880/2, rc 0, transno 17179872938 00000100:00100000:2.0:1746065128.954794:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259815040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065128.954801:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46b480/2, rc 0, transno 17179872939 00000100:00100000:2.0:1746065128.954803:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259815552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.954864:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065128.954868:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259815680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.954884:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.954900:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259815680 00000100:00100000:2.0:1746065128.954902:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259815680 00000100:00100000:2.0:1746065128.954913:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11301 00000100:00100000:2.0:1746065128.954916:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3297:x1830881259815680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065128.954987:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3297:x1830881259815680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (102us total) trans 17179872942 rc 0/0 00000100:00100000:2.0:1746065128.954992:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11301 00000100:00100000:1.0:1746065128.955775:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259814912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.955799:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.955831:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259815424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.955843:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.955854:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065128.955858:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801363a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259814784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.955868:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.955877:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259815296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.955886:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.955903:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259814912 00000100:00100000:1.0:1746065128.955905:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259814912 00000100:00100000:1.0:1746065128.955917:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259815424 00000100:00100000:1.0:1746065128.955919:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259815424 00000100:00100000:1.0:1746065128.955924:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259814784 00000100:00100000:1.0:1746065128.955925:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259814784 00000100:00100000:1.0:1746065128.955929:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259815296 00000100:00100000:1.0:1746065128.955931:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259815296 00000100:00100000:1.0:1746065128.955937:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11302 00000100:00100000:1.0:1746065128.955941:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259814912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.956035:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259814912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (234us total) trans 17179872943 rc 0/0 00000100:00100000:1.0:1746065128.956039:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11302 00000100:00100000:1.0:1746065128.956048:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11303 00000100:00100000:1.0:1746065128.956052:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259815424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.956116:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259815424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (272us total) trans 17179872944 rc 0/0 00000100:00100000:1.0:1746065128.956120:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11303 00000100:00100000:1.0:1746065128.956128:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11304 00000100:00100000:1.0:1746065128.956132:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259814784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065128.956191:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259814784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (321us total) trans 17179872945 rc 0/0 00000100:00100000:1.0:1746065128.956196:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11304 00000100:00100000:1.0:1746065128.956202:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11305 00000100:00100000:1.0:1746065128.956206:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259815296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065128.956253:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065128.956255:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.956257:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.956259:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.956261:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065128.956274:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259815296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (386us total) trans 17179872946 rc 0/0 00000100:00100000:1.0:1746065128.956290:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11305 00000004:00080000:1.0:1746065128.956318:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a0000/2, rc 0, transno 17179872945 00000100:00100000:1.0:1746065128.956321:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259814784:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065128.956327:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130447800/2, rc 0, transno 17179872946 00000100:00100000:1.0:1746065128.956329:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259815296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065128.956334:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801363a3b80/2, rc 0, transno 17179872943 00000100:00100000:1.0:1746065128.956336:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801363a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259814912:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065128.956343:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f469f80/2, rc 0, transno 17179872944 00000100:00100000:1.0:1746065128.956345:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259815424:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065128.958784:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06680/2, rc 0, transno 17179872942 00000100:00100000:2.0:1746065128.958792:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259815680:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065128.960043:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.960054:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.960060:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.960065:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f144600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065128.960069:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.960074:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.960086:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.960089:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065128.960092:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065128.960096:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144600/0x14b4f8542d4f4766 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00000100:00100000:3.0:1746065128.960229:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259815808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.960270:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.962698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065128.962800:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259815936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.962844:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.962865:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259816192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.962879:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.962967:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259815808 00000100:00100000:2.0:1746065128.962973:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259815808 00000100:00100000:2.0:1746065128.963002:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259815936 00000100:00100000:2.0:1746065128.963004:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259815936 00000100:00100000:2.0:1746065128.963013:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259816192 00000100:00100000:2.0:1746065128.963014:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259816192 00000100:00100000:2.0:1746065128.963026:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11306 00000100:00100000:2.0:1746065128.963032:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:3295:x1830881259815808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065128.963207:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3295:x1830881259815808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (2936us total) trans 21474840154 rc 0/0 00000100:00100000:2.0:1746065128.963213:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11306 00000100:00100000:2.0:1746065128.963227:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11307 00000100:00100000:2.0:1746065128.963231:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:3296:x1830881259815936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065128.963322:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3296:x1830881259815936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (478us total) trans 21474840155 rc 0/0 00000100:00100000:2.0:1746065128.963328:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11307 00000100:00100000:2.0:1746065128.963336:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11308 00000100:00100000:2.0:1746065128.963340:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:3298:x1830881259816192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065128.963407:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3298:x1830881259816192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (526us total) trans 21474840156 rc 0/0 00000100:00100000:2.0:1746065128.963411:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11308 00000100:00100000:2.0:1746065128.963432:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259816064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065128.963446:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065128.963457:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259816064 00000100:00100000:2.0:1746065128.963459:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259816064 00000100:00100000:2.0:1746065128.963470:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11309 00000100:00100000:2.0:1746065128.963473:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+64:3297:x1830881259816064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065128.963542:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+65:3297:x1830881259816064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (95us total) trans 21474840157 rc 0/0 00000100:00100000:2.0:1746065128.963547:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11309 00000004:00080000:3.0:1746065128.963850:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084380/2, rc 0, transno 21474840154 00000100:00100000:3.0:1746065128.963855:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259815808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.963860:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259816320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.963875:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065128.963901:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259816320 00000100:00100000:3.0:1746065128.963903:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259816320 00000100:00100000:3.0:1746065128.963915:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11310 00000100:00100000:3.0:1746065128.963919:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+65:3295:x1830881259816320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065128.963986:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:3.0:1746065128.963989:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065128.963991:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065128.963992:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065128.963994:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:3.0:1746065128.964011:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3295:x1830881259816320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (135us total) trans 21474840158 rc 0/0 00000100:00100000:3.0:1746065128.964015:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11310 00000100:00100000:3.0:1746065128.964079:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248768 00000100:00100000:3.0:1746065128.964082:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248768 00000100:00100000:3.0:1746065128.964100:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9157 00000100:00100000:3.0:1746065128.964103:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29233:x1830881261248768:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065128.964114:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065128.964126:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc96 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.964163:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc96 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.964174:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc96 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.964187:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.964190:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065128.964192:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f144a00, rc 0) 00000100:00100000:3.0:1746065128.964216:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29233:x1830881261248768:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 112us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.964221:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9157 00000004:00080000:3.0:1746065128.964296:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085180/2, rc 0, transno 21474840158 00000100:00100000:3.0:1746065128.964299:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259816320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065128.964397:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084e00/2, rc 0, transno 21474840155 00000100:00100000:1.0:1746065128.964400:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259815936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.964404:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259816448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.964419:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065128.964449:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085f80/2, rc 0, transno 21474840156 00000100:00100000:1.0:1746065128.964452:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259816192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.964456:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259816704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.964467:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065128.964481:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259816448 00000100:00100000:1.0:1746065128.964483:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259816448 00000100:00100000:1.0:1746065128.964494:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259816704 00000100:00100000:1.0:1746065128.964495:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259816704 00000100:00100000:1.0:1746065128.964502:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11311 00000100:00100000:1.0:1746065128.964505:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3296:x1830881259816448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065128.964565:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065128.964567:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.964569:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.964570:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065128.964572:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065128.964588:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3296:x1830881259816448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (168us total) trans 21474840159 rc 0/0 00000100:00100000:1.0:1746065128.964592:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11311 00000100:00100000:1.0:1746065128.964601:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11312 00000100:00100000:1.0:1746065128.964604:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3298:x1830881259816704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065128.964658:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3298:x1830881259816704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (189us total) trans 21474840160 rc 0/0 00000100:00100000:1.0:1746065128.964662:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11312 00000004:00080000:1.0:1746065128.964677:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0086680/2, rc 0, transno 21474840159 00000100:00100000:1.0:1746065128.964680:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259816448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065128.964692:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0086300/2, rc 0, transno 21474840160 00000100:00100000:1.0:1746065128.964694:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259816704:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065128.964880:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084a80/2, rc 0, transno 21474840157 00000100:00100000:3.0:1746065128.964884:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259816064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.964888:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259816576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065128.964905:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065128.964964:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259816576 00000100:00100000:0.0:1746065128.964967:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259816576 00000100:00100000:0.0:1746065128.964982:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11313 00000100:00100000:0.0:1746065128.964985:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3297:x1830881259816576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065128.965052:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065128.965054:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.965056:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.965058:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065128.965059:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065128.965081:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3297:x1830881259816576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (175us total) trans 21474840161 rc 0/0 00000100:00100000:0.0:1746065128.965085:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11313 00000004:00080000:3.0:1746065128.965135:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085500/2, rc 0, transno 21474840161 00000100:00100000:3.0:1746065128.965138:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259816576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065128.970644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.970799:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248896 00000100:00100000:3.0:1746065128.970806:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248896 00000100:00100000:3.0:1746065128.970873:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 631 00000100:00100000:3.0:1746065128.970881:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29233:x1830881261248896:12345-192.168.202.46@tcp:103:mirror_io.0 00010000:00010000:3.0:1746065128.970896:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065128.970915:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133085800/0x14b4f8542d4f4727 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc88 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065128.970936:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065128.970940:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065128.970971:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29233:x1830881261248896:12345-192.168.202.46@tcp:103:mirror_io.0 Request processed in 91us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065128.970976:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 631 00000100:00100000:0.0:1746065128.973881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.974512:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261249152 00000100:00100000:3.0:1746065128.974520:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261249152 00000100:00100000:3.0:1746065128.974568:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3766 00000100:00100000:3.0:1746065128.974575:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29233:x1830881261249152:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065128.975178:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29233:x1830881261249152:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 602us (1301us total) trans 8589943236 rc 0/0 00000100:00100000:3.0:1746065128.975185:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3766 00000100:00100000:0.0:1746065128.976945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065128.977005:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261249408 00000100:00100000:3.0:1746065128.977009:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261249408 00000100:00100000:3.0:1746065128.977267:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3767 00000100:00100000:3.0:1746065128.977272:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009badc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29233:x1830881261249408:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065128.977500:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009badc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29233:x1830881261249408:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 226us (557us total) trans 8589943237 rc 0/0 00000100:00100000:3.0:1746065128.977505:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3767 00000100:00100000:0.0:1746065128.997347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065128.997416:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261249664 00000100:00100000:2.0:1746065128.997423:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261249664 00000100:00100000:2.0:1746065128.997474:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9158 00000100:00100000:2.0:1746065128.997481:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+7:29240:x1830881261249664:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065128.997501:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065128.997517:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f230800/0x14b4f8542d4f4774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bc9d expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.997630:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997642:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997650:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997666:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997674:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997682:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997769:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231400/0x14b4f8542d4f4789 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997775:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231400/0x14b4f8542d4f4789 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997784:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231400/0x14b4f8542d4f4789 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065128.997791:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065128.997885:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997891:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997900:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997904:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f231e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065128.997907:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997911:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997919:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065128.997922:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065128.997925:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997928:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231e00/0x14b4f8542d4f477b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997945:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997949:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997953:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997956:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f231200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065128.997958:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997961:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997970:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205300) 00010000:00010000:2.0:1746065128.997972:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065128.997974:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.997977:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231200/0x14b4f8542d4f4782 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065128.998008:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f230800/0x14b4f8542d4f4774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc9d expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.998019:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231400/0x14b4f8542d4f4789 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc9d expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065128.998024:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065128.998025:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065128.998027:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f231400, rc 0) 00000100:00100000:2.0:1746065128.998076:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:29240:x1830881261249664:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 595us (736us total) trans 8589943238 rc 0/0 00000100:00100000:2.0:1746065128.998081:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9158 00000100:00100000:0.0:1746065129.003046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.003170:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261249920 00000100:00100000:3.0:1746065129.003179:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261249920 00000100:00100000:3.0:1746065129.003234:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9159 00000100:00100000:3.0:1746065129.003243:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:29242:x1830881261249920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.003267:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.003296:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4797 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bca4 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.003408:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003421:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003430:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003444:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003449:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003455:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003560:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003570:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003576:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065129.003585:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065129.003674:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003681:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003686:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003690:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f76a800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065129.003694:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003700:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003709:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:3.0:1746065129.003712:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065129.003716:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003720:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a800/0x14b4f8542d4f479e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003762:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003768:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003772:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003776:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f76ac00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065129.003778:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003783:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003790:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090d6f700) 00010000:00010000:3.0:1746065129.003792:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065129.003794:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003798:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ac00/0x14b4f8542d4f47a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.003870:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4797 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bca4 expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.003882:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bca4 expref: 249 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.003888:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065129.003890:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065129.003892:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76a400, rc 0) 00000100:00100000:3.0:1746065129.003941:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29242:x1830881261249920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 698us (903us total) trans 8589943239 rc 0/0 00000100:00100000:3.0:1746065129.003947:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9159 00000100:00080000:0.0:1746065129.004788:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065129.005015:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.005045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.005068:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.005092:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.005116:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.005151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.005304:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261250048 00000100:00100000:2.0:1746065129.005311:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261250048 00000100:00100000:2.0:1746065129.005347:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261250176 00000100:00100000:2.0:1746065129.005351:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261250176 00000100:00100000:2.0:1746065129.005368:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261250304 00000100:00100000:2.0:1746065129.005370:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261250304 00000100:00100000:2.0:1746065129.005388:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261250432 00000100:00100000:2.0:1746065129.005390:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261250432 00000100:00100000:2.0:1746065129.005686:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261250560 00000100:00100000:2.0:1746065129.005689:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261250560 00000100:00100000:0.0:1746065129.006471:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261250688 00000100:00100000:0.0:1746065129.006476:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261250688 00000100:00100000:0.0:1746065129.006503:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11314 00000100:00100000:0.0:1746065129.006511:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881261250048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.006527:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.006544:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcab expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065129.006565:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e9, atime: 0x6812d6e8, ctime: 0x6812d6e9, blocks: 0x7f1 00010000:00010000:0.0:1746065129.006582:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.006584:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.006592:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcab expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.006606:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcab expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.006615:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003200, rc 0) 00000100:00100000:0.0:1746065129.006663:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881261250048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 152us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.006669:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11314 00000100:00100000:0.0:1746065129.006686:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11315 00000100:00100000:0.0:1746065129.006692:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261250176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.006700:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.006710:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcb2 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065129.006724:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6e9, atime: 0x6812d6e9, ctime: 0x6812d6e9, blocks: 0x821 00010000:00010000:0.0:1746065129.006733:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.006735:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.006740:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb2 expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.006751:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb2 expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.006757:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003800, rc 0) 00000100:00100000:0.0:1746065129.006778:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881261250176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 86us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.006783:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11315 00000100:00100000:0.0:1746065129.006797:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11316 00000100:00100000:0.0:1746065129.006803:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261250304:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065129.006869:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11317 00000100:00100000:1.0:1746065129.006878:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881261250432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065129.006886:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065129.006896:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcc0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065129.006909:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6e9, atime: 0x6812d6e9, ctime: 0x6812d6e9, blocks: 0x821 00010000:00010000:1.0:1746065129.006920:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.006922:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.006927:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc0 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.006938:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc0 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.006945:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f455200, rc 0) 00000100:00100000:1.0:1746065129.006965:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881261250432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 89us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.006969:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11317 00000100:00100000:1.0:1746065129.006985:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11318 00000100:00100000:1.0:1746065129.006991:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+29:1958:x1830881261250560:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065129.006999:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065129.007006:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcc7 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065129.007016:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6e9, atime: 0x6812d6e8, ctime: 0x6812d6e9, blocks: 0x16a9 00010000:00010000:1.0:1746065129.007024:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.007025:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.007030:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc7 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.007039:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc7 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.007049:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f454a00, rc 0) 00000100:00100000:1.0:1746065129.007067:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881261250560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 77us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.007072:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11318 00000100:00100000:1.0:1746065129.007085:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11319 00000100:00100000:1.0:1746065129.007091:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+27:1958:x1830881261250688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065129.007098:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065129.007106:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcce expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065129.007117:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6e9, atime: 0x6812d6e7, ctime: 0x6812d6e9, blocks: 0x102b 00010000:00010000:1.0:1746065129.007125:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.007127:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.007131:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcce expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.007141:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcce expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.007148:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f455800, rc 0) 00000100:00100000:1.0:1746065129.007166:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881261250688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 75us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.007171:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11319 00000100:00080000:2.0:1746065129.007306:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746065129.007310:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746065129.007396:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.007406:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcb9 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065129.007421:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6e9, atime: 0x6812d6e9, ctime: 0x6812d6e9, blocks: 0x81d 00010000:00010000:0.0:1746065129.007430:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.007431:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.007437:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb9 expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.007446:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb9 expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.007453:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003e00, rc 0) 00000100:00100000:0.0:1746065129.007474:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881261250304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 670us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.007478:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11316 00000100:00100000:0.0:1746065129.010095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.010144:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.012413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.012627:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261250816 00000100:00100000:0.0:1746065129.012631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.012635:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261250816 00000100:00100000:0.0:1746065129.012668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.012673:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261251072 00000100:00100000:1.0:1746065129.012676:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261251072 00000100:00100000:1.0:1746065129.012689:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261251328 00000100:00100000:1.0:1746065129.012691:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261251328 00000100:00100000:1.0:1746065129.012698:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261250944 00000100:00100000:1.0:1746065129.012700:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261250944 00000100:00100000:0.0:1746065129.012703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.012727:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261251200 00000100:00100000:0.0:1746065129.012731:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261251200 00000100:00100000:3.0:1746065129.012739:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261251456 00000100:00100000:3.0:1746065129.012742:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261251456 00000100:00100000:0.0:1746065129.012751:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11320 00000100:00100000:0.0:1746065129.012758:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:1959:x1830881261250816:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065129.012764:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11321 00000100:00100000:3.0:1746065129.012769:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881261251072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.012773:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.012777:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.012788:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bce3 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.012788:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcd5 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.012806:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.012806:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.012807:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.012807:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.012826:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bce3 expref: 33 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.012833:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcd5 expref: 51 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.012840:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bce3 expref: 33 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.012846:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcd5 expref: 51 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.012849:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76a200, rc 0) 00010000:00010000:0.0:1746065129.012853:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002400, rc 0) 00000100:00100000:3.0:1746065129.012885:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261251072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 115us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.012886:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:1959:x1830881261250816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 128us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.012891:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11321 00000100:00100000:0.0:1746065129.012894:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11320 00000100:00100000:3.0:1746065129.012905:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11322 00000100:00100000:0.0:1746065129.012908:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11323 00000100:00100000:3.0:1746065129.012909:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:1959:x1830881261251328:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065129.012914:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881261250944:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.012915:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.012920:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcf1 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.012920:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.012927:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcdc expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.012929:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.012931:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.012934:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf1 expref: 51 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.012935:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.012937:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.012941:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcdc expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.012942:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf1 expref: 51 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.012950:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcdc expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.012952:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76ae00, rc 0) 00010000:00010000:0.0:1746065129.012959:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002e00, rc 0) 00000100:00100000:3.0:1746065129.012966:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:1959:x1830881261251328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 57us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.012971:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11322 00000100:00100000:0.0:1746065129.012975:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261250944:12345-192.168.202.46@tcp:101:cat.0 Request processed in 62us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.012980:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11324 00000100:00100000:0.0:1746065129.012983:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11323 00000100:00100000:3.0:1746065129.012984:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+50:1959:x1830881261251200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.012989:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.012995:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcea expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065129.012999:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11325 00010000:00010000:3.0:1746065129.013002:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.013003:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065129.013004:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881261251456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.013006:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcea expref: 51 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.013009:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.013013:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcea expref: 51 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.013015:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcf8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.013019:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76be00, rc 0) 00010000:00010000:0.0:1746065129.013024:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.013025:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.013028:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf8 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065129.013031:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:1959:x1830881261251200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 47us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.013036:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11324 00010000:00010000:0.0:1746065129.013037:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf8 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.013042:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6003c00, rc 0) 00000100:00100000:0.0:1746065129.013058:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261251456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 54us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.013063:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11325 00000100:00100000:0.0:1746065129.023274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.023370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.023407:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261251712 00000100:00100000:0.0:1746065129.023415:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261251712 00000100:00100000:0.0:1746065129.024363:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261251968 00000100:00100000:0.0:1746065129.024368:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261251968 00000100:00100000:0.0:1746065129.024408:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9160 00000100:00100000:0.0:1746065129.024463:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:29240:x1830881261251712:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065129.024484:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.024487:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065129.024509:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f231400/0x14b4f8542d4f4789 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc9d expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.024528:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065129.024532:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065129.024540:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f480e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bcff expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.024578:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.024589:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc96 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.024596:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bca4 expref: 249 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.024602:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.024625:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bca4 expref: 249 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.024636:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bca4 expref: 249 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.024647:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259816832:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065129.024721:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc96 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.024729:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc96 expref: 8 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.024737:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259816960:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065129.024755:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065129.024964:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9161 00000100:00100000:3.0:1746065129.024972:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29245:x1830881261251968:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065129.024982:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.024989:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f481c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd06 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.025534:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.025542:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.025548:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065129.026127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.026338:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.026451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.026631:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.026681:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261252352 00000100:00100000:3.0:1746065129.026686:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261252352 00002000:00100000:3.0:1746065129.026710:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009009df80 x1830881261252352/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.026719:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009df80 with x1830881261252352 ext(0->1048575) 00002000:00010000:3.0:1746065129.026722:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009df80 00000100:00100000:3.0:1746065129.026735:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261252480 00000100:00100000:3.0:1746065129.026737:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261252480 00002000:00100000:3.0:1746065129.026746:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009009ed80 x1830881261252480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.026753:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009ed80 with x1830881261252480 ext(1048576->2097151) 00002000:00010000:3.0:1746065129.026756:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009ed80 00000100:00100000:3.0:1746065129.026765:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261252864 00000100:00100000:3.0:1746065129.026767:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261252864 00002000:00100000:3.0:1746065129.026777:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88008fd72300 x1830881261252864/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.026788:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72300 with x1830881261252864 ext(1048576->2097151) 00002000:00010000:3.0:1746065129.026791:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72300 00000100:00100000:3.0:1746065129.026801:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5200 00000100:00100000:3.0:1746065129.026805:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+31:1959:x1830881261252352:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065129.027774:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5201 00000100:00100000:3.0:1746065129.027781:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+32:1959:x1830881261252480:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065129.028275:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5202 00000100:00100000:1.0:1746065129.028297:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881261252864:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065129.031100:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261252736 00000100:00100000:2.0:1746065129.031110:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261252736 00002000:00100000:2.0:1746065129.031146:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd70700 x1830881261252736/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.031156:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70700 with x1830881261252736 ext(1048576->2097151) 00002000:00010000:2.0:1746065129.031161:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd70700 00000100:00100000:0.0:1746065129.031166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.031181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.031183:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5203 00000100:00100000:2.0:1746065129.031190:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881261252736:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065129.033727:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261253248 00000100:00100000:1.0:1746065129.033736:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261253248 00000100:00100000:0.0:1746065129.033762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.033778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065129.033780:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc96 expref: 9 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065129.033805:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261253120 00000100:00100000:1.0:1746065129.033808:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261253120 00010000:00010000:1.0:1746065129.033829:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bca4 expref: 251 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065129.033848:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5656 00000100:00100000:1.0:1746065129.033854:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261253248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065129.033864:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065129.033868:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc96 expref: 9 pid: 14645 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.033877:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc96 expref: 9 pid: 14645 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.033894:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.033899:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065129.033910:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.033914:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065129.033918:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.033922:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065129.033951:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261253248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 97us (2784us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.033956:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5656 00000100:00100000:1.0:1746065129.033992:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5657 00000100:00100000:1.0:1746065129.033995:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1961:x1830881261253120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065129.034001:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065129.034004:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bca4 expref: 251 pid: 14645 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.034011:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bca4 expref: 251 pid: 14645 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.034019:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.034021:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065129.034027:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065129.034035:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065129.034041:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.034044:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.034048:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.034060:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065129.034070:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1961:x1830881261253120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 74us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.034073:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5657 00010000:00010000:1.0:1746065129.034104:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a400/0x14b4f8542d4f47ac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bca4 expref: 250 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065129.034115:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259816832:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065129.034138:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f144a00/0x14b4f8542d4f476d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bc96 expref: 8 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065129.034144:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259816960:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065129.034156:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.034162:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.034169:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065129.034334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:2.0:1746065129.034338:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065129.034349:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261253632 00000100:00100000:0.0:1746065129.034352:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261253632 00000100:00100000:2.0:1746065129.034370:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:0.0:1746065129.034373:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88008fd73100 x1830881261253632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.034381:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73100 with x1830881261253632 ext(0->1048575) 00010000:00010000:2.0:1746065129.034384:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00002000:00010000:0.0:1746065129.034385:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd73100 00010000:00010000:2.0:1746065129.034389:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065129.034399:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261253760 00000004:00200000:2.0:1746065129.034400:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000100:00100000:0.0:1746065129.034402:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261253760 00002000:00100000:0.0:1746065129.034411:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88008fd70000 x1830881261253760/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.034417:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70000 with x1830881261253760 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.034419:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70000 00000100:00100000:0.0:1746065129.034425:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261254144 00000100:00100000:0.0:1746065129.034427:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261254144 00002000:00100000:0.0:1746065129.034435:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88008fd71f80 x1830881261254144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.034440:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71f80 with x1830881261254144 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.034442:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd71f80 00000100:00100000:0.0:1746065129.034449:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261254016 00000100:00100000:0.0:1746065129.034450:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261254016 00002000:00100000:0.0:1746065129.034457:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd05500 x1830881261254016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.034462:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05500 with x1830881261254016 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.034464:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05500 00000100:00100000:0.0:1746065129.034479:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5204 00000100:00100000:0.0:1746065129.034483:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1959:x1830881261253632:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065129.034498:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5205 00000100:00100000:1.0:1746065129.034502:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1959:x1830881261253760:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.035409:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5206 00000100:00100000:0.0:1746065129.035415:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261254144:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065129.035456:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5207 00000100:00100000:2.0:1746065129.035462:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261254016:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065129.036378:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76ba00/0x14b4f8542d4f481c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd06 expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.036397:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd06 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.036403:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065129.036406:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065129.036408:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f76a600, rc 0) 00000100:00100000:2.0:1746065129.036428:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29245:x1830881261251968:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11458us (13059us total) trans 8589943240 rc 0/0 00000100:00100000:2.0:1746065129.036434:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9161 00000040:00080000:3.0:1746065129.041209:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2639, 88 off222064 00000004:00080000:3.0:1746065129.041221:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728332405133ns, next at 666984569566ns, rc = 0 00000100:00100000:0.0:1746065129.041812:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+32:1959:x1830881261252352:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 15001us (15681us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.041832:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5200 00002000:00100000:0.0:1746065129.041841:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88009009df80 x1830881261252352/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.041850:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009df80 with x1830881261252352 ext(0->1048575) 00002000:00010000:0.0:1746065129.041854:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009df80 00000040:00080000:3.0:1746065129.042068:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2567, 88 off215544 00000004:00080000:3.0:1746065129.042074:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728333258358ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065129.042114:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2568, 88 off215632 00000004:00080000:3.0:1746065129.042117:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728333301531ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065129.042128:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2640, 88 off222152 00000004:00080000:3.0:1746065129.042130:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728333314964ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065129.042136:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2641, 88 off222240 00000004:00080000:3.0:1746065129.042139:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728333323340ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065129.042145:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2569, 88 off215720 00000004:00080000:3.0:1746065129.042148:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728333332524ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065129.042158:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2570, 88 off215808 00000004:00080000:3.0:1746065129.042160:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728333344994ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065129.042168:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2571, 88 off215896 00000004:00080000:3.0:1746065129.042171:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728333355929ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065129.042180:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2642, 88 off222328 00000004:00080000:3.0:1746065129.042182:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728333366948ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065129.042189:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2572, 88 off215984 00000004:00080000:3.0:1746065129.042191:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728333376063ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065129.042200:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2643, 88 off222416 00000004:00080000:3.0:1746065129.042202:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728333386535ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065129.042207:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2573, 88 off216072 00000004:00080000:3.0:1746065129.042210:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728333394315ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065129.042219:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2644, 88 off222504 00000004:00080000:3.0:1746065129.042221:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728333405495ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065129.042226:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2645, 88 off222592 00000004:00080000:3.0:1746065129.042228:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728333412973ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065129.042235:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2646, 88 off222680 00000004:00080000:3.0:1746065129.042237:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728333421449ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065129.042242:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2647, 88 off222768 00000004:00080000:3.0:1746065129.042244:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728333429258ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065129.042250:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2574, 88 off216160 00000004:00080000:3.0:1746065129.042253:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728333437305ns, next at 666938887344ns, rc = 0 00000100:00100000:3.0:1746065129.049294:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881261252480:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 21495us (22937us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065129.049308:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5201 00002000:00100000:3.0:1746065129.049319:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88009009ed80 x1830881261252480/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.049329:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009ed80 with x1830881261252480 ext(1048576->2097151) 00002000:00010000:3.0:1746065129.049335:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009ed80 00000100:00100000:3.0:1746065129.058012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.058164:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881261252864:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 29867us (31710us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.058174:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5202 00002000:00100000:0.0:1746065129.058183:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88008fd72300 x1830881261252864/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.058191:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72300 with x1830881261252864 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.058196:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72300 00000100:00100000:2.0:1746065129.058331:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261254400 00000100:00100000:2.0:1746065129.058337:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261254400 00000100:00100000:2.0:1746065129.058364:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9162 00000100:00100000:2.0:1746065129.058370:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+11:29243:x1830881261254400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.058385:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.058401:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd0d expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.058443:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065129.058450:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.058463:0:14643:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065129.058475:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.058485:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065129.058487:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065129.058490:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.058500:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a113600, rc 0) 00000100:00100000:2.0:1746065129.058526:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:29243:x1830881261254400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 156us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.058532:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9162 00000100:00100000:3.0:1746065129.058667:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1959:x1830881261252736:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 27477us (32034us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065129.058676:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5203 00002000:00100000:3.0:1746065129.058681:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd70700 x1830881261252736/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.058689:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70700 with x1830881261252736 ext(1048576->2097151) 00002000:00010000:3.0:1746065129.058692:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd70700 00000100:00100000:2.0:1746065129.065042:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+53:1959:x1830881261253632:12345-192.168.202.46@tcp:3:cat.0 Request processed in 30552us (31277us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065129.065054:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5204 00002000:00100000:2.0:1746065129.065064:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88008fd73100 x1830881261253632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.065073:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73100 with x1830881261253632 ext(0->1048575) 00002000:00010000:2.0:1746065129.065078:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd73100 00000100:00100000:2.0:1746065129.069406:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881261254016:12345-192.168.202.46@tcp:3:cat.0 Request processed in 33937us (35027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065129.069416:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5207 00002000:00100000:2.0:1746065129.069427:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd05500 x1830881261254016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.069436:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05500 with x1830881261254016 ext(1048576->2097151) 00002000:00010000:2.0:1746065129.069441:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05500 00000100:00100000:0.0:1746065129.069715:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261254144:12345-192.168.202.46@tcp:3:cat.0 Request processed in 34299us (35379us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.069720:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5206 00002000:00100000:0.0:1746065129.069725:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88008fd71f80 x1830881261254144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.069730:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71f80 with x1830881261254144 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.069733:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd71f80 00000100:00100000:1.0:1746065129.076483:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:1959:x1830881261253760:12345-192.168.202.46@tcp:3:cat.0 Request processed in 41971us (42695us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065129.076494:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5205 00002000:00100000:1.0:1746065129.076505:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88008fd70000 x1830881261253760/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.076514:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70000 with x1830881261253760 ext(1048576->2097151) 00002000:00010000:1.0:1746065129.076519:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70000 00000100:00100000:0.0:1746065129.083875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.083900:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261254528 00000100:00100000:0.0:1746065129.083906:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261254528 00000100:00100000:0.0:1746065129.084177:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9163 00000100:00100000:0.0:1746065129.084184:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29242:x1830881261254528:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.084202:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.084216:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd14 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.084262:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 251 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.084273:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 251 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.084293:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065129.084296:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065129.084299:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 11 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.084304:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6b9400, rc 0) 00000100:00100000:0.0:1746065129.085333:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29242:x1830881261254528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1146us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.085339:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9163 00010000:00010000:3.0:1746065129.105295:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.105312:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065129.105315:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065129.105319:0:14645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.105329:0:14645:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.105336:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.105344:0:14645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.105350:0:14645:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.105356:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.105397:0:14645:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.105411:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259817088:192.168.202.46@tcp:105: 00000001:00080000:2.0:1746065129.105743:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943240 is committed 00000001:00080000:2.0:1746065129.105757:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943238 is committed 00000001:00080000:2.0:1746065129.105763:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943241 is committed 00000004:00080000:2.0:1746065129.105767:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1866 committed 00000004:00080000:2.0:1746065129.105776:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1939 committed 00000004:00080000:2.0:1746065129.105781:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1938 committed 00000004:00080000:2.0:1746065129.105783:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1937 committed 00000004:00080000:2.0:1746065129.105784:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1936 committed 00000004:00080000:2.0:1746065129.105786:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1865 committed 00000004:00080000:2.0:1746065129.105787:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1935 committed 00000004:00080000:2.0:1746065129.105789:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1864 committed 00000004:00080000:2.0:1746065129.105790:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1934 committed 00000004:00080000:2.0:1746065129.105792:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1863 committed 00000004:00080000:2.0:1746065129.105794:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1862 committed 00000004:00080000:2.0:1746065129.105795:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1861 committed 00000004:00080000:2.0:1746065129.105797:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1933 committed 00000004:00080000:2.0:1746065129.105798:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1932 committed 00000004:00080000:2.0:1746065129.105800:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1860 committed 00000004:00080000:2.0:1746065129.105802:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1859 committed 00000004:00080000:2.0:1746065129.105803:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1931 committed 00000001:00080000:2.0:1746065129.105811:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943237 is committed 00000100:00100000:2.0:1746065129.105972:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259817216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065129.106019:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065129.106079:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259817728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065129.106105:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065129.106129:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065129.106135:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259817344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065129.106157:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065129.106175:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259817856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065129.106198:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065129.106228:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259817216 00000100:00100000:2.0:1746065129.106236:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259817216 00000100:00100000:2.0:1746065129.106289:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259817728 00000100:00100000:2.0:1746065129.106293:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259817728 00000100:00100000:2.0:1746065129.106311:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259817344 00000100:00100000:2.0:1746065129.106315:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259817344 00000100:00100000:2.0:1746065129.106330:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259817856 00000100:00100000:2.0:1746065129.106332:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259817856 00000100:00100000:2.0:1746065129.106348:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11326 00000100:00100000:2.0:1746065129.106355:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013071b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+80:3295:x1830881259817216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065129.106538:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065129.106543:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065129 -> 1746065129 00002000:00010000:2.0:1746065129.106544:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00002000:00010000:2.0:1746065129.106546:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065129 -> 1746065129 00002000:00010000:2.0:1746065129.106547:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2033 00000100:00100000:2.0:1746065129.106585:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013071b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259817216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (566us total) trans 17179872947 rc 0/0 00000100:00100000:2.0:1746065129.106592:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11326 00000100:00100000:2.0:1746065129.106694:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11327 00000100:00100000:2.0:1746065129.106701:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+80:3295:x1830881259817728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065129.106790:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065129.106794:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065129.106795:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065129.106797:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065129.106798:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065129.106856:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259817728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (750us total) trans 17179872948 rc 0/0 00000100:00100000:2.0:1746065129.106862:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11327 00000100:00100000:2.0:1746065129.106875:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11328 00000100:00100000:2.0:1746065129.106881:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+80:3295:x1830881259817344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065129.106975:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065129.106979:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065129 -> 1746065129 00002000:00010000:2.0:1746065129.106981:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065129 -> 1746065129 00002000:00010000:2.0:1746065129.106982:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065129 -> 1746065129 00002000:00010000:2.0:1746065129.106984:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065129.107012:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259817344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (853us total) trans 17179872949 rc 0/0 00000100:00100000:2.0:1746065129.107017:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11328 00000100:00100000:2.0:1746065129.107030:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11329 00000100:00100000:2.0:1746065129.107037:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+80:3295:x1830881259817856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065129.107119:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065129.107123:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065129.107124:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065129.107126:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065129.107127:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065129.107153:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259817856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (954us total) trans 17179872950 rc 0/0 00000100:00100000:2.0:1746065129.107159:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11329 00000100:00080000:2.0:1746065129.107181:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746065129.107220:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd07800/2, rc 0, transno 17179872949 00000100:00100000:2.0:1746065129.107232:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259817344:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065129.107243:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb11880/2, rc 0, transno 17179872950 00000100:00100000:2.0:1746065129.107246:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259817856:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065129.107253:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05c00/2, rc 0, transno 17179872947 00000100:00100000:2.0:1746065129.107256:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259817216:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065129.107263:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb12300/2, rc 0, transno 17179872948 00000100:00100000:2.0:1746065129.107266:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259817728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065129.107322:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259818240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065129.107349:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065129.107380:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259818240 00000100:00100000:2.0:1746065129.107385:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259818240 00000100:00100000:2.0:1746065129.107407:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11330 00000100:00100000:2.0:1746065129.107414:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+81:3295:x1830881259818240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065129.107528:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+82:3295:x1830881259818240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (178us total) trans 17179872951 rc 0/0 00000100:00100000:2.0:1746065129.107534:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11330 00000004:00080000:2.0:1746065129.107563:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90adf80/2, rc 0, transno 17179872951 00000100:00100000:2.0:1746065129.107568:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259818240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065129.107851:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259817600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065129.107883:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065129.107912:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259818112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065129.107935:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065129.107953:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065129.107960:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259817472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065129.107981:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065129.107999:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259817984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065129.108020:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065129.108051:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259817600 00000100:00100000:1.0:1746065129.108055:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259817600 00000100:00100000:1.0:1746065129.108078:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259818112 00000100:00100000:1.0:1746065129.108081:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259818112 00000100:00100000:1.0:1746065129.108096:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259817472 00000100:00100000:1.0:1746065129.108098:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259817472 00000100:00100000:1.0:1746065129.108111:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259817984 00000100:00100000:1.0:1746065129.108114:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259817984 00000100:00100000:1.0:1746065129.108131:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11331 00000100:00100000:1.0:1746065129.108138:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3298:x1830881259817600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065129.108242:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065129.108245:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065129.108247:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065129.108248:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065129.108250:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065129.108295:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881259817600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (412us total) trans 17179872952 rc 0/0 00000100:00100000:1.0:1746065129.108299:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11331 00000100:00100000:1.0:1746065129.108315:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11332 00000100:00100000:1.0:1746065129.108318:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3298:x1830881259818112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065129.108389:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881259818112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (453us total) trans 17179872953 rc 0/0 00000100:00100000:1.0:1746065129.108394:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11332 00000100:00100000:1.0:1746065129.108409:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11333 00000100:00100000:1.0:1746065129.108415:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3298:x1830881259817472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065129.108511:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:1.0:1746065129.108514:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065129 -> 1746065129 00002000:00010000:1.0:1746065129.108516:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065128 -> 1746065128 00002000:00010000:1.0:1746065129.108517:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065129 -> 1746065129 00002000:00010000:1.0:1746065129.108519:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5801 -> 5801 00000100:00100000:1.0:1746065129.108547:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881259817472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (563us total) trans 17179872954 rc 0/0 00000100:00100000:1.0:1746065129.108553:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11333 00000100:00100000:1.0:1746065129.108567:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11334 00000100:00100000:1.0:1746065129.108573:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3298:x1830881259817984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065129.108680:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881259817984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (659us total) trans 17179872955 rc 0/0 00000100:00100000:1.0:1746065129.108685:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11334 00010000:00010000:3.0:1746065129.108925:0:14645:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.108939:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259818368:192.168.202.46@tcp:105: 00000004:00080000:1.0:1746065129.109227:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05880/2, rc 0, transno 17179872954 00000100:00100000:1.0:1746065129.109234:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259817472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065129.109309:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065129.109468:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259818624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065129.109498:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065129.109519:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259819136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065129.109541:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065129.109560:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065129.109566:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259818752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065129.109588:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065129.109608:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259819264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065129.109629:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065129.109670:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259818624 00000100:00100000:3.0:1746065129.109675:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259818624 00000100:00100000:3.0:1746065129.109701:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259819136 00000100:00100000:3.0:1746065129.109703:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259819136 00000100:00100000:3.0:1746065129.109711:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259818752 00000100:00100000:3.0:1746065129.109713:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259818752 00000100:00100000:3.0:1746065129.109723:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259819264 00000100:00100000:3.0:1746065129.109725:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259819264 00000100:00100000:3.0:1746065129.109739:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11335 00000100:00100000:3.0:1746065129.109744:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3297:x1830881259818624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065129.109901:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065129.109904:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065129 -> 1746065129 00002000:00010000:3.0:1746065129.109906:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065129 -> 1746065129 00002000:00010000:3.0:1746065129.109908:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065129 -> 1746065129 00002000:00010000:3.0:1746065129.109909:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065129.109944:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3297:x1830881259818624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (445us total) trans 21474840162 rc 0/0 00000100:00100000:3.0:1746065129.109950:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11335 00000100:00100000:3.0:1746065129.109964:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11336 00000100:00100000:3.0:1746065129.109970:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3297:x1830881259819136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065129.110057:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065129.110060:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065129.110062:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065129.110063:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065129.110064:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065129.110092:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3297:x1830881259819136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (549us total) trans 21474840163 rc 0/0 00000100:00100000:3.0:1746065129.110097:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11336 00000100:00100000:3.0:1746065129.110110:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11337 00000100:00100000:3.0:1746065129.110116:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3297:x1830881259818752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065129.110204:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065129.110208:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065129 -> 1746065129 00002000:00010000:3.0:1746065129.110209:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065127 -> 1746065127 00002000:00010000:3.0:1746065129.110211:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065129 -> 1746065129 00002000:00010000:3.0:1746065129.110213:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746065129.110241:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3297:x1830881259818752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (651us total) trans 21474840164 rc 0/0 00000100:00100000:3.0:1746065129.110247:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11337 00000100:00100000:3.0:1746065129.110259:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11338 00000100:00100000:3.0:1746065129.110265:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3297:x1830881259819264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065129.110363:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065129.110366:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065129.110367:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065129.110369:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065129.110370:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065129.110397:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3297:x1830881259819264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (767us total) trans 21474840165 rc 0/0 00000100:00100000:3.0:1746065129.110403:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11338 00000100:00080000:3.0:1746065129.110432:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1746065129.110454:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0087800/2, rc 0, transno 21474840164 00000100:00100000:3.0:1746065129.110459:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259818752:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065129.110468:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7ff480/2, rc 0, transno 21474840165 00000100:00100000:3.0:1746065129.110471:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259819264:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065129.110479:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084000/2, rc 0, transno 21474840162 00000100:00100000:3.0:1746065129.110481:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259818624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065129.110488:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0087100/2, rc 0, transno 21474840163 00000100:00100000:3.0:1746065129.110490:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259819136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065129.110582:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259818496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065129.110614:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065129.110636:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259819008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065129.110658:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065129.110677:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065129.110690:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259818880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065129.110708:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065129.110724:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259819392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065129.110745:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065129.110772:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259818496 00000100:00100000:0.0:1746065129.110777:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259818496 00000100:00100000:0.0:1746065129.110794:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259819008 00000100:00100000:0.0:1746065129.110798:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259819008 00000100:00100000:0.0:1746065129.110806:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259818880 00000100:00100000:0.0:1746065129.110808:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259818880 00000100:00100000:0.0:1746065129.110852:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259819392 00000100:00100000:0.0:1746065129.110856:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259819392 00000100:00100000:0.0:1746065129.110870:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11339 00000100:00100000:0.0:1746065129.110876:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259818496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065129.110979:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065129.110982:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065129 -> 1746065129 00002000:00010000:0.0:1746065129.110984:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065129 -> 1746065129 00002000:00010000:0.0:1746065129.110985:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065129 -> 1746065129 00002000:00010000:0.0:1746065129.110987:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065129.111020:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259818496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (406us total) trans 21474840166 rc 0/0 00000100:00100000:0.0:1746065129.111026:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11339 00000100:00100000:0.0:1746065129.111045:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11340 00000100:00100000:0.0:1746065129.111051:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259819008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065129.111141:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065129.111145:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065129.111146:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065129.111148:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065129.111149:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:0.0:1746065129.111176:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259819008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (516us total) trans 21474840167 rc 0/0 00000100:00100000:0.0:1746065129.111182:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11340 00000100:00100000:0.0:1746065129.111197:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11341 00000100:00100000:0.0:1746065129.111203:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259818880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065129.111327:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259818880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 122us (615us total) trans 21474840168 rc 0/0 00000100:00100000:0.0:1746065129.111333:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11341 00000100:00100000:0.0:1746065129.111348:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11342 00000100:00100000:0.0:1746065129.111354:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3296:x1830881259819392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065129.111458:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3296:x1830881259819392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (711us total) trans 21474840169 rc 0/0 00000100:00100000:0.0:1746065129.111464:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11342 00000004:00080000:0.0:1746065129.111502:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084700/2, rc 0, transno 21474840168 00000100:00100000:0.0:1746065129.111508:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259818880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065129.111517:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7ff100/2, rc 0, transno 21474840169 00000100:00100000:0.0:1746065129.111519:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259819392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065129.111525:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0087b80/2, rc 0, transno 21474840166 00000100:00100000:0.0:1746065129.111528:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259818496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065129.111534:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085880/2, rc 0, transno 21474840167 00000100:00100000:0.0:1746065129.111536:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259819008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065129.111709:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb12680/2, rc 0, transno 17179872955 00000100:00100000:1.0:1746065129.111713:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259817984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065129.111720:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06a00/2, rc 0, transno 17179872952 00000100:00100000:1.0:1746065129.111722:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259817600:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065129.111728:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb13100/2, rc 0, transno 17179872953 00000100:00100000:1.0:1746065129.111730:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259818112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065129.113620:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259817088:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065129.113635:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259818368:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065129.113674:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002c00/0x14b4f8542d4f480e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 10 pid: 14645 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065129.113696:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.113726:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002600, rc 0) 00000100:00100000:3.0:1746065129.113772:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:29240:x1830881261251712:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 89309us (90505us total) trans 8589943241 rc 0/0 00000100:00100000:3.0:1746065129.113779:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9160 00000100:00100000:0.0:1746065129.115655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.116670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.117838:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261254784 00000100:00100000:2.0:1746065129.117847:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261254784 00000100:00100000:2.0:1746065129.117910:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261254656 00000100:00100000:2.0:1746065129.117914:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261254656 00000100:00100000:3.0:1746065129.118071:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3768 00000100:00100000:3.0:1746065129.118082:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29242:x1830881261254784:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:3.0:1746065129.118203:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29242:x1830881261254784:12345-192.168.202.46@tcp:49:cat.0 Request processed in 121us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.118210:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3768 00000100:00100000:3.0:1746065129.118228:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3769 00000100:00100000:3.0:1746065129.118234:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:29243:x1830881261254656:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:3.0:1746065129.118293:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75065d94-a855-40b7-bd64-6d6f17292955+9:29243:x1830881261254656:12345-192.168.202.46@tcp:49:cat.0 Request processed in 60us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.118298:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3769 00000100:00100000:0.0:1746065129.120942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.121650:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261254912 00000100:00100000:1.0:1746065129.121659:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261254912 00000100:00100000:1.0:1746065129.122439:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3770 00000100:00100000:1.0:1746065129.122451:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:29240:x1830881261254912:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:1.0:1746065129.122575:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:75065d94-a855-40b7-bd64-6d6f17292955+9:29240:x1830881261254912:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 126us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.122582:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3770 00000100:00100000:0.0:1746065129.154204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.154297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.154321:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261255168 00000100:00100000:0.0:1746065129.154328:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261255168 00002000:00100000:0.0:1746065129.154367:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd73800 x1830881261255168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.154376:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73800 with x1830881261255168 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.154381:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd73800 00000100:00100000:0.0:1746065129.154396:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261255424 00000100:00100000:0.0:1746065129.154398:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261255424 00002000:00100000:0.0:1746065129.154409:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd72680 x1830881261255424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.154416:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72680 with x1830881261255424 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.154418:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72680 00000100:00100000:0.0:1746065129.154430:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5208 00000100:00100000:0.0:1746065129.154438:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261255168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065129.156466:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5209 00000100:00100000:2.0:1746065129.156481:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261255424:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065129.176801:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261255424:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 20320us (22497us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.176830:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5209 00002000:00100000:0.0:1746065129.176842:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd72680 x1830881261255424/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.176851:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72680 with x1830881261255424 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.176856:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72680 00000100:00100000:0.0:1746065129.177146:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261255168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22708us (22946us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.177153:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5208 00002000:00100000:0.0:1746065129.177158:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008fd73800 x1830881261255168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.177171:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73800 with x1830881261255168 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.177174:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd73800 00000100:00100000:0.0:1746065129.185520:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.185554:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.185575:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261255808 00000100:00100000:0.0:1746065129.185582:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261255808 00002000:00100000:0.0:1746065129.185613:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012d136a00 x1830881261255808/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.185622:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136a00 with x1830881261255808 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.185626:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d136a00 00000100:00100000:0.0:1746065129.185641:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5210 00000100:00100000:0.0:1746065129.185646:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261255808:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065129.187231:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261255552 00000100:00100000:2.0:1746065129.187240:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261255552 00000100:00100000:2.0:1746065129.187271:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11343 00000100:00100000:2.0:1746065129.187288:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+29:29240:x1830881261255552:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065129.187299:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.187313:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd1b expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.187338:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb2 expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.187346:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcdc expref: 32 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.187352:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.187353:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.187356:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1265664->1695743] (req 1265664->1695743) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 30 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.187377:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcdc expref: 32 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.187386:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcdc expref: 32 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.187395:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259819520:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.187459:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb2 expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.187466:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb2 expref: 30 pid: 9716 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.187472:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259819648:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.187487:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.190232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.190349:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261256064 00000100:00100000:0.0:1746065129.190355:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261256064 00002000:00100000:0.0:1746065129.190388:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012d137b80 x1830881261256064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.190397:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137b80 with x1830881261256064 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.190402:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d137b80 00000100:00100000:0.0:1746065129.190418:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5211 00000100:00100000:0.0:1746065129.190424:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261256064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.191807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.192504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.192523:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261256320 00000100:00100000:0.0:1746065129.192529:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261256320 00010000:00010000:0.0:1746065129.192552:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb2 expref: 32 pid: 9716 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.192631:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259819520:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.192640:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259819648:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.192666:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [1265664->1695743] (req 1265664->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 32 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.192678:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbcda00, rc 0) 00000100:00100000:2.0:1746065129.192707:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+32:29240:x1830881261255552:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5430us (7194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.192714:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11343 00000100:00100000:0.0:1746065129.198331:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261256192 00000100:00100000:0.0:1746065129.198340:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261256192 00010000:00010000:0.0:1746065129.198368:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcdc expref: 34 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065129.198388:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5658 00000100:00100000:0.0:1746065129.198396:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+31:1960:x1830881261256320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065129.198407:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065129.198423:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb2 expref: 31 pid: 9716 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065129.198433:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb2 expref: 31 pid: 9716 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065129.198453:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003800/0x14b4f8542d4f47c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb2 expref: 31 pid: 9716 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065129.198463:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065129.198507:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261256320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (6702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.198513:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5658 00000100:00100000:0.0:1746065129.198529:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5659 00000100:00100000:0.0:1746065129.198534:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261256192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065129.198540:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065129.198547:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcdc expref: 34 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065129.198555:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcdc expref: 34 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065129.198565:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6002e00/0x14b4f8542d4f47f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcdc expref: 34 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065129.198573:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.198574:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.198580:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.198589:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.198616:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 29 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065129.198627:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d137480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259819776:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065129.203269:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.208447:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+28:1961:x1830881261255808:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 22792us (22883us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.208458:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5210 00002000:00100000:0.0:1746065129.208468:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012d136a00 x1830881261255808/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.208477:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136a00 with x1830881261255808 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.208482:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d136a00 00000100:00100000:0.0:1746065129.215515:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d137480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259819776:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065129.215532:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065129.215564:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261256192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 17029us (23060us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.215572:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5659 00000100:00100000:0.0:1746065129.216404:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881261256064:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25978us (26176us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.216411:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5211 00002000:00100000:0.0:1746065129.216419:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88012d137b80 x1830881261256064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.216428:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137b80 with x1830881261256064 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.216433:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d137b80 00000100:00100000:0.0:1746065129.216471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.216520:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261256576 00000100:00100000:0.0:1746065129.216525:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261256576 00002000:00100000:0.0:1746065129.216550:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x379:0x0] (1265664->1269759) req@ffff88012d137480 x1830881261256576/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.216556:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137480 with x1830881261256576 ext(1265664->1269759) 00002000:00010000:0.0:1746065129.216559:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d137480 00000100:00100000:0.0:1746065129.216571:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5212 00000100:00100000:0.0:1746065129.216577:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261256576:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065129.216693:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261256576:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 115us (221us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065129.216698:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5212 00002000:00100000:0.0:1746065129.216702:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x379:0x0] (1265664->1269759) req@ffff88012d137480 x1830881261256576/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.216709:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137480 with x1830881261256576 ext(1265664->1269759) 00002000:00010000:0.0:1746065129.216711:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d137480 00000100:00100000:0.0:1746065129.221964:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.221996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.222850:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261257088 00000100:00100000:1.0:1746065129.222859:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261257088 00002000:00100000:1.0:1746065129.222892:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012d135500 x1830881261257088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.222902:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135500 with x1830881261257088 ext(1048576->2097151) 00002000:00010000:1.0:1746065129.222906:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d135500 00000100:00100000:1.0:1746065129.222920:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261256832 00000100:00100000:1.0:1746065129.222923:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261256832 00002000:00100000:1.0:1746065129.222932:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012d136d80 x1830881261256832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.222938:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136d80 with x1830881261256832 ext(1048576->2097151) 00002000:00010000:1.0:1746065129.222941:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d136d80 00000100:00100000:1.0:1746065129.222951:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5213 00000100:00100000:1.0:1746065129.222957:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:1961:x1830881261257088:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065129.223238:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5214 00000100:00100000:2.0:1746065129.223245:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881261256832:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065129.230381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.230444:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261257344 00000100:00100000:1.0:1746065129.230453:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261257344 00002000:00100000:1.0:1746065129.230495:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1691648->1695743) req@ffff8800a90ad880 x1830881261257344/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.230505:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad880 with x1830881261257344 ext(1691648->1695743) 00002000:00010000:1.0:1746065129.230509:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ad880 00000100:00100000:1.0:1746065129.230527:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5215 00000100:00100000:1.0:1746065129.230534:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261257344:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065129.231247:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261257344:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 710us (869us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065129.231254:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5215 00002000:00100000:1.0:1746065129.231260:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x379:0x0] (1691648->1695743) req@ffff8800a90ad880 x1830881261257344/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.231267:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad880 with x1830881261257344 ext(1691648->1695743) 00002000:00010000:1.0:1746065129.231271:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ad880 00000100:00100000:0.0:1746065129.234770:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:1961:x1830881261257088:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11806us (12804us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.234780:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5213 00002000:00100000:0.0:1746065129.234790:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012d135500 x1830881261257088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.234799:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135500 with x1830881261257088 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.234804:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d135500 00000100:00100000:1.0:1746065129.239147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.239298:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261257600 00000100:00100000:3.0:1746065129.239306:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261257600 00000100:00100000:3.0:1746065129.239355:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3771 00000100:00100000:3.0:1746065129.239363:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+9:29240:x1830881261257600:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065129.239597:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+10:29240:x1830881261257600:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 235us (455us total) trans 8589943242 rc 0/0 00000100:00100000:3.0:1746065129.239603:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3771 00000100:00100000:0.0:1746065129.240811:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1959:x1830881261256832:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 17564us (18812us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.240836:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5214 00002000:00100000:0.0:1746065129.240843:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->2097151) req@ffff88012d136d80 x1830881261256832/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.240852:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136d80 with x1830881261256832 ext(1048576->2097151) 00002000:00010000:0.0:1746065129.240856:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d136d80 00000100:00100000:2.0:1746065129.243607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.243630:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261257728 00000100:00100000:2.0:1746065129.243637:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261257728 00000100:00100000:2.0:1746065129.243669:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11344 00000100:00100000:2.0:1746065129.243675:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:29245:x1830881261257728:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065129.244071:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.244086:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd22 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.244111:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcce expref: 27 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.244124:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf8 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.244130:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.244132:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.244135:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3600384->4194303] (req 3600384->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 33 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.244160:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf8 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.244171:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf8 expref: 33 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.244181:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259819904:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.244253:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcce expref: 27 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.244261:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcce expref: 27 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.244269:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259820032:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.244298:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.251412:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.251711:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259819904:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065129.251732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.251985:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261257984 00000100:00100000:1.0:1746065129.251991:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261257984 00010000:00010000:1.0:1746065129.252019:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf8 expref: 34 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746065129.252043:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5660 00000100:00100000:1.0:1746065129.252050:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881261257984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065129.252061:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065129.252083:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf8 expref: 34 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065129.252093:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf8 expref: 34 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065129.252111:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003c00/0x14b4f8542d4f4807 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf8 expref: 34 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065129.252123:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065129.252127:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261257856 00000100:00100000:0.0:1746065129.252131:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261257856 00000100:00100000:0.0:1746065129.252151:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11345 00000100:00100000:1.0:1746065129.252156:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881261257984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.252156:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881261257856:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065129.252165:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5660 00010000:00010000:0.0:1746065129.252167:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.252177:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f631e00/0x14b4f8542d4f484d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd29 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065129.252196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.252238:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259820032:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065129.252265:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3600384->4194303] (req 3600384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 34 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.252273:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596c600, rc 0) 00000100:00100000:3.0:1746065129.252322:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:29245:x1830881261257728:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8647us (8720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.252326:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11344 00000100:00100000:0.0:1746065129.252330:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259820160:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065129.252366:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065129.253119:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258112 00000100:00100000:2.0:1746065129.253123:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258112 00000100:00100000:2.0:1746065129.253144:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11346 00000100:00100000:2.0:1746065129.253149:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261258112:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.253155:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.253162:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f4854 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd30 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.253172:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.253177:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f4854 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd30 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.253185:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8df600/0x14b4f8542d4f4854 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd30 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.253191:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8df600, rc 0) 00000100:00100000:2.0:1746065129.253207:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261258112:12345-192.168.202.46@tcp:101:cat.0 Request processed in 58us (1010us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065129.253212:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11346 00000100:00100000:1.0:1746065129.254110:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.254143:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258240 00000100:00100000:2.0:1746065129.254146:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258240 00000100:00100000:1.0:1746065129.254153:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065129.254160:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcce expref: 28 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.254178:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5661 00000100:00100000:2.0:1746065129.254182:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+28:1960:x1830881261258240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.254191:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.254203:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcce expref: 28 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.254213:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcce expref: 28 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.254226:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f455800/0x14b4f8542d4f47d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcce expref: 28 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.254234:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.254236:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.254241:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 33 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.254249:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 33 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.254269:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 33 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.254294:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259820288:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065129.254327:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065129.254426:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258368 00000100:00100000:3.0:1746065129.254430:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258368 00000100:00100000:3.0:1746065129.254449:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11347 00000100:00100000:3.0:1746065129.254454:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881261258368:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.254463:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.254470:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f4e400/0x14b4f8542d4f485b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd37 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.254792:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259820416:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065129.254866:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d3c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746065129.257672:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime: 1746065129 -> 1746065130 00002000:00010000:0.0:1746065129.257677:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime: 1746065129 -> 1746065130 00002000:00010000:0.0:1746065129.257679:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime: 1746065129 -> 1746065130 00000100:00100000:0.0:1746065129.257695:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881259820160:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065129.257719:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f631e00/0x14b4f8542d4f484d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd29 expref: 33 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.257729:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f631e00/0x14b4f8542d4f484d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd29 expref: 33 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.257737:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f631e00, rc 0) 00000100:00100000:0.0:1746065129.257771:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261257856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5614us (6366us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065129.257778:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11345 00002000:00010000:3.0:1746065129.257860:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime: 1746065129 -> 1746065130 00002000:00010000:3.0:1746065129.257863:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime: 1746065127 -> 1746065130 00002000:00010000:3.0:1746065129.257865:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime: 1746065129 -> 1746065130 00000100:00100000:3.0:1746065129.257874:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259820416:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065129.257891:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f4e400/0x14b4f8542d4f485b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd37 expref: 29 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.257901:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f4e400/0x14b4f8542d4f485b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd37 expref: 29 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.257908:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f4e400, rc 0) 00000100:00100000:3.0:1746065129.257925:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:1958:x1830881261258368:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3471us (3773us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065129.257930:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11347 00000100:00100000:1.0:1746065129.257989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.258035:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258624 00000100:00100000:0.0:1746065129.258040:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258624 00002000:00100000:0.0:1746065129.258067:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3600384->3604479) req@ffff880134d86a00 x1830881261258624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.258074:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86a00 with x1830881261258624 ext(3600384->3604479) 00000100:00100000:2.0:1746065129.258075:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259820288:192.168.202.46@tcp:105: 00002000:00010000:0.0:1746065129.258078:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d86a00 00010000:00010000:2.0:1746065129.258086:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065129.258092:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5216 00000100:00100000:0.0:1746065129.258097:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261258624:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065129.258152:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+27:1960:x1830881261258240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3968us (4042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.258159:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5661 00000100:00100000:0.0:1746065129.258215:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261258624:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 117us (226us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065129.258221:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5216 00002000:00100000:0.0:1746065129.258225:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3600384->3604479) req@ffff880134d86a00 x1830881261258624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.258232:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86a00 with x1830881261258624 ext(3600384->3604479) 00002000:00010000:0.0:1746065129.258235:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d86a00 00000100:00100000:2.0:1746065129.267240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.267313:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258880 00000100:00100000:0.0:1746065129.267322:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258880 00002000:00100000:0.0:1746065129.267371:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88008fd04000 x1830881261258880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.267381:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04000 with x1830881261258880 ext(2097152->3145727) 00002000:00010000:0.0:1746065129.267385:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04000 00000100:00100000:0.0:1746065129.267401:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5217 00000100:00100000:0.0:1746065129.267409:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881261258880:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.274834:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+30:1958:x1830881261258880:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7400us (7575us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.274845:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5217 00002000:00100000:0.0:1746065129.274856:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88008fd04000 x1830881261258880/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.274864:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04000 with x1830881261258880 ext(2097152->3145727) 00002000:00010000:0.0:1746065129.274869:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04000 00000100:00100000:0.0:1746065129.285212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.285233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.285244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.285256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.285305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.285335:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261259136 00000100:00100000:0.0:1746065129.285344:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261259136 00002000:00100000:0.0:1746065129.285386:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012d136680 x1830881261259136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.285396:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136680 with x1830881261259136 ext(2097152->3145727) 00002000:00010000:0.0:1746065129.285401:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d136680 00000100:00100000:0.0:1746065129.285415:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261259392 00000100:00100000:0.0:1746065129.285417:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261259392 00002000:00100000:0.0:1746065129.285427:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012d137100 x1830881261259392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.285434:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137100 with x1830881261259392 ext(3145728->4194303) 00002000:00010000:0.0:1746065129.285436:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d137100 00000100:00100000:0.0:1746065129.285444:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261259648 00000100:00100000:0.0:1746065129.285446:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261259648 00002000:00100000:0.0:1746065129.285456:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012d135c00 x1830881261259648/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.285462:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135c00 with x1830881261259648 ext(2097152->3145727) 00002000:00010000:0.0:1746065129.285466:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d135c00 00000100:00100000:0.0:1746065129.285474:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261259904 00000100:00100000:0.0:1746065129.285476:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261259904 00002000:00100000:0.0:1746065129.285484:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3600383) req@ffff88012d134e00 x1830881261259904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.285490:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134e00 with x1830881261259904 ext(3145728->3600383) 00002000:00010000:0.0:1746065129.285492:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d134e00 00000100:00100000:0.0:1746065129.285501:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5218 00000100:00100000:0.0:1746065129.285508:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1958:x1830881261259136:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.286660:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5219 00000100:00100000:0.0:1746065129.286670:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+53:1958:x1830881261259392:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.287758:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5220 00000100:00100000:0.0:1746065129.287765:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881261259648:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.290558:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5221 00000100:00100000:0.0:1746065129.290568:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261259904:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065129.292793:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261260032 00000100:00100000:3.0:1746065129.292801:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261260032 00000100:00100000:3.0:1746065129.292854:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11348 00000100:00100000:3.0:1746065129.292861:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+27:29243:x1830881261260032:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.292874:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.292890:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd3e expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.292997:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.293004:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065129.293005:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065129.293008:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.293034:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.293048:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 35 pid: 21235 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065129.293059:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259820544:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065129.293116:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.310839:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+53:1958:x1830881261259136:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25302us (25606us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065129.310853:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5218 00002000:00100000:1.0:1746065129.310866:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x380:0x0] (2097152->3145727) req@ffff88012d136680 x1830881261259136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.310874:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136680 with x1830881261259136 ext(2097152->3145727) 00002000:00010000:1.0:1746065129.310880:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d136680 00000100:00100000:0.0:1746065129.317471:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:1958:x1830881261259392:12345-192.168.202.46@tcp:3:cat.0 Request processed in 30796us (32230us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.317482:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5219 00002000:00100000:0.0:1746065129.317492:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88012d137100 x1830881261259392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.317501:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137100 with x1830881261259392 ext(3145728->4194303) 00002000:00010000:0.0:1746065129.317506:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d137100 00000100:00100000:0.0:1746065129.321021:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881259820544:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065129.321046:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.321062:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d75d400, rc 0) 00000100:00100000:0.0:1746065129.321099:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75065d94-a855-40b7-bd64-6d6f17292955+28:29243:x1830881261260032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 28237us (35791us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.321106:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11348 00000100:00100000:0.0:1746065129.325243:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.325264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.325943:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261259648:12345-192.168.202.46@tcp:3:cat.0 Request processed in 38175us (40694us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.325953:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5220 00002000:00100000:0.0:1746065129.325964:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff88012d135c00 x1830881261259648/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.325972:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135c00 with x1830881261259648 ext(2097152->3145727) 00010000:00010000:0.0:1746065129.325980:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 34 pid: 21235 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.325994:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 34 pid: 21235 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.326000:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d135c00 00000100:00100000:0.0:1746065129.326022:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261260288 00000100:00100000:0.0:1746065129.326028:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261260288 00002000:00100000:0.0:1746065129.326051:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3600384->4194303) req@ffff88009f15d880 x1830881261260288/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.326063:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15d880 with x1830881261260288 ext(3600384->4194303) 00010000:00010000:0.0:1746065129.326066:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 34 pid: 21235 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.326074:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 34 pid: 21235 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.326079:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f15d880 00000100:00100000:0.0:1746065129.326092:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1576 00000100:00100000:0.0:1746065129.326097:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261260288:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065129.326738:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881261259904:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36170us (41479us total) trans 0 rc 454656/454656 00000100:00100000:0.0:1746065129.326743:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5221 00002000:00100000:0.0:1746065129.326749:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->3600383) req@ffff88012d134e00 x1830881261259904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 454656/454656 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.326756:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134e00 with x1830881261259904 ext(3145728->3600383) 00010000:00010000:0.0:1746065129.326760:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 34 pid: 21235 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.326767:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 34 pid: 21235 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.326772:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d134e00 00000100:00100000:0.0:1746065129.331316:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261260160 00000100:00100000:0.0:1746065129.331325:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261260160 00000100:00100000:0.0:1746065129.331362:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11349 00000100:00100000:0.0:1746065129.331370:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+51:29245:x1830881261260160:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065129.331385:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.331399:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd45 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.331423:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc7 expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.331430:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf1 expref: 52 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.331435:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.331437:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.331439:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4599807] (req 4194304->4599807) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 52 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.331461:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf1 expref: 52 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.331469:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf1 expref: 52 pid: 4545 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065129.331479:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259820672:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065129.331535:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc7 expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.331546:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc7 expref: 29 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065129.331553:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259820800:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065129.331564:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.338189:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259820672:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065129.338200:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259820800:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065129.338226:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->4599807] (req 4194304->4599807) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 52 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.338241:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f231200, rc 0) 00000100:00100000:0.0:1746065129.338285:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:29245:x1830881261260160:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6905us (13039us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.338294:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11349 00000100:00100000:0.0:1746065129.347075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.347095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.347124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.347185:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261260416 00000100:00100000:0.0:1746065129.347192:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261260416 00000100:00100000:0.0:1746065129.347222:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11350 00000100:00100000:0.0:1746065129.347229:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:29242:x1830881261260416:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.347244:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.347257:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd4c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.347291:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.347293:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.347299:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd4c expref: 53 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.347310:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd4c expref: 53 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.347319:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f230c00, rc 0) 00000100:00100000:0.0:1746065129.347352:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+53:29242:x1830881261260416:12345-192.168.202.46@tcp:101:cat.0 Request processed in 124us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.347357:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11350 00000100:00100000:2.0:1746065129.348575:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261260544 00000100:00100000:2.0:1746065129.348581:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261260544 00010000:00010000:2.0:1746065129.348600:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc7 expref: 30 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.348616:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261260672 00000100:00100000:2.0:1746065129.348618:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261260672 00010000:00010000:2.0:1746065129.348624:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf1 expref: 53 pid: 4545 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.348635:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5662 00000100:00100000:2.0:1746065129.348639:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+30:1960:x1830881261260544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.348646:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.348659:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc7 expref: 30 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.348667:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc7 expref: 30 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.348681:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f454a00/0x14b4f8542d4f47cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc7 expref: 30 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.348688:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.348707:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+29:1960:x1830881261260544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.348711:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5662 00000100:00100000:2.0:1746065129.348720:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5663 00000100:00100000:2.0:1746065129.348725:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+53:1961:x1830881261260672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.348729:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.348734:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf1 expref: 53 pid: 4545 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.348740:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf1 expref: 53 pid: 4545 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.348748:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f76ae00/0x14b4f8542d4f47f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcf1 expref: 53 pid: 4545 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.348753:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.348754:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.348758:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 52 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.348765:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 52 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.348785:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 52 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.348794:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259820928:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065129.349810:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42600 going to sleep for 11 seconds 00000001:00080000:1.0:1746065129.351150:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840169 is committed 00000001:00080000:1.0:1746065129.351167:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840152 is committed 00000001:00080000:1.0:1746065129.351256:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840151 is committed 00000001:00080000:1.0:1746065129.352657:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840153 is committed 00000100:00100000:0.0:1746065129.359371:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261260288:12345-192.168.202.46@tcp:4:cat.0 Request processed in 33264us (34096us total) trans 21474840170 rc 0/0 00000100:00100000:0.0:1746065129.359382:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1576 00002000:00100000:0.0:1746065129.359392:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3600384->4194303) req@ffff88009f15d880 x1830881261260288/t21474840170(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.359401:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15d880 with x1830881261260288 ext(3600384->4194303) 00010000:00010000:0.0:1746065129.359409:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 16 pid: 21235 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.359423:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 16 pid: 21235 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.359429:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f15d880 00000100:00100000:0.0:1746065129.359483:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259820928:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065129.359497:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065129.359526:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1961:x1830881261260672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 10800us (12400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.359533:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5663 00000100:00100000:2.0:1746065129.359913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.359943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.360116:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261260928 00000100:00100000:0.0:1746065129.360121:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261260928 00002000:00100000:0.0:1746065129.360147:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4595712->4599807) req@ffff88008fd04380 x1830881261260928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.360154:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04380 with x1830881261260928 ext(4595712->4599807) 00002000:00010000:0.0:1746065129.360157:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04380 00000100:00100000:1.0:1746065129.360179:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261261184 00000100:00100000:1.0:1746065129.360181:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261261184 00002000:00100000:1.0:1746065129.360192:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88008fd04a80 x1830881261261184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.360197:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04a80 with x1830881261261184 ext(3145728->4194303) 00002000:00010000:1.0:1746065129.360200:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04a80 00000100:00100000:1.0:1746065129.360241:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5222 00000100:00100000:1.0:1746065129.360246:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+53:1961:x1830881261260928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065129.360389:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+53:1961:x1830881261260928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 141us (480us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065129.360395:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5222 00002000:00100000:1.0:1746065129.360400:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (4595712->4599807) req@ffff88008fd04380 x1830881261260928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.360406:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04380 with x1830881261260928 ext(4595712->4599807) 00002000:00010000:1.0:1746065129.360409:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04380 00000100:00100000:1.0:1746065129.360423:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5223 00000100:00100000:1.0:1746065129.360427:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1959:x1830881261261184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.382958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.383325:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1959:x1830881261261184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22894us (23378us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065129.383334:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5223 00002000:00100000:0.0:1746065129.383344:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88008fd04a80 x1830881261261184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.383353:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04a80 with x1830881261261184 ext(3145728->4194303) 00002000:00010000:0.0:1746065129.383359:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04a80 00000100:00100000:0.0:1746065129.383389:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261261312 00000100:00100000:0.0:1746065129.383394:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261261312 00010000:00010000:0.0:1746065129.383417:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 16 pid: 21235 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.383437:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5664 00000100:00100000:0.0:1746065129.383443:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261261312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065129.383453:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065129.383468:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 16 pid: 21235 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.383478:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 16 pid: 21235 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.383497:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a596c600/0x14b4f8542d4f4846 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd22 expref: 16 pid: 21235 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065129.383510:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.383512:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.383517:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.383524:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.383551:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065129.383562:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259821056:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065129.394094:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.396812:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259821056:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065129.396842:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065129.396874:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881261261312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 13430us (13922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.396883:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5664 00000100:00100000:0.0:1746065129.399857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.399882:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261261440 00000100:00100000:0.0:1746065129.399888:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261261440 00000100:00100000:0.0:1746065129.399921:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9164 00000100:00100000:0.0:1746065129.399927:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:29249:x1830881261261440:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065129.399946:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.399960:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66dc00/0x14b4f8542d4f4877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd53 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.400004:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.400014:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.400022:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.400032:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.400037:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.400041:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.400128:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.400137:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd06 expref: 248 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.400143:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.400168:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd06 expref: 248 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.400182:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd06 expref: 248 pid: 14643 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.400192:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259821184:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065129.400245:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.400638:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.400653:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261261568 00000100:00100000:0.0:1746065129.400656:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261261568 00000100:00100000:0.0:1746065129.400675:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11351 00000100:00100000:0.0:1746065129.400680:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:29242:x1830881261261568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.400687:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.400696:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd5a expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.400710:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.400711:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.400716:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd5a expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.400725:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd5a expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.400733:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66c200, rc 0) 00000100:00100000:0.0:1746065129.400755:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:29242:x1830881261261568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 74us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.400760:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11351 00000100:00100000:1.0:1746065129.412092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.412136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.412159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.412179:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261261824 00000100:00100000:1.0:1746065129.412184:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261261824 00002000:00100000:1.0:1746065129.412217:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880134d84380 x1830881261261824/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.412227:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84380 with x1830881261261824 ext(2097152->3145727) 00002000:00010000:1.0:1746065129.412231:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d84380 00000100:00100000:1.0:1746065129.412243:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261262336 00000100:00100000:1.0:1746065129.412246:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261262336 00002000:00100000:1.0:1746065129.412256:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880134d86d80 x1830881261262336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.412263:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86d80 with x1830881261262336 ext(3145728->4194303) 00002000:00010000:1.0:1746065129.412265:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d86d80 00000100:00100000:1.0:1746065129.412286:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5224 00000100:00100000:1.0:1746065129.412292:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+8:1961:x1830881261261824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065129.413487:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259821184:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065129.413508:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065129.413526:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261262208 00000100:00100000:1.0:1746065129.413529:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261262208 00000100:00100000:1.0:1746065129.413553:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3772 00000100:00100000:1.0:1746065129.413558:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009badf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:27246:x1830881261262208:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065129.413692:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009badf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:27246:x1830881261262208:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 134us (1555us total) trans 8589943243 rc 0/0 00000100:00100000:1.0:1746065129.413698:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3772 00000100:00100000:1.0:1746065129.413737:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5225 00000100:00100000:1.0:1746065129.413742:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881261262336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.429051:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.429505:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261262464 00000100:00100000:1.0:1746065129.429514:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261262464 00002000:00100000:1.0:1746065129.429547:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x379:0x0] (1265664->1695743) req@ffff88009f15ea00 x1830881261262464/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.429557:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ea00 with x1830881261262464 ext(1265664->1695743) 00002000:00010000:1.0:1746065129.429562:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15ea00 00000100:00100000:1.0:1746065129.429581:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5226 00000100:00100000:1.0:1746065129.429589:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881261262464:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065129.435807:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.437957:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261261824:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25659us (25866us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065129.437967:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5224 00002000:00100000:1.0:1746065129.437978:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880134d84380 x1830881261261824/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.437988:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84380 with x1830881261261824 ext(2097152->3145727) 00002000:00010000:1.0:1746065129.437993:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d84380 00000100:00100000:1.0:1746065129.438084:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261262592 00000100:00100000:1.0:1746065129.438091:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261262592 00010000:00010000:1.0:1746065129.438118:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd06 expref: 250 pid: 14643 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065129.438138:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5665 00000100:00100000:1.0:1746065129.438726:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1960:x1830881261262592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065129.438741:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065129.438748:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd06 expref: 250 pid: 14643 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.438760:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd06 expref: 250 pid: 14643 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.438778:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f76a600/0x14b4f8542d4f4823 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd06 expref: 250 pid: 14643 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.438794:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.438798:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.438805:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.438811:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.438848:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065129.438867:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:1960:x1830881261262592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 723us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.438873:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5665 00010000:00010000:1.0:1746065129.439006:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439013:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065129.439050:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:1.0:1746065129.439054:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065129.439073:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439082:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439090:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439096:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439101:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439107:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a66d800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065129.439110:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439116:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439123:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065129.439126:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065129.439129:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439133:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d800/0x14b4f8542d4f487e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439143:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439147:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439151:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439155:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a66c000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065129.439157:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439162:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439172:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093669500) 00010000:00010000:1.0:1746065129.439174:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065129.439176:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439180:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c000/0x14b4f8542d4f4885 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.439210:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66dc00/0x14b4f8542d4f4877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd53 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.439221:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd53 expref: 7 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.439227:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.439229:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065129.439231:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66d000, rc 0) 00000100:00100000:1.0:1746065129.439255:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29249:x1830881261261440:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 39327us (39402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.439262:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9164 00000100:00100000:1.0:1746065129.439612:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881261262336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25868us (27450us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065129.439618:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5225 00002000:00100000:1.0:1746065129.439625:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff880134d86d80 x1830881261262336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.439633:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86d80 with x1830881261262336 ext(3145728->4194303) 00002000:00010000:1.0:1746065129.439636:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d86d80 00000100:00100000:1.0:1746065129.441104:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1958:x1830881261262464:12345-192.168.202.46@tcp:4:cat.0 Request processed in 11511us (12056us total) trans 21474840171 rc 0/0 00000100:00100000:1.0:1746065129.441112:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5226 00002000:00100000:1.0:1746065129.441119:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x379:0x0] (1265664->1695743) req@ffff88009f15ea00 x1830881261262464/t21474840171(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.441127:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f15ea00 with x1830881261262464 ext(1265664->1695743) 00002000:00010000:1.0:1746065129.441130:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f15ea00 00000100:00100000:1.0:1746065129.450479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.450499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.450511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.450550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.450603:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261262720 00000100:00100000:3.0:1746065129.450610:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261262720 00000100:00100000:3.0:1746065129.450639:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261262848 00000100:00100000:3.0:1746065129.450641:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261262848 00000100:00100000:3.0:1746065129.450651:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261262976 00000100:00100000:3.0:1746065129.450652:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261262976 00000100:00100000:3.0:1746065129.450669:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261263104 00000100:00100000:3.0:1746065129.450670:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261263104 00000100:00100000:3.0:1746065129.450682:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11352 00000100:00100000:3.0:1746065129.450689:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261262720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.450703:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.450716:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d500400/0x14b4f8542d4f489a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd61 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.450758:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259821312:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065129.450842:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11353 00000100:00100000:3.0:1746065129.450848:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1960:x1830881261262848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.450854:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.450861:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4f48a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd68 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.450883:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259821440:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065129.450901:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 11 seconds 00000100:00080000:3.0:1746065129.450912:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065129.451431:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065129.451699:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11354 00000100:00100000:2.0:1746065129.451706:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1959:x1830881261262976:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065129.451713:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.451721:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd6f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.451734:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.451735:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.451742:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd6f expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.451755:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd6f expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.451763:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f4ea00, rc 0) 00000100:00100000:2.0:1746065129.451785:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1959:x1830881261262976:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 80us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.451790:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11354 00000100:00100000:2.0:1746065129.451804:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11355 00000100:00100000:2.0:1746065129.451809:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1959:x1830881261263104:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065129.451852:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.451861:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f4ec00/0x14b4f8542d4f48af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd76 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.451885:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259821568:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065129.451913:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.452952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.452966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.452976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.452993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.453003:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261263232 00000100:00100000:0.0:1746065129.453008:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261263232 00000100:00100000:0.0:1746065129.453027:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261263360 00000100:00100000:0.0:1746065129.453028:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261263360 00000100:00100000:0.0:1746065129.453037:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261263488 00000100:00100000:0.0:1746065129.453038:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261263488 00000100:00100000:0.0:1746065129.453044:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261263616 00000100:00100000:0.0:1746065129.453046:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261263616 00000100:00100000:0.0:1746065129.453054:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11356 00000100:00100000:0.0:1746065129.453058:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881261263232:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065129.453067:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.453075:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd7d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.453087:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.453089:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.453093:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd7d expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.453103:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd7d expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.453109:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66cc00, rc 0) 00000100:00100000:0.0:1746065129.453128:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881261263232:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.453132:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11356 00000100:00100000:0.0:1746065129.453142:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11357 00000100:00100000:0.0:1746065129.453146:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881261263360:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065129.453150:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.453156:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd84 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.453164:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.453165:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.453169:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd84 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.453176:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd84 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.453181:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66ce00, rc 0) 00000100:00100000:0.0:1746065129.453190:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881261263360:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 44us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.453194:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11357 00000100:00100000:0.0:1746065129.453202:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11358 00000100:00100000:0.0:1746065129.453205:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881261263488:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065129.453209:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.453213:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a66de00/0x14b4f8542d4f48c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd8b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065129.453234:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259821696:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065129.453271:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.453311:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11359 00000100:00100000:0.0:1746065129.453315:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881261263616:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065129.453320:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.453324:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd92 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.453332:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.453333:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.453337:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd92 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.453344:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd92 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.453350:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66c800, rc 0) 00000100:00100000:0.0:1746065129.453360:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881261263616:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.453364:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11359 00002000:00010000:0.0:1746065129.456576:0:4545:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime: 1746065129 -> 1746065130 00002000:00010000:0.0:1746065129.456582:0:4545:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime: 1746065128 -> 1746065130 00002000:00010000:0.0:1746065129.456584:0:4545:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime: 1746065129 -> 1746065130 00000100:00100000:0.0:1746065129.456605:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259821440:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065129.456632:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4f48a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd68 expref: 53 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.456646:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4f48a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd68 expref: 53 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.456654:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501e00, rc 0) 00000100:00100000:0.0:1746065129.456688:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801363a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1960:x1830881261262848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5839us (6186us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065129.456695:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11353 00000100:00100000:0.0:1746065129.456794:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259821568:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065129.456807:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f4ec00/0x14b4f8542d4f48af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd76 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.456830:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f4ec00/0x14b4f8542d4f48af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd76 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.456836:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f4ec00, rc 0) 00000100:00100000:0.0:1746065129.456851:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881261263104:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 5043us (6302us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065129.456856:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11355 00000100:00100000:3.0:1746065129.456976:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259821312:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065129.456991:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d500400/0x14b4f8542d4f489a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd61 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.456998:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d500400/0x14b4f8542d4f489a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd61 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.457006:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500400, rc 0) 00000100:00100000:3.0:1746065129.457021:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261262720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6334us (6548us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065129.457026:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11352 00000100:00100000:0.0:1746065129.459988:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259821696:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065129.460019:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a66de00/0x14b4f8542d4f48c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd8b expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.460033:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a66de00/0x14b4f8542d4f48c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd8b expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.460048:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66de00, rc 0) 00000100:00100000:0.0:1746065129.460082:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1959:x1830881261263488:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 6874us (7104us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065129.460089:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11358 00000100:00100000:1.0:1746065129.469141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.469207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.469231:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261264000 00000100:00100000:1.0:1746065129.469237:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261264000 00002000:00100000:1.0:1746065129.469272:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4599808->5029887) req@ffff88009009e680 x1830881261264000/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.469295:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009e680 with x1830881261264000 ext(4599808->5029887) 00002000:00010000:1.0:1746065129.469300:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009e680 00000100:00100000:1.0:1746065129.469319:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5227 00000100:00100000:1.0:1746065129.469326:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1958:x1830881261264000:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.472014:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261263744 00000100:00100000:0.0:1746065129.472025:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261263744 00000100:00100000:0.0:1746065129.472092:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11360 00000100:00100000:0.0:1746065129.472099:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+29:29243:x1830881261263744:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.472112:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.472125:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bd99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.472145:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.472147:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.472153:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd99 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.472164:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd99 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.472173:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66dc00, rc 0) 00000100:00100000:0.0:1746065129.472211:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75065d94-a855-40b7-bd64-6d6f17292955+30:29243:x1830881261263744:12345-192.168.202.46@tcp:101:cat.0 Request processed in 112us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065129.472216:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11360 00000100:00100000:0.0:1746065129.472331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.473645:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261264256 00000100:00100000:0.0:1746065129.473651:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261264256 00000100:00100000:0.0:1746065129.473679:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9165 00000100:00100000:0.0:1746065129.473684:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29249:x1830881261264256:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065129.473695:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.473707:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d600/0x14b4f8542d4f48d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bda0 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.473783:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.473794:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd53 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.473800:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.473836:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd53 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.473846:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd53 expref: 8 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.473856:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259821824:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065129.473904:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065129.474378:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1958:x1830881261264000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5050us (5168us total) trans 0 rc 430080/430080 00000100:00100000:2.0:1746065129.474387:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5227 00002000:00100000:2.0:1746065129.474394:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4599808->5029887) req@ffff88009009e680 x1830881261264000/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 430080/430080 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.474403:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009e680 with x1830881261264000 ext(4599808->5029887) 00002000:00010000:2.0:1746065129.474406:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009e680 00000100:00100000:0.0:1746065129.478980:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.479039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.479060:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261264384 00000100:00100000:0.0:1746065129.479066:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261264384 00000100:00100000:0.0:1746065129.479095:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261264512 00000100:00100000:0.0:1746065129.479097:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261264512 00000100:00100000:0.0:1746065129.479111:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11361 00000100:00100000:0.0:1746065129.479118:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881261264384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.479132:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.479146:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9e00/0x14b4f8542d4f48e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bda7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065129.479185:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f15f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259821952:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065129.479246:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.479261:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11362 00000100:00100000:0.0:1746065129.479266:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+52:1959:x1830881261264512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.479273:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.479294:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0f9c00/0x14b4f8542d4f48ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bdae expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065129.479316:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259822080:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065129.479333:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000001:00080000:2.0:1746065129.486573:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872927 is committed 00000001:00080000:2.0:1746065129.486603:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872907 is committed 00000001:00080000:2.0:1746065129.486608:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872902 is committed 00000001:00080000:2.0:1746065129.486617:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872955 is committed 00000001:00080000:2.0:1746065129.486690:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872937 is committed 00000001:00080000:2.0:1746065129.486736:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872935 is committed 00000100:00100000:1.0:1746065129.487225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.487271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.487300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.487312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.487356:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261264640 00000100:00100000:1.0:1746065129.487363:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261264640 00010000:00010000:1.0:1746065129.487393:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd53 expref: 9 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065129.487417:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5666 00000100:00100000:1.0:1746065129.487425:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881261264640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065129.487436:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065129.487441:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd53 expref: 9 pid: 14645 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.487451:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd53 expref: 9 pid: 14645 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.487468:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.487472:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.487479:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.487485:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.487497:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065129.487528:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1958:x1830881261264640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.487533:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5666 00000100:00100000:1.0:1746065129.487554:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261265152 00000100:00100000:1.0:1746065129.487557:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261265152 00002000:00100000:1.0:1746065129.487575:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009009f480 x1830881261265152/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.487582:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009f480 with x1830881261265152 ext(3145728->4194303) 00002000:00010000:1.0:1746065129.487585:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009f480 00000100:00100000:1.0:1746065129.487592:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261265408 00000100:00100000:1.0:1746065129.487594:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261265408 00002000:00100000:1.0:1746065129.487602:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009009c380 x1830881261265408/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.487607:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009c380 with x1830881261265408 ext(3145728->4194303) 00002000:00010000:1.0:1746065129.487609:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009009c380 00000100:00100000:1.0:1746065129.487616:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5228 00000100:00100000:1.0:1746065129.487620:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261265152:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065129.490835:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5229 00000100:00100000:2.0:1746065129.490848:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261265408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.491983:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261264896 00000100:00100000:0.0:1746065129.491990:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261264896 00000100:00100000:0.0:1746065129.492021:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9166 00000100:00100000:0.0:1746065129.492026:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+10:29251:x1830881261264896:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065129.492040:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.492055:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f4ec00/0x14b4f8542d4f48f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bdb5 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.492136:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492149:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492158:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492169:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492173:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492178:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492256:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492263:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492268:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065129.492289:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065129.492350:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492355:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492360:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492368:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ad3b1c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065129.492370:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492376:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492385:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065129.492388:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065129.492391:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492395:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4f48fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492408:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492411:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492415:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492418:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ad3b1800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065129.492420:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492423:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492428:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5a36200) 00010000:00010000:0.0:1746065129.492430:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065129.492432:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492435:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f4903 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065129.492465:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f4ec00/0x14b4f8542d4f48f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdb5 expref: 13 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.492475:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdb5 expref: 12 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.492480:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065129.492482:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065129.492483:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b0000, rc 0) 00000100:00100000:0.0:1746065129.492507:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75065d94-a855-40b7-bd64-6d6f17292955+12:29251:x1830881261264896:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 480us (5287us total) trans 8589943244 rc 0/0 00000100:00100000:0.0:1746065129.492512:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9166 00010000:00010000:0.0:1746065129.492552:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d000/0x14b4f8542d4f488c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd53 expref: 8 pid: 14645 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065129.492564:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259821824:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065129.492581:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.492587:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065129.492590:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:0.0:1746065129.492602:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:0.0:1746065129.492649:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66d600/0x14b4f8542d4f48d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bda0 expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.492658:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bda0 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.492663:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065129.492665:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065129.492667:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66c600, rc 0) 00000100:00100000:0.0:1746065129.492682:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29249:x1830881261264256:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 18998us (20351us total) trans 8589943245 rc 0/0 00000100:00100000:0.0:1746065129.492687:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9165 00000100:00100000:0.0:1746065129.492725:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f15f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259821952:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065129.492742:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9e00/0x14b4f8542d4f48e7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bda7 expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.492751:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9e00/0x14b4f8542d4f48e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bda7 expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.492758:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0f9e00, rc 0) 00000100:00100000:0.0:1746065129.492779:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881261264384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 13662us (13805us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065129.492785:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11361 00000100:00100000:0.0:1746065129.492840:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259822080:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065129.492856:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0f9c00/0x14b4f8542d4f48ee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdae expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.492864:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0f9c00/0x14b4f8542d4f48ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdae expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.492870:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0f9c00, rc 0) 00000100:00100000:0.0:1746065129.492886:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881261264512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 13620us (13846us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065129.492890:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11362 00000100:00100000:1.0:1746065129.514486:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261265152:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26856us (27176us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065129.514496:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5228 00002000:00100000:1.0:1746065129.514506:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff88009009f480 x1830881261265152/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.514516:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009f480 with x1830881261265152 ext(3145728->4194303) 00002000:00010000:1.0:1746065129.514521:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009009f480 00000100:00100000:2.0:1746065129.521791:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261265408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 30941us (34470us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065129.521802:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5229 00002000:00100000:2.0:1746065129.521811:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (3145728->4194303) req@ffff88009009c380 x1830881261265408/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.521846:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009009c380 with x1830881261265408 ext(3145728->4194303) 00002000:00010000:2.0:1746065129.521851:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009009c380 00000100:00100000:0.0:1746065129.523398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.524720:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261265664 00000100:00100000:3.0:1746065129.524729:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261265664 00000100:00100000:3.0:1746065129.524777:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9167 00000100:00100000:3.0:1746065129.524785:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29249:x1830881261265664:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065129.524804:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.524807:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065129.524844:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66c600/0x14b4f8542d4f48e0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bda0 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.524873:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065129.524879:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065129.524890:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4f491f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bdbc expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.524961:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.524971:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.524978:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.524988:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.524993:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.524997:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.525002:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d501e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065129.525005:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.525009:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.525014:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065129.525016:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065129.525018:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.525022:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501e00/0x14b4f8542d4f4926 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065129.525041:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4f491f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdbc expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.525046:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4f491f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdbc expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.525052:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501000, rc 0) 00000100:00100000:3.0:1746065129.525089:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29249:x1830881261265664:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 305us (1696us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065129.525094:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9167 00000100:00100000:0.0:1746065129.534803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.535915:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261265792 00000100:00100000:2.0:1746065129.535924:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261265792 00000100:00100000:0.0:1746065129.535954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.536060:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261265920 00000100:00100000:2.0:1746065129.536064:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261265920 00000100:00100000:3.0:1746065129.536069:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11363 00000100:00100000:3.0:1746065129.536078:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881261265792:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.536094:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065129.536099:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11364 00000100:00100000:2.0:1746065129.536106:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881261265920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.536109:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f492d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bdc3 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.536113:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.536122:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090bbf800/0x14b4f8542d4f4934 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bdca expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.536152:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259822336:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065129.536155:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259822208:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065129.536223:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065129.536227:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.536706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.537551:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259822208:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065129.537569:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090bbf800/0x14b4f8542d4f4934 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdca expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.537580:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090bbf800/0x14b4f8542d4f4934 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdca expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.537603:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090bbf800, rc 0) 00000100:00100000:2.0:1746065129.537629:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881261265920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1524us (1677us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065129.537636:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11364 00000100:00100000:3.0:1746065129.537790:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261266176 00000100:00100000:3.0:1746065129.537794:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261266176 00000100:00100000:3.0:1746065129.537840:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3773 00000100:00100000:3.0:1746065129.537846:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29249:x1830881261266176:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065129.538009:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29249:x1830881261266176:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 163us (1303us total) trans 8589943246 rc 0/0 00000100:00100000:3.0:1746065129.538015:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3773 00000100:00100000:3.0:1746065129.538496:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259822336:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065129.538510:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f492d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdc3 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.538519:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f492d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdc3 expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.538526:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500a00, rc 0) 00000100:00100000:3.0:1746065129.538542:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881261265792:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2467us (3748us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065129.538547:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11363 00000100:00100000:0.0:1746065129.548550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.548600:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.548695:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261266688 00000100:00100000:2.0:1746065129.548704:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261266688 00000100:00100000:2.0:1746065129.548741:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11365 00000100:00100000:2.0:1746065129.548748:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261266688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.548764:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.548779:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090bbec00/0x14b4f8542d4f493b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bdd8 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.548848:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259822464:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065129.548924:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065129.549001:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261266432 00000100:00100000:3.0:1746065129.549005:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261266432 00000100:00100000:3.0:1746065129.549037:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3774 00000100:00100000:3.0:1746065129.549042:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29242:x1830881261266432:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065129.549200:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29242:x1830881261266432:12345-192.168.202.46@tcp:35:cat.0 Request processed in 156us (658us total) trans 8589943247 rc 0/0 00000100:00100000:3.0:1746065129.549206:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3774 00000100:00100000:2.0:1746065129.554568:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.554628:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261266816 00000100:00100000:1.0:1746065129.554636:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261266816 00000100:00100000:1.0:1746065129.554675:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9168 00000100:00100000:1.0:1746065129.554683:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29253:x1830881261266816:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065129.554703:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065129.554718:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12a00/0x14b4f8542d4f4942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bdd1 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.554842:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.554853:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.554863:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.554873:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.554878:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.554883:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.554969:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00000100:00100000:3.0:1746065129.554974:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259822464:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065129.554977:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.554983:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065129.554990:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:3.0:1746065129.554996:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090bbec00/0x14b4f8542d4f493b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd8 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.555006:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090bbec00/0x14b4f8542d4f493b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd8 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.555018:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090bbec00, rc 0) 00000100:00100000:3.0:1746065129.555050:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261266688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6303us (6450us total) trans 0 rc 301/301 00010000:00010000:1.0:1746065129.555051:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00000100:00100000:3.0:1746065129.555056:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11365 00010000:00010000:1.0:1746065129.555056:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555062:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555066:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe13600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065129.555069:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555075:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555083:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065129.555085:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065129.555088:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555092:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13600/0x14b4f8542d4f4949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555108:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555113:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555117:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555120:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe12600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065129.555122:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555126:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555136:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715d00) 00010000:00010000:1.0:1746065129.555137:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065129.555140:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555143:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4f4950 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.555171:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12a00/0x14b4f8542d4f4942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd1 expref: 253 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.555179:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd1 expref: 252 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.555184:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.555186:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065129.555188:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe12400, rc 0) 00000100:00100000:1.0:1746065129.555208:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29253:x1830881261266816:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 526us (647us total) trans 8589943248 rc 0/0 00000100:00100000:1.0:1746065129.555213:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9168 00000100:00100000:0.0:1746065129.570925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.571000:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261266944 00000100:00100000:3.0:1746065129.571008:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261266944 00000100:00100000:3.0:1746065129.571038:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11366 00000100:00100000:3.0:1746065129.571044:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+8:29243:x1830881261266944:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.571057:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.571070:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bddf expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.571093:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.571099:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065129.571101:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065129.571103:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->5029887] (req 4194304->5029887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.571123:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.571132:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 23 pid: 8851 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065129.571146:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259822592:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065129.571218:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065129.572901:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259822592:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065129.572920:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->5029887] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.572932:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501c00, rc 0) 00000100:00100000:3.0:1746065129.572958:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:75065d94-a855-40b7-bd64-6d6f17292955+9:29243:x1830881261266944:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1914us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.572964:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11366 00000100:00100000:0.0:1746065129.577128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.577205:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261267072 00000100:00100000:2.0:1746065129.577213:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261267072 00002000:00100000:2.0:1746065129.577249:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4599807) req@ffff88012d134700 x1830881261267072/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.577257:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134700 with x1830881261267072 ext(4194304->4599807) 00010000:00010000:2.0:1746065129.577264:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 24 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065129.577288:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 24 pid: 8851 timeout: 828 lvb_type: 0 00002000:00010000:2.0:1746065129.577294:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d134700 00000100:00100000:2.0:1746065129.577320:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1577 00000100:00100000:2.0:1746065129.577326:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881261267072:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065129.590403:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261267072:12345-192.168.202.46@tcp:4:cat.0 Request processed in 13069us (13274us total) trans 17179872956 rc 0/0 00000100:00100000:2.0:1746065129.590413:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1577 00002000:00100000:2.0:1746065129.590422:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4194304->4599807) req@ffff88012d134700 x1830881261267072/t17179872956(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.590430:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134700 with x1830881261267072 ext(4194304->4599807) 00010000:00010000:2.0:1746065129.590439:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 26 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746065129.590451:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 26 pid: 8851 timeout: 828 lvb_type: 0 00002000:00010000:2.0:1746065129.590457:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d134700 00000100:00100000:0.0:1746065129.604265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.605501:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261267200 00000100:00100000:1.0:1746065129.605509:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261267200 00010000:00010000:1.0:1746065129.605543:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 26 pid: 8851 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065129.605578:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5667 00000100:00100000:1.0:1746065129.605585:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881261267200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065129.605597:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065129.605615:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 26 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.605626:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 26 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.605644:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f231200/0x14b4f8542d4f4869 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd45 expref: 26 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065129.606924:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.606927:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.606935:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.606944:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.606974:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065129.606986:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009009ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259822720:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065129.609085:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.609844:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009009ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881259822720:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065129.609860:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065129.609890:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881261267200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4305us (5631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.609899:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5667 00000100:00100000:0.0:1746065129.615041:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.615122:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261267456 00000100:00100000:2.0:1746065129.615129:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261267456 00002000:00100000:2.0:1746065129.615162:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880093ba2300 x1830881261267456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.615171:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2300 with x1830881261267456 ext(4194304->5029887) 00002000:00010000:2.0:1746065129.615175:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba2300 00000100:00100000:2.0:1746065129.615320:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5230 00000100:00100000:2.0:1746065129.615327:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261267456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065129.622981:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261267456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7646us (7940us total) trans 0 rc 835584/835584 00000100:00100000:2.0:1746065129.622990:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5230 00002000:00100000:2.0:1746065129.623000:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880093ba2300 x1830881261267456/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.623009:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2300 with x1830881261267456 ext(4194304->5029887) 00002000:00010000:2.0:1746065129.623013:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba2300 00000100:00100000:0.0:1746065129.679238:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.680260:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261267712 00000100:00100000:2.0:1746065129.680271:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261267712 00002000:00100000:2.0:1746065129.680317:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x379:0x0] (1712128->1716223) req@ffff88008f49dc00 x1830881261267712/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.680333:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49dc00 with x1830881261267712 ext(1712128->1716223) 00002000:00010000:2.0:1746065129.680338:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49dc00 00000100:00100000:2.0:1746065129.680513:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5231 00000100:00100000:2.0:1746065129.680521:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261267712:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065129.680696:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261267712:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 175us (1471us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065129.680702:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5231 00002000:00100000:2.0:1746065129.680708:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x379:0x0] (1712128->1716223) req@ffff88008f49dc00 x1830881261267712/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.680714:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49dc00 with x1830881261267712 ext(1712128->1716223) 00002000:00010000:2.0:1746065129.680717:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49dc00 00000100:00100000:1.0:1746065129.681106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.681253:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261267840 00000100:00100000:3.0:1746065129.681257:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261267840 00000100:00100000:3.0:1746065129.681473:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11367 00000100:00100000:3.0:1746065129.681479:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:29253:x1830881261267840:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065129.681488:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.681503:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bde6 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.681523:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc0 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.681531:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd84 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.681541:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcea expref: 26 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.681547:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.681549:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.681552:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 26 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.681575:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcea expref: 26 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.682599:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcea expref: 26 pid: 4545 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065129.682611:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259822848:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065129.683322:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd84 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.683332:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd84 expref: 6 pid: 8429 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065129.683341:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259822976:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065129.684175:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc0 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.684190:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc0 expref: 8 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065129.684198:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259823104:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065129.684222:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.687487:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.687644:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261267968 00000100:00100000:2.0:1746065129.687652:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261267968 00000100:00100000:2.0:1746065129.687698:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11368 00000100:00100000:2.0:1746065129.687705:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013071b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+10:29251:x1830881261267968:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065129.687719:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.687734:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bded expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.687756:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb9 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.687763:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd7d expref: 7 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.687773:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bce3 expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.687778:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.687780:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.687783:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->1429503] (req 1048576->1429503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 11 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.687809:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bce3 expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.687843:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bce3 expref: 15 pid: 4545 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.687854:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259823232:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065129.687909:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259822848:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.687923:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd7d expref: 7 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.687930:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd7d expref: 7 pid: 8429 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065129.688181:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259822976:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065129.688189:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259823104:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065129.688210:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 26 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.688222:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500e00, rc 0) 00000100:00100000:2.0:1746065129.688236:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259823360:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065129.688260:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009009ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:29253:x1830881261267840:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6781us (7154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.688266:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11367 00010000:00010000:2.0:1746065129.688266:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb9 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.688288:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb9 expref: 11 pid: 9716 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.688295:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259823488:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.688310:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.689046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.689084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.689233:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261268096 00000100:00100000:2.0:1746065129.689237:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261268096 00010000:00010000:2.0:1746065129.689258:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcea expref: 26 pid: 4545 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.689293:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261268224 00000100:00100000:2.0:1746065129.689295:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261268224 00010000:00010000:2.0:1746065129.689305:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd84 expref: 7 pid: 8429 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.689319:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5668 00000100:00100000:2.0:1746065129.689324:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261268096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.689332:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.689349:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcea expref: 26 pid: 4545 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.689358:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcea expref: 26 pid: 4545 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.689372:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f76be00/0x14b4f8542d4f4800 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcea expref: 26 pid: 4545 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.689386:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.689405:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261268096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.689410:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5668 00000100:00100000:2.0:1746065129.689419:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5669 00000100:00100000:2.0:1746065129.689424:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261268224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.689429:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.689435:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd84 expref: 7 pid: 8429 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.689442:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd84 expref: 7 pid: 8429 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.689452:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a66ce00/0x14b4f8542d4f48bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd84 expref: 7 pid: 8429 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746065129.689459:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.689472:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261268224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 48us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.689477:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5669 00000100:00100000:1.0:1746065129.690005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.690156:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259823232:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065129.690166:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259823360:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065129.690173:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259823488:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065129.690198:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [1048576->1429503] (req 1048576->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 11 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.690208:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec20000, rc 0) 00000100:00100000:3.0:1746065129.690231:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013071b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+11:29251:x1830881261267968:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2527us (2751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.690238:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11368 00000100:00100000:0.0:1746065129.690390:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261268352 00000100:00100000:0.0:1746065129.690394:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261268352 00010000:00010000:0.0:1746065129.690408:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc0 expref: 9 pid: 8428 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065129.690426:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5670 00000100:00100000:0.0:1746065129.690431:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+9:1960:x1830881261268352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065129.690436:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065129.690445:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc0 expref: 9 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065129.690452:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc0 expref: 9 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065129.690463:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f455200/0x14b4f8542d4f47c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcc0 expref: 9 pid: 8428 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746065129.690474:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.690475:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.690481:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.690487:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.690509:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065129.690518:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259823616:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065129.690554:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.691317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.691628:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261268480 00000100:00100000:3.0:1746065129.691632:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261268480 00010000:00010000:3.0:1746065129.691648:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd7d expref: 8 pid: 8429 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065129.691673:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5671 00000100:00100000:3.0:1746065129.691678:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261268480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.691684:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065129.691694:0:10991:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:3.0:1746065129.691699:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd7d expref: 8 pid: 8429 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065129.691706:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd7d expref: 8 pid: 8429 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065129.691719:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a66cc00/0x14b4f8542d4f48b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd7d expref: 8 pid: 8429 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065129.692115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.692210:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261268864 00000100:00100000:2.0:1746065129.692214:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261268864 00002000:00100000:2.0:1746065129.692239:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1679360->1683455) req@ffff88008f49e680 x1830881261268864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.692247:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49e680 with x1830881261268864 ext(1679360->1683455) 00002000:00010000:2.0:1746065129.692252:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49e680 00000100:00100000:2.0:1746065129.692264:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5232 00000100:00100000:2.0:1746065129.692269:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881261268864:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065129.692562:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259823616:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065129.692578:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065129.692825:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.694151:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881261268864:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1876us (2030us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065129.694161:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5232 00002000:00100000:2.0:1746065129.694168:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1679360->1683455) req@ffff88008f49e680 x1830881261268864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.694176:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49e680 with x1830881261268864 ext(1679360->1683455) 00002000:00010000:2.0:1746065129.694180:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49e680 00000100:00100000:1.0:1746065129.694256:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+8:1960:x1830881261268352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3824us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.694263:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5670 00000100:00100000:3.0:1746065129.694464:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261268480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2784us (3147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.694469:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5671 00000100:00100000:0.0:1746065129.695024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.695769:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261268608 00000100:00100000:3.0:1746065129.695776:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261268608 00010000:00010000:3.0:1746065129.695801:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb9 expref: 11 pid: 9716 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065129.695838:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5672 00000100:00100000:3.0:1746065129.695844:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261268608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.695855:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065129.695871:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb9 expref: 11 pid: 9716 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065129.695880:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb9 expref: 11 pid: 9716 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065129.695897:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6003e00/0x14b4f8542d4f47dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcb9 expref: 11 pid: 9716 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065129.695908:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.695946:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261268608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 101us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.695950:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5672 00000100:00100000:0.0:1746065129.697902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.698007:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261269120 00000100:00100000:2.0:1746065129.698014:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261269120 00000100:00100000:2.0:1746065129.698044:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9169 00000100:00100000:2.0:1746065129.698050:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:29260:x1830881261269120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.698069:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.698223:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fceba00/0x14b4f8542d4f497a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bdf4 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.698318:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.698330:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.698338:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065129.698347:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:2.0:1746065129.699072:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fceba00/0x14b4f8542d4f497a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdf4 expref: 255 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.699195:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdf4 expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.699202:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065129.699204:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065129.699207:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcea000, rc 0) 00000100:00100000:2.0:1746065129.699256:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:29260:x1830881261269120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1206us (1358us total) trans 8589943249 rc 0/0 00000100:00100000:2.0:1746065129.699262:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9169 00000100:00100000:0.0:1746065129.700923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.700988:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261269248 00000100:00100000:3.0:1746065129.700994:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261269248 00000100:00100000:3.0:1746065129.701023:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11369 00000100:00100000:3.0:1746065129.701029:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261269248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.701042:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.701055:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d500600/0x14b4f8542d4f498f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bdfb expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.701096:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259823744:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065129.701155:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.702236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.702263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.702325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.702375:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261269376 00000100:00100000:0.0:1746065129.702379:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261269376 00000100:00100000:0.0:1746065129.702398:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261269504 00000100:00100000:0.0:1746065129.702400:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261269504 00000100:00100000:0.0:1746065129.702410:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261269632 00000100:00100000:0.0:1746065129.702411:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261269632 00000100:00100000:0.0:1746065129.702423:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11370 00000100:00100000:0.0:1746065129.702428:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881261269376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065129.702437:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.702446:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbce600/0x14b4f8542d4f4996 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be02 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.702458:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065129.702465:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbce600/0x14b4f8542d4f4996 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be02 expref: 19 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.702473:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbce600/0x14b4f8542d4f4996 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be02 expref: 19 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065129.702544:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11371 00000100:00100000:2.0:1746065129.702550:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261269504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.702557:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.702565:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be09 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.702575:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.702576:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.702583:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be09 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.702594:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be09 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.702600:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcebc00, rc 0) 00000100:00100000:2.0:1746065129.702628:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261269504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 79us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.702633:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11371 00000100:00100000:2.0:1746065129.702652:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11372 00000100:00100000:2.0:1746065129.702656:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:29253:x1830881261269632:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065129.702661:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.702666:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be10 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.702678:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd4c expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.702685:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 7 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.702691:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be09 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.702696:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065129.702697:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065129.702700:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2097152->2469887] (req 2097152->2469887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.702717:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be09 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.702725:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be09 expref: 27 pid: 8429 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746065129.702738:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259823872:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.702773:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 7 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.702780:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 7 pid: 21235 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065129.702787:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259824000:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.702809:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd4c expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.702837:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd4c expref: 27 pid: 8851 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746065129.702844:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259824128:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.702864:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42600 going to sleep for 11 seconds 00010000:00010000:0.0:1746065129.703064:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbce600, rc 0) 00000100:00100000:0.0:1746065129.703085:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881261269376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 657us (851us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065129.703090:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11370 00000100:00100000:0.0:1746065129.703589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.704414:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261269760 00000100:00100000:1.0:1746065129.704420:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261269760 00010000:00010000:1.0:1746065129.704440:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bce3 expref: 18 pid: 4545 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746065129.704472:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5673 00000100:00100000:1.0:1746065129.704478:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881261269760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065129.704485:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065129.704502:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bce3 expref: 18 pid: 4545 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065129.704511:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bce3 expref: 18 pid: 4545 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065129.704524:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f76a200/0x14b4f8542d4f47e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bce3 expref: 18 pid: 4545 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746065129.704587:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.704588:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.704593:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 9 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.704599:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 9 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.704609:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881259823744:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065129.704619:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 9 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.704626:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d500600/0x14b4f8542d4f498f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdfb expref: 17 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065129.704627:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259824256:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065129.704633:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d500600/0x14b4f8542d4f498f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdfb expref: 17 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.704639:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500600, rc 0) 00000100:00100000:1.0:1746065129.704677:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065129.704702:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261269248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3672us (3783us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065129.704707:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11369 00000100:00100000:2.0:1746065129.705430:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259823872:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065129.705432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.705709:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259824000:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.705717:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259824128:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.705734:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [2097152->2469887] (req 2097152->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.705748:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcebe00, rc 0) 00000100:00100000:2.0:1746065129.705769:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:29253:x1830881261269632:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3112us (3444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.705774:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11372 00000100:00100000:3.0:1746065129.705851:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261269888 00000100:00100000:3.0:1746065129.705854:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261269888 00010000:00010000:3.0:1746065129.705866:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be09 expref: 27 pid: 8429 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746065129.705880:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5674 00000100:00100000:3.0:1746065129.705884:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881261269888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.705890:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065129.705902:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be09 expref: 27 pid: 8429 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065129.705914:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be09 expref: 27 pid: 8429 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065129.705926:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcebc00/0x14b4f8542d4f499d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be09 expref: 27 pid: 8429 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746065129.705934:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.705950:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261269888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.705956:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5674 00000100:00100000:1.0:1746065129.707438:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259824256:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065129.707452:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065129.707486:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881261269760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3008us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.707493:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5673 00000100:00100000:0.0:1746065129.711050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.711648:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261270272 00000100:00100000:2.0:1746065129.711656:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261270272 00002000:00100000:2.0:1746065129.711691:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88008f49d500 x1830881261270272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.711699:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d500 with x1830881261270272 ext(0->1048575) 00002000:00010000:2.0:1746065129.711704:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49d500 00000100:00100000:2.0:1746065129.711729:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5233 00000100:00100000:2.0:1746065129.711735:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261270272:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.713453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.713481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.713502:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.713516:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261270656 00000100:00100000:0.0:1746065129.713520:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261270656 00002000:00100000:0.0:1746065129.713545:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1425408->1429503) req@ffff88008f49d180 x1830881261270656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.713552:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d180 with x1830881261270656 ext(1425408->1429503) 00002000:00010000:0.0:1746065129.713556:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49d180 00000100:00100000:0.0:1746065129.713569:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5234 00000100:00100000:0.0:1746065129.713575:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+10:1959:x1830881261270656:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065129.713615:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261270016 00000100:00100000:3.0:1746065129.713619:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261270016 00010000:00010000:3.0:1746065129.713637:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 8 pid: 21235 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065129.713656:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261270528 00000100:00100000:3.0:1746065129.713658:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261270528 00010000:00010000:3.0:1746065129.713667:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd4c expref: 28 pid: 8851 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746065129.713690:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5675 00000100:00100000:3.0:1746065129.713695:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+8:1959:x1830881261270016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065129.713702:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+10:1959:x1830881261270656:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 127us (198us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746065129.713703:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065129.713708:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5234 00002000:00100000:0.0:1746065129.713712:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1425408->1429503) req@ffff88008f49d180 x1830881261270656/t0(0) o3->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.713718:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d180 with x1830881261270656 ext(1425408->1429503) 00010000:00010000:3.0:1746065129.713721:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 8 pid: 21235 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065129.713721:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49d180 00010000:00010000:3.0:1746065129.713736:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 8 pid: 21235 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065129.713755:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d501c00/0x14b4f8542d4f4965 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bddf expref: 8 pid: 21235 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065129.713769:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.713791:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+7:1959:x1830881261270016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.713796:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5675 00000100:00100000:3.0:1746065129.713806:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5676 00000100:00100000:3.0:1746065129.713811:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881261270528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.713835:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065129.713843:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd4c expref: 28 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065129.713851:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd4c expref: 28 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065129.713861:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f230c00/0x14b4f8542d4f4870 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd4c expref: 28 pid: 8851 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746065129.713869:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.713871:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.713877:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.713889:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.713913:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.713922:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259824384:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065129.713965:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.715083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.715156:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261270912 00000100:00100000:3.0:1746065129.715161:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261270912 00000100:00100000:3.0:1746065129.715184:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3775 00000100:00100000:3.0:1746065129.715189:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+12:29251:x1830881261270912:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065129.716339:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+13:29251:x1830881261270912:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1145us (1254us total) trans 8589943250 rc 0/0 00000100:00100000:3.0:1746065129.716347:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3775 00000100:00100000:3.0:1746065129.716853:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881259824384:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065129.716867:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.716921:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881261270528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3109us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.716930:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5676 00000100:00100000:0.0:1746065129.719678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.719729:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261271168 00000100:00100000:3.0:1746065129.719736:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261271168 00002000:00100000:3.0:1746065129.719769:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2465792->2469887) req@ffff88008f49d880 x1830881261271168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.719783:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d880 with x1830881261271168 ext(2465792->2469887) 00002000:00010000:3.0:1746065129.719788:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49d880 00000100:00100000:3.0:1746065129.719838:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5235 00000100:00100000:3.0:1746065129.719845:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261271168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065129.720033:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261271168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 188us (361us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065129.720039:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5235 00002000:00100000:3.0:1746065129.720044:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x380:0x0] (2465792->2469887) req@ffff88008f49d880 x1830881261271168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.720050:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d880 with x1830881261271168 ext(2465792->2469887) 00002000:00010000:3.0:1746065129.720053:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49d880 00000100:00100000:3.0:1746065129.721972:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881261270272:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10230us (10921us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065129.721981:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5233 00002000:00100000:3.0:1746065129.721990:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37d:0x0] (0->1048575) req@ffff88008f49d500 x1830881261270272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.721998:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d500 with x1830881261270272 ext(0->1048575) 00002000:00010000:3.0:1746065129.722003:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49d500 00000100:00100000:0.0:1746065129.722670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.724008:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261271424 00000100:00100000:3.0:1746065129.724017:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261271424 00000100:00100000:3.0:1746065129.724064:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3776 00000100:00100000:3.0:1746065129.724070:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:29253:x1830881261271424:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065129.724244:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:29253:x1830881261271424:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 173us (1575us total) trans 8589943251 rc 0/0 00000100:00100000:3.0:1746065129.724251:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3776 00000100:00100000:0.0:1746065129.732420:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.732580:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261271552 00000100:00100000:2.0:1746065129.732589:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261271552 00000100:00100000:2.0:1746065129.732746:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11373 00000100:00100000:2.0:1746065129.732755:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:29260:x1830881261271552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.732770:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.732785:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be17 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.732809:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.732916:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065129.732918:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065129.732922:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 4/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.732946:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.732956:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 9 pid: 21235 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.732966:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259824512:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.733245:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065129.735057:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259824512:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.735157:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 3/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.735336:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0041200, rc 0) 00000100:00100000:2.0:1746065129.735371:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:29260:x1830881261271552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2616us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.735378:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11373 00000100:00100000:0.0:1746065129.735552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.735662:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261271680 00000100:00100000:1.0:1746065129.735669:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261271680 00002000:00100000:1.0:1746065129.735700:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1712128->2097151) req@ffff88008f49ed80 x1830881261271680/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.735708:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ed80 with x1830881261271680 ext(1712128->2097151) 00010000:00010000:1.0:1746065129.735713:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 10 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065129.735724:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 10 pid: 21235 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746065129.735730:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f49ed80 00000100:00100000:1.0:1746065129.735759:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1578 00000100:00100000:1.0:1746065129.735765:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+10:1961:x1830881261271680:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065129.741694:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261271680:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5920us (6134us total) trans 21474840172 rc 0/0 00000100:00100000:1.0:1746065129.741706:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1578 00002000:00100000:1.0:1746065129.741717:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1712128->2097151) req@ffff88008f49ed80 x1830881261271680/t21474840172(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.741725:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ed80 with x1830881261271680 ext(1712128->2097151) 00010000:00010000:1.0:1746065129.741733:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 12 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065129.741747:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 12 pid: 21235 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746065129.741753:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f49ed80 00000100:00100000:0.0:1746065129.744046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.744246:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261271808 00000100:00100000:3.0:1746065129.744254:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261271808 00010000:00010000:3.0:1746065129.744292:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 12 pid: 21235 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746065129.744437:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5677 00000100:00100000:3.0:1746065129.744444:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:1958:x1830881261271808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.744457:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065129.744473:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 12 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.744483:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 12 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.744503:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbcda00/0x14b4f8542d4f483f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1695743) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd1b expref: 12 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.744531:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.744533:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.744539:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.744546:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.744577:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.744587:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259824640:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065129.744648:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065129.746130:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259824640:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065129.746146:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.746190:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+11:1958:x1830881261271808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1745us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.746198:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5677 00000100:00100000:0.0:1746065129.749946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.750029:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272064 00000100:00100000:1.0:1746065129.750037:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272064 00002000:00100000:1.0:1746065129.750075:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008f49ce00 x1830881261272064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.750085:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ce00 with x1830881261272064 ext(1048576->2097151) 00002000:00010000:1.0:1746065129.750092:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49ce00 00000100:00100000:1.0:1746065129.750119:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5236 00000100:00100000:1.0:1746065129.750131:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261272064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065129.758581:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261272064:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8441us (8633us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065129.758593:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5236 00002000:00100000:1.0:1746065129.758606:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x379:0x0] (1048576->2097151) req@ffff88008f49ce00 x1830881261272064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065129.758616:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49ce00 with x1830881261272064 ext(1048576->2097151) 00002000:00010000:1.0:1746065129.758621:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49ce00 00000100:00100000:0.0:1746065129.763357:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.763465:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272192 00000100:00100000:2.0:1746065129.763472:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272192 00000100:00100000:2.0:1746065129.764026:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11374 00000100:00100000:2.0:1746065129.764034:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:29260:x1830881261272192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.764048:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.764064:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be1e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.764096:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 10 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.764102:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065129.764104:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065129.764107:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.764129:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 10 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.764138:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 10 pid: 8427 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.764148:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259824768:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.764217:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065129.765533:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259824768:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.765554:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.765566:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0040200, rc 0) 00000100:00100000:2.0:1746065129.765594:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:29260:x1830881261272192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1560us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.765600:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11374 00000100:00100000:0.0:1746065129.766333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.766729:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272320 00000100:00100000:2.0:1746065129.766735:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272320 00002000:00100000:2.0:1746065129.766763:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1429503) req@ffff88008f49f800 x1830881261272320/t0(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.766771:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49f800 with x1830881261272320 ext(1048576->1429503) 00010000:00010000:2.0:1746065129.766777:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 11 pid: 8427 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.766788:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 11 pid: 8427 timeout: 829 lvb_type: 0 00002000:00010000:2.0:1746065129.766794:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f49f800 00000100:00100000:2.0:1746065129.767002:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1579 00000100:00100000:2.0:1746065129.767009:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+11:1961:x1830881261272320:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065129.772291:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261272320:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5264us (5941us total) trans 21474840173 rc 0/0 00000100:00100000:2.0:1746065129.772300:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1579 00002000:00100000:2.0:1746065129.772309:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->1429503) req@ffff88008f49f800 x1830881261272320/t21474840173(0) o4->75065d94-a855-40b7-bd64-6d6f17292955@192.168.202.46@tcp:45/0 lens 488/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.772317:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49f800 with x1830881261272320 ext(1048576->1429503) 00010000:00010000:2.0:1746065129.772325:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 13 pid: 8427 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.772338:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 13 pid: 8427 timeout: 829 lvb_type: 0 00002000:00010000:2.0:1746065129.772348:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f49f800 00000100:00100000:0.0:1746065129.774949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.775023:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272448 00000100:00100000:3.0:1746065129.775030:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272448 00010000:00010000:3.0:1746065129.775056:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 13 pid: 8427 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746065129.775082:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5678 00000100:00100000:3.0:1746065129.775087:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+13:1960:x1830881261272448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.775098:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065129.775110:0:7079:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065129 -> 1746065130 00002000:00010000:3.0:1746065129.775112:0:7079:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065129 -> 1746065130 00010000:00010000:3.0:1746065129.775115:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 13 pid: 8427 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.775123:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 13 pid: 8427 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.775140:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec20000/0x14b4f8542d4f4973 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bded expref: 13 pid: 8427 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.775158:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.775160:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.775165:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.775170:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.775192:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.775200:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259824896:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065129.775250:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065129.776257:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881259824896:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065129.776269:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.776314:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881261272448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1225us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.776321:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5678 00000100:00100000:0.0:1746065129.779548:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.779662:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272704 00000100:00100000:2.0:1746065129.779670:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272704 00002000:00100000:2.0:1746065129.779709:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88008f49c700 x1830881261272704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.779718:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49c700 with x1830881261272704 ext(1048576->2097151) 00002000:00010000:2.0:1746065129.779723:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49c700 00000100:00100000:2.0:1746065129.779785:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5237 00000100:00100000:2.0:1746065129.779793:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881261272704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065129.780392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.780453:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272960 00000100:00100000:3.0:1746065129.780458:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272960 00002000:00100000:3.0:1746065129.780477:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1679359) req@ffff88008f49c380 x1830881261272960/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.780491:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49c380 with x1830881261272960 ext(1048576->1679359) 00002000:00010000:3.0:1746065129.780495:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49c380 00000100:00100000:3.0:1746065129.780700:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5238 00000100:00100000:3.0:1746065129.780708:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881261272960:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065129.787978:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881261272960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7264us (7580us total) trans 0 rc 630784/630784 00000100:00100000:3.0:1746065129.787988:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5238 00002000:00100000:3.0:1746065129.787998:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1048576->1679359) req@ffff88008f49c380 x1830881261272960/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 630784/630784 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.788017:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49c380 with x1830881261272960 ext(1048576->1679359) 00002000:00010000:3.0:1746065129.788023:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49c380 00000100:00100000:2.0:1746065129.792383:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881261272704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12583us (12835us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065129.792393:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5237 00002000:00100000:2.0:1746065129.792402:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37a:0x0] (1048576->2097151) req@ffff88008f49c700 x1830881261272704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.792409:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49c700 with x1830881261272704 ext(1048576->2097151) 00002000:00010000:2.0:1746065129.792414:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f49c700 00000100:00100000:0.0:1746065129.807450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.807500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.807695:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261273216 00000100:00100000:3.0:1746065129.807702:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261273216 00002000:00100000:3.0:1746065129.807744:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2469888->3145727) req@ffff880095353100 x1830881261273216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.807752:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353100 with x1830881261273216 ext(2469888->3145727) 00002000:00010000:3.0:1746065129.807757:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353100 00000100:00100000:3.0:1746065129.807769:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261273472 00000100:00100000:3.0:1746065129.807771:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261273472 00002000:00100000:3.0:1746065129.807781:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880095352a00 x1830881261273472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.807788:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352a00 with x1830881261273472 ext(2097152->3145727) 00002000:00010000:3.0:1746065129.807791:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095352a00 00000100:00100000:3.0:1746065129.807840:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5239 00000100:00100000:3.0:1746065129.807848:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881261273216:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065129.809630:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5240 00000100:00100000:2.0:1746065129.809641:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881261273472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065129.833184:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881261273472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23538us (25675us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065129.833195:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5240 00002000:00100000:2.0:1746065129.833205:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x37b:0x0] (2097152->3145727) req@ffff880095352a00 x1830881261273472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.833214:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352a00 with x1830881261273472 ext(2097152->3145727) 00002000:00010000:2.0:1746065129.833219:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095352a00 00000100:00100000:3.0:1746065129.833555:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881261273216:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25706us (26112us total) trans 0 rc 675840/675840 00000100:00100000:3.0:1746065129.833562:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5239 00002000:00100000:3.0:1746065129.833566:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2469888->3145727) req@ffff880095353100 x1830881261273216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.833574:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353100 with x1830881261273216 ext(2469888->3145727) 00002000:00010000:3.0:1746065129.833577:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353100 00010000:00010000:2.0:1746065129.837979:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065129.840767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.840855:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261273600 00000100:00100000:2.0:1746065129.840863:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261273600 00000100:00100000:2.0:1746065129.840911:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11375 00000100:00100000:2.0:1746065129.840919:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:29260:x1830881261273600:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.840934:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.840951:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be25 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.840971:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.840973:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.840979:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be25 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.840991:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be25 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.840999:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a505de00, rc 0) 00000100:00100000:2.0:1746065129.841034:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:29260:x1830881261273600:12345-192.168.202.46@tcp:101:cat.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.841040:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11375 00000100:00100000:0.0:1746065129.843397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.843454:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261273856 00000100:00100000:3.0:1746065129.843459:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261273856 00002000:00100000:3.0:1746065129.843488:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880095351880 x1830881261273856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.843497:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351880 with x1830881261273856 ext(3145728->4194303) 00002000:00010000:3.0:1746065129.843501:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095351880 00000100:00100000:3.0:1746065129.843527:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5241 00000100:00100000:3.0:1746065129.843533:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881261273856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065129.850343:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881261273856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6800us (7065us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065129.850353:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5241 00002000:00100000:3.0:1746065129.850362:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (3145728->4194303) req@ffff880095351880 x1830881261273856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.850371:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351880 with x1830881261273856 ext(3145728->4194303) 00002000:00010000:3.0:1746065129.850376:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095351880 00000100:00100000:0.0:1746065129.861507:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.861651:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261273984 00000100:00100000:2.0:1746065129.861658:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261273984 00000100:00100000:2.0:1746065129.861708:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11376 00000100:00100000:2.0:1746065129.861716:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261273984:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.861730:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.861744:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4f49c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be2c expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.861771:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4f49c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be2c expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.861780:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4f49c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be2c expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.861792:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b1800, rc 0) 00000100:00100000:2.0:1746065129.861865:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261273984:12345-192.168.202.46@tcp:101:cat.0 Request processed in 149us (365us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065129.861871:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11376 00000100:00100000:0.0:1746065129.865708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.865767:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274240 00000100:00100000:3.0:1746065129.865773:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274240 00002000:00100000:3.0:1746065129.865806:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880095352d80 x1830881261274240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.865832:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352d80 with x1830881261274240 ext(4194304->5029887) 00002000:00010000:3.0:1746065129.865836:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352d80 00000100:00100000:3.0:1746065129.865863:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5242 00000100:00100000:3.0:1746065129.865871:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261274240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065129.876124:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261274240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10246us (10414us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065129.876134:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5242 00002000:00100000:3.0:1746065129.876142:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (4194304->5029887) req@ffff880095352d80 x1830881261274240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/440 e 0 to 0 dl 1746065140 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065129.876150:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352d80 with x1830881261274240 ext(4194304->5029887) 00002000:00010000:3.0:1746065129.876155:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352d80 00000100:00100000:0.0:1746065129.882105:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.882193:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274368 00000100:00100000:3.0:1746065129.882200:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274368 00000100:00100000:3.0:1746065129.882250:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11377 00000100:00100000:3.0:1746065129.882257:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261274368:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065129.882303:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.882318:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d500000/0x14b4f8542d4f49c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be33 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.882342:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d500000/0x14b4f8542d4f49c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be33 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.882352:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d500000/0x14b4f8542d4f49c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be33 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.882376:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500000, rc 0) 00000100:00100000:3.0:1746065129.882422:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261274368:12345-192.168.202.46@tcp:101:cat.0 Request processed in 165us (324us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065129.882429:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11377 00000100:00100000:0.0:1746065129.885890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.886072:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274496 00000100:00100000:2.0:1746065129.886080:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274496 00000100:00100000:2.0:1746065129.886113:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11378 00000100:00100000:2.0:1746065129.886119:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881261274496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065129.886133:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.886145:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0400/0x14b4f8542d4f49ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.886170:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0400/0x14b4f8542d4f49ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be3a expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.886179:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0400/0x14b4f8542d4f49ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be3a expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.886191:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b0400, rc 0) 00000100:00100000:2.0:1746065129.886225:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881261274496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 106us (342us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065129.886230:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11378 00000100:00100000:0.0:1746065129.903047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.903130:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274624 00000100:00100000:2.0:1746065129.903137:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274624 00000100:00100000:2.0:1746065129.903182:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9170 00000100:00100000:2.0:1746065129.903190:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29265:x1830881261274624:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065129.903211:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065129.903227:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1000/0x14b4f8542d4f49d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be41 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.903285:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903296:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903304:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903315:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903319:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903324:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903412:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903419:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903424:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065129.903446:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065129.903449:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065129.903459:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903465:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903470:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903474:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903478:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903483:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b0a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065129.903486:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903491:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903498:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065129.903501:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065129.903504:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903508:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0a00/0x14b4f8542d4f49dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903531:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903535:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903539:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903543:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b1600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065129.903545:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903549:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903554:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880133205800) 00010000:00010000:2.0:1746065129.903556:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065129.903558:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903563:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1600/0x14b4f8542d4f49e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065129.903586:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b1000/0x14b4f8542d4f49d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be41 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.903600:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be41 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.903605:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065129.903607:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065129.903609:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b0000, rc 0) 00000100:00100000:2.0:1746065129.903647:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261274624:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 458us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.903652:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9170 00000100:00100000:0.0:1746065129.906163:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.908276:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274752 00000100:00100000:3.0:1746065129.908286:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274752 00000100:00100000:3.0:1746065129.908339:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11379 00000100:00100000:3.0:1746065129.908346:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261274752:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065129.908360:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.908374:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be48 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.908395:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.908397:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.908404:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be48 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.908417:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be48 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.908428:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500a00, rc 0) 00000100:00100000:3.0:1746065129.909890:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261274752:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1540us (3728us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.909901:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11379 00000100:00100000:1.0:1746065129.910624:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.910648:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.910679:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.910728:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261275008 00000100:00100000:3.0:1746065129.910733:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261275008 00000100:00100000:3.0:1746065129.910753:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274880 00000100:00100000:3.0:1746065129.910755:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274880 00000100:00100000:3.0:1746065129.910763:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261275136 00000100:00100000:3.0:1746065129.910764:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261275136 00000100:00100000:3.0:1746065129.910775:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11380 00000100:00100000:3.0:1746065129.910780:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261275008:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065129.910793:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.910805:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f49f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be56 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.910873:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259825024:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065129.910934:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065129.910949:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11381 00000100:00100000:3.0:1746065129.910955:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261274880:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065129.910961:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.910970:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be4f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.910980:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.910982:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.910988:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be4f expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.910999:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be4f expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.911007:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501400, rc 0) 00000100:00100000:3.0:1746065129.911022:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261274880:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 67us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.911027:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11381 00000100:00100000:3.0:1746065129.911035:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11382 00000100:00100000:3.0:1746065129.911039:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261275136:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065129.911044:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065129.911049:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d501800/0x14b4f8542d4f4a06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be5d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.911062:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d501800/0x14b4f8542d4f4a06 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be5d expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.911069:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d501800/0x14b4f8542d4f4a06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be5d expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.911079:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501800, rc 0) 00000100:00100000:3.0:1746065129.911090:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261275136:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 50us (411us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065129.911094:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11382 00002000:00010000:3.0:1746065129.913131:0:8427:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime: 1746065129 -> 1746065130 00002000:00010000:3.0:1746065129.913136:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime: 1746065129 -> 1746065130 00002000:00010000:3.0:1746065129.913138:0:8427:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime: 1746065129 -> 1746065130 00000100:00100000:3.0:1746065129.913155:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881259825024:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065129.913175:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f49f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be56 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.913186:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d501600/0x14b4f8542d4f49f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be56 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065129.913194:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501600, rc 0) 00000100:00100000:3.0:1746065129.916378:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1961:x1830881261275008:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5588us (5747us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065129.916388:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11380 00000100:00100000:0.0:1746065129.927301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.927377:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261275392 00000100:00100000:1.0:1746065129.927385:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261275392 00000100:00100000:1.0:1746065129.927419:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9171 00000100:00100000:1.0:1746065129.927426:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261275392:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065129.927442:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065129.927456:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfe00/0x14b4f8542d4f4a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be64 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.927527:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.927539:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd1 expref: 254 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.927550:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be41 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.927555:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.927585:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be41 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.927597:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be41 expref: 10 pid: 14643 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065129.927609:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259825152:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065129.927676:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd1 expref: 254 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.927683:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd1 expref: 254 pid: 14645 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065129.927690:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259825280:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065129.927704:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.932058:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259825152:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065129.932071:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259825280:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065129.932090:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065129.933047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.933125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.933190:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261275648 00000100:00100000:1.0:1746065129.933196:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261275648 00010000:00010000:1.0:1746065129.933225:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd1 expref: 255 pid: 14645 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065129.933258:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261275520 00000100:00100000:1.0:1746065129.933261:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261275520 00010000:00010000:1.0:1746065129.933285:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be41 expref: 11 pid: 14643 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065129.933300:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5679 00000100:00100000:1.0:1746065129.933307:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1960:x1830881261275648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065129.933318:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065129.933323:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd1 expref: 255 pid: 14645 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065129.933331:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd1 expref: 255 pid: 14645 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065129.933349:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12400/0x14b4f8542d4f4957 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdd1 expref: 255 pid: 14645 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065129.933364:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.933368:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.933376:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.933384:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065129.933418:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1960:x1830881261275648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.933424:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5679 00000100:00100000:1.0:1746065129.933444:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5680 00000100:00100000:1.0:1746065129.933449:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881261275520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065129.933455:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065129.933459:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be41 expref: 11 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065129.933466:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be41 expref: 11 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065129.933476:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b0000/0x14b4f8542d4f49ea lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be41 expref: 11 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065129.933485:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.933488:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.933494:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.933499:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.933514:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065129.933527:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881261275520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.933533:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5680 00010000:00010000:1.0:1746065129.933547:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.933553:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065129.933566:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065129.933666:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfe00/0x14b4f8542d4f4a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be64 expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.933676:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be64 expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.933682:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.933684:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065129.933686:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffbe800, rc 0) 00000100:00100000:1.0:1746065129.933707:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261275392:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6281us (6414us total) trans 8589943252 rc 0/0 00000100:00100000:1.0:1746065129.933712:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9171 00000100:00100000:0.0:1746065129.940114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.940189:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261275776 00000100:00100000:1.0:1746065129.940197:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261275776 00000100:00100000:1.0:1746065129.940238:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9172 00000100:00100000:1.0:1746065129.940244:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261275776:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065129.940263:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065129.940285:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbec00/0x14b4f8542d4f4a22 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be6b expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.940351:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.940362:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be64 expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.940369:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.940392:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be64 expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.940401:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be64 expref: 11 pid: 14645 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065129.940411:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259825408:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065129.940482:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.941906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.941963:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261275904 00000100:00100000:3.0:1746065129.941968:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261275904 00010000:00010000:3.0:1746065129.941988:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be64 expref: 12 pid: 14645 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746065129.943005:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5681 00000100:00100000:3.0:1746065129.943014:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261275904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.943027:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065129.943033:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be64 expref: 12 pid: 14645 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.943045:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be64 expref: 12 pid: 14645 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.943063:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065129.943067:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.943079:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.943085:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065129.943098:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.943131:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261275904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 119us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.943137:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5681 00010000:00010000:1.0:1746065129.943349:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe800/0x14b4f8542d4f4a14 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be64 expref: 11 pid: 14645 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065129.943364:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881259825408:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065129.943378:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.943385:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.943389:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065129.943424:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:1.0:1746065129.943429:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065129.943441:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.943463:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbec00/0x14b4f8542d4f4a22 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be6b expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.943474:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be6b expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.943479:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.943481:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065129.943483:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffbfa00, rc 0) 00000100:00100000:1.0:1746065129.947379:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261275776:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 7126us (7263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065129.947390:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9172 00000100:00100000:0.0:1746065129.949495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.949532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.949592:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276032 00000100:00100000:1.0:1746065129.949599:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276032 00000100:00100000:1.0:1746065129.949626:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276160 00000100:00100000:1.0:1746065129.949627:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276160 00000100:00100000:1.0:1746065129.950615:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11383 00000100:00100000:1.0:1746065129.950624:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261276032:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065129.950639:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065129.950653:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ffbea00/0x14b4f8542d4f4a30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be72 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065129.950695:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259825536:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065129.950755:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.950889:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11384 00000100:00100000:0.0:1746065129.950896:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261276160:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065129.950902:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065129.950909:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbce800/0x14b4f8542d4f4a37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be79 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065129.950924:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbce800/0x14b4f8542d4f4a37 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be79 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.950933:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbce800/0x14b4f8542d4f4a37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be79 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065129.950945:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbce800, rc 0) 00000100:00100000:0.0:1746065129.950963:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261276160:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 68us (1430us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065129.950968:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11384 00000100:00100000:1.0:1746065129.954121:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881259825536:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065129.954145:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ffbea00/0x14b4f8542d4f4a30 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be72 expref: 7 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.954157:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ffbea00/0x14b4f8542d4f4a30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be72 expref: 7 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.954168:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffbea00, rc 0) 00000100:00100000:1.0:1746065129.954197:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261276032:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3575us (4706us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065129.954204:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11383 00000100:00100000:2.0:1746065129.961055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065129.962523:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276416 00000100:00100000:1.0:1746065129.962532:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276416 00000100:00100000:1.0:1746065129.962575:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9173 00000100:00100000:1.0:1746065129.962581:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261276416:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065129.962598:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065129.962612:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbf400/0x14b4f8542d4f4a3e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be80 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.962684:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfe00/0x14b4f8542d4f4a45 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.962695:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfe00/0x14b4f8542d4f4a45 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065129.962705:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfe00/0x14b4f8542d4f4a45 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065129.962717:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065129.962803:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbf400/0x14b4f8542d4f4a3e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be80 expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.962850:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfe00/0x14b4f8542d4f4a45 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be80 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.962868:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065129.962870:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065129.962873:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffbfe00, rc 0) 00000100:00100000:1.0:1746065129.962916:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29265:x1830881261276416:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 334us (1868us total) trans 8589943253 rc 0/0 00000100:00100000:1.0:1746065129.962922:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9173 00000100:00100000:0.0:1746065129.967628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.970170:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276672 00000100:00100000:1.0:1746065129.970172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.970178:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276672 00000100:00100000:1.0:1746065129.970201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.970441:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276928 00000100:00100000:2.0:1746065129.970444:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276928 00000100:00100000:1.0:1746065129.970447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.970465:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261277184 00000100:00100000:2.0:1746065129.970467:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261277184 00000100:00100000:1.0:1746065129.970467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.970477:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276544 00000100:00100000:2.0:1746065129.970479:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276544 00000100:00100000:1.0:1746065129.970480:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276800 00000100:00100000:1.0:1746065129.970482:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276800 00000100:00100000:2.0:1746065129.970491:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11385 00000100:00100000:2.0:1746065129.970498:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261276672:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065129.970535:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.970552:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.970559:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be48 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.970566:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.970567:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.970570:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.970594:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be48 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.970604:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be48 expref: 11 pid: 8427 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065129.970615:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259825664:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.970679:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.970687:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 16 pid: 8429 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.970693:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259825792:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.970710:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.970793:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11386 00000100:00100000:1.0:1746065129.970799:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261276928:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065129.970829:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.970838:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.970847:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065129.970848:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065129.970850:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.970866:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.970872:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 25 pid: 21235 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065129.970880:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259825920:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065129.970897:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.970909:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11387 00000100:00100000:1.0:1746065129.970914:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261277184:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065129.970925:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.970933:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.970939:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd92 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.970945:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd5a expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.970950:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.970951:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065129.970953:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.970963:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd5a expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.970969:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd5a expref: 16 pid: 25185 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065129.970975:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259826048:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065129.970992:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd92 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065129.970998:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd92 expref: 11 pid: 9716 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065129.971004:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259826176:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065129.971018:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065129.971023:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 11 pid: 8851 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065129.971034:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259826304:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065129.971044:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065129.971070:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.971199:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11388 00000100:00100000:2.0:1746065129.971206:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261276544:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065129.971222:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971236:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcab expref: 6 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.971243:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd6f expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.971249:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcd5 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.971254:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.971256:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.971258:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971286:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcd5 expref: 25 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.971294:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcd5 expref: 25 pid: 8428 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065129.971302:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259826432:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.971338:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd6f expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.971346:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd6f expref: 7 pid: 8427 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065129.971358:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259826560:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.971380:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcab expref: 6 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.971387:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcab expref: 6 pid: 9716 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065129.971393:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259826688:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.971406:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065129.971417:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261277056 00000100:00100000:2.0:1746065129.971420:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261277056 00000100:00100000:2.0:1746065129.971435:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11389 00000100:00100000:2.0:1746065129.971439:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261276800:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065129.971453:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971461:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971468:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be4f expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.971473:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.971474:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.971476:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 5/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971489:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be4f expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065129.971497:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be4f expref: 11 pid: 8851 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065129.971505:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259826816:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.971527:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971534:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 16 pid: 8429 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.971542:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259826944:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.971555:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065129.971623:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11390 00000100:00100000:2.0:1746065129.971629:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261277056:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065129.971643:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971651:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971658:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd99 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971666:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be25 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971671:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746065129.971672:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746065129.971674:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971687:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be25 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971694:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be25 expref: 25 pid: 8429 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.971702:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259827072:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.971726:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd99 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.971732:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd99 expref: 6 pid: 8429 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.971739:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259827200:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.972437:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.972450:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 25 pid: 8429 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.972456:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259827328:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.972475:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065129.978599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.978630:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.978756:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259825664:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.978765:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259825792:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.978784:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065129.978874:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259826048:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065129.978881:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259826176:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065129.978888:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881259826304:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065129.978902:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.978988:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261277440 00000100:00100000:2.0:1746065129.978994:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261277440 00002000:00100000:2.0:1746065129.979029:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x37f:0x0] (1679360->2097151) req@ffff88012e8b4000 x1830881261277440/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065129.979036:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4000 with x1830881261277440 ext(1679360->2097151) 00010000:00010000:2.0:1746065129.979043:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 26 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.979052:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 26 pid: 21235 timeout: 829 lvb_type: 0 00002000:00010000:2.0:1746065129.979057:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e8b4000 00000100:00100000:2.0:1746065129.979079:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1580 00000100:00100000:2.0:1746065129.979086:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881261277440:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065129.979327:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881259825920:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065129.979337:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.979398:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261277312 00000100:00100000:3.0:1746065129.979402:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261277312 00010000:00010000:3.0:1746065129.979672:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be48 expref: 12 pid: 8427 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746065129.979689:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5682 00000100:00100000:3.0:1746065129.979693:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1958:x1830881261277312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.979700:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065129.979713:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be48 expref: 12 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746065129.979721:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be48 expref: 12 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746065129.979737:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d500a00/0x14b4f8542d4f49f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be48 expref: 12 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746065129.979756:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.979983:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1958:x1830881261277312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 288us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.979989:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5682 00000100:00100000:3.0:1746065129.980488:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259826432:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065129.983714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.984014:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259826560:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065129.984024:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881259826688:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065129.984046:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065129.984067:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261278080 00000100:00100000:3.0:1746065129.984071:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261278080 00010000:00010000:3.0:1746065129.984094:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcab expref: 7 pid: 9716 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746065129.984127:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5683 00000100:00100000:3.0:1746065129.984133:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+7:1959:x1830881261278080:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.984143:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065129.984158:0:7079:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2033 -> 2049 00010000:00010000:3.0:1746065129.984163:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcab expref: 7 pid: 9716 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746065129.984171:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcab expref: 7 pid: 9716 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746065129.984189:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6003200/0x14b4f8542d4f47ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcab expref: 7 pid: 9716 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746065129.984200:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.984227:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+6:1959:x1830881261278080:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 94us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.984232:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5683 00000100:00100000:2.0:1746065129.987868:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065129.989625:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881261277440:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10531us (10986us total) trans 17179872957 rc 0/0 00000100:00100000:0.0:1746065129.989635:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1580 00002000:00100000:0.0:1746065129.989645:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x37f:0x0] (1679360->2097151) req@ffff88012e8b4000 x1830881261277440/t17179872957(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.989655:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4000 with x1830881261277440 ext(1679360->2097151) 00010000:00010000:0.0:1746065129.989664:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 28 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065129.989676:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 28 pid: 21235 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065129.989682:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e8b4000 00000100:00100000:2.0:1746065129.989910:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259826816:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.989930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.989943:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261277952 00000100:00100000:2.0:1746065129.989947:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261277952 00010000:00010000:2.0:1746065129.989967:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd6f expref: 9 pid: 8427 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065129.989982:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261278208 00000100:00100000:2.0:1746065129.989984:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261278208 00010000:00010000:2.0:1746065129.989991:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be4f expref: 11 pid: 8851 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065129.990004:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5684 00000100:00100000:2.0:1746065129.990009:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1959:x1830881261277952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.990018:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.990031:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd6f expref: 9 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990038:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd6f expref: 9 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990055:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f4ea00/0x14b4f8542d4f48a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd6f expref: 9 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990067:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.990084:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1959:x1830881261277952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 75us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.990088:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5684 00000100:00100000:2.0:1746065129.990120:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5685 00000100:00100000:2.0:1746065129.990124:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1959:x1830881261278208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.990129:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.990139:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be4f expref: 11 pid: 8851 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990147:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be4f expref: 11 pid: 8851 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990158:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d501400/0x14b4f8542d4f49ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be4f expref: 11 pid: 8851 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990166:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.990176:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1959:x1830881261278208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.990180:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5685 00000100:00100000:2.0:1746065129.990215:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881259826944:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.990230:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.990262:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.990284:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261278464 00000100:00100000:2.0:1746065129.990286:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261278464 00010000:00010000:2.0:1746065129.990297:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd5a expref: 17 pid: 25185 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.990310:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5686 00000100:00100000:2.0:1746065129.990314:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881261278464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.990320:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.990329:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd5a expref: 17 pid: 25185 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.990335:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd5a expref: 17 pid: 25185 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.990345:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c200/0x14b4f8542d4f4893 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd5a expref: 17 pid: 25185 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.990353:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.990366:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881261278464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.990371:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5686 00000100:00100000:2.0:1746065129.990397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.990407:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261277696 00000100:00100000:2.0:1746065129.990410:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261277696 00010000:00010000:2.0:1746065129.990418:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd92 expref: 10 pid: 9716 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065129.990431:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5687 00000100:00100000:2.0:1746065129.990435:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261277696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.990440:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.990445:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd92 expref: 10 pid: 9716 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990452:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd92 expref: 10 pid: 9716 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990461:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a66c800/0x14b4f8542d4f48cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd92 expref: 10 pid: 9716 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990468:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.990481:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261277696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.990485:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5687 00000100:00100000:2.0:1746065129.990511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.990521:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261278336 00000100:00100000:2.0:1746065129.990523:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261278336 00010000:00010000:2.0:1746065129.990531:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcd5 expref: 28 pid: 8428 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065129.990541:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5688 00000100:00100000:2.0:1746065129.990545:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261278336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.990550:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.990556:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcd5 expref: 28 pid: 8428 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990568:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcd5 expref: 28 pid: 8428 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990577:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f47eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcd5 expref: 28 pid: 8428 timeout: 829 lvb_type: 1 00010000:00010000:2.0:1746065129.990585:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.990587:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.990590:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990596:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990611:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.990623:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881261278336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.990628:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5688 00000100:00100000:2.0:1746065129.990656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.990666:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261277568 00000100:00100000:2.0:1746065129.990668:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261277568 00010000:00010000:2.0:1746065129.990675:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 16 pid: 8429 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.990687:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5689 00000100:00100000:2.0:1746065129.990690:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261277568:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.990698:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.990706:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 16 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.990712:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 16 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.990721:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0041200/0x14b4f8542d4f49ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be17 expref: 16 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.990729:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.990730:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.990733:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990739:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990751:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.990765:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881261277568:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.990770:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5689 00010000:00010000:2.0:1746065129.990785:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990792:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990811:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990837:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990844:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990849:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b1400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065129.990852:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990859:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990867:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.990872:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1400/0x14b4f8542d4f4a53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.990902:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261276672:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 20405us (23281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.990908:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11385 00000100:00100000:2.0:1746065129.990945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.990957:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261277824 00000100:00100000:2.0:1746065129.990959:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261277824 00010000:00010000:2.0:1746065129.990968:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 12 pid: 8851 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.990982:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5690 00000100:00100000:2.0:1746065129.990986:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+12:1960:x1830881261277824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.990992:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.990999:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 12 pid: 8851 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.991005:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 12 pid: 8851 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.991015:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4f4862 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd3e expref: 12 pid: 8851 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.991022:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.991023:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.991025:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991031:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991044:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.991056:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261277824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.991064:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5690 00000100:00100000:2.0:1746065129.991095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.991106:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261278592 00000100:00100000:2.0:1746065129.991108:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261278592 00010000:00010000:2.0:1746065129.991116:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 15 pid: 8429 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.991129:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5691 00000100:00100000:2.0:1746065129.991133:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881261278592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.991138:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.991144:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 15 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.991151:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 15 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.991160:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040200/0x14b4f8542d4f49b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be1e expref: 15 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.991167:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.991169:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065129.991171:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991175:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991189:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.991201:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1958:x1830881261278592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.991205:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5691 00010000:00010000:2.0:1746065129.991225:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991231:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991242:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991248:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991253:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991258:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800953d3600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065129.991261:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991266:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991288:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991292:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4f4a6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.991317:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261276800:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 19877us (20849us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.991322:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11389 00000100:00100000:2.0:1746065129.991377:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259827200:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.991410:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259827072:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065129.991444:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881259827328:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065129.991456:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.991506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.991536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065129.991546:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261278848 00000100:00100000:2.0:1746065129.991548:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261278848 00010000:00010000:2.0:1746065129.991557:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd99 expref: 6 pid: 8429 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065129.991569:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5692 00000100:00100000:2.0:1746065129.991574:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+6:1960:x1830881261278848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065129.991582:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065129.991591:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd99 expref: 6 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.991598:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd99 expref: 6 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.991608:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a66dc00/0x14b4f8542d4f48d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd99 expref: 6 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065129.991617:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065129.991632:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75065d94-a855-40b7-bd64-6d6f17292955+5:1960:x1830881261278848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 57us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.991637:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5692 00010000:00010000:2.0:1746065129.991676:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991683:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991695:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991700:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991706:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991712:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b1600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065129.991714:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991719:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991727:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991732:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1600/0x14b4f8542d4f4a68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.991761:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1960:x1830881261276544:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 20556us (21313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.991766:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11388 00010000:00010000:2.0:1746065129.991842:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991849:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991861:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991867:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991872:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991877:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ffbe200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065129.991879:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991884:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991892:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065129.991897:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4f4a61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065129.991927:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261277184:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 21012us (21724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065129.991932:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11387 00000100:00100000:0.0:1746065129.995446:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261278720 00000100:00100000:0.0:1746065129.995457:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261278720 00002000:00100000:0.0:1746065129.995497:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2469887) req@ffff880094ff6680 x1830881261278720/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/0 e 0 to 0 dl 1746065140 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065129.995507:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6680 with x1830881261278720 ext(2097152->2469887) 00010000:00010000:0.0:1746065129.995515:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065129.995527:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065129.995534:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094ff6680 00000100:00100000:3.0:1746065129.998018:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 1581 00000100:00100000:3.0:1746065129.998029:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881261278720:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065129.998427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.998511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065129.998530:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261278976 00000100:00100000:3.0:1746065129.998535:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261278976 00010000:00010000:3.0:1746065129.998553:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be25 expref: 29 pid: 8429 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746065129.998569:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261279104 00000100:00100000:3.0:1746065129.998571:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261279104 00010000:00010000:3.0:1746065129.998576:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 30 pid: 21235 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746065129.998586:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5693 00000100:00100000:3.0:1746065129.998590:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881261278976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.998597:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065129.998608:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be25 expref: 30 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.998617:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be25 expref: 30 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.998632:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a505de00/0x14b4f8542d4f49b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be25 expref: 30 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.998644:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.998661:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261278976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.998666:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5693 00000100:00100000:3.0:1746065129.998677:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5694 00000100:00100000:3.0:1746065129.998681:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881261279104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065129.998686:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065129.998693:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 28 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.998700:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 28 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.998715:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d500e00/0x14b4f8542d4f496c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bde6 expref: 28 pid: 21235 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065129.998723:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.998725:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065129.998728:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.998737:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.998755:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065129.998768:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881261279104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065129.998773:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5694 00010000:00010000:3.0:1746065129.998848:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065129.998855:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.001973:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.001988:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.001994:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.002000:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ffbe000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065130.002003:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.002014:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.002030:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.002034:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ffbe000/0x14b4f8542d4f4a5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065130.002115:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:1960:x1830881261276928:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 31312us (31946us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065130.002122:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11386 00000100:00100000:3.0:1746065130.004792:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881261278720:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6760us (13280us total) trans 17179872958 rc 0/0 00000100:00100000:3.0:1746065130.004802:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 1581 00002000:00100000:3.0:1746065130.004812:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x380:0x0] (2097152->2469887) req@ffff880094ff6680 x1830881261278720/t17179872958(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:45/0 lens 488/448 e 0 to 0 dl 1746065140 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065130.004836:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6680 with x1830881261278720 ext(2097152->2469887) 00010000:00010000:3.0:1746065130.004844:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746065130.004857:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 829 lvb_type: 0 00002000:00010000:3.0:1746065130.004864:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094ff6680 00000100:00100000:0.0:1746065130.008281:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.008370:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261279232 00000100:00100000:1.0:1746065130.008377:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261279232 00010000:00010000:1.0:1746065130.008422:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 829 lvb_type: 0 00000100:00080000:3.0:1746065130.008443:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065130.008493:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5695 00000100:00100000:1.0:1746065130.008501:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881261279232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065130.008512:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065130.008530:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065130.008538:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065130.008553:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcebe00/0x14b4f8542d4f49a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2469887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be10 expref: 27 pid: 8429 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065130.008576:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.008581:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.008585:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.008591:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.008618:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065130.008635:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.008642:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.008658:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881261279232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 158us (393us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065130.008659:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.008663:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5695 00010000:00010000:2.0:1746065130.008666:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.008672:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.008678:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5a200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065130.008681:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.008688:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.008702:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.008707:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5a200/0x14b4f8542d4f4a76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065130.008744:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+5:1960:x1830881261277056:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 37115us (37673us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.008750:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11390 00000100:00100000:0.0:1746065130.011545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.011606:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261279488 00000100:00100000:2.0:1746065130.011612:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261279488 00000100:00100000:2.0:1746065130.011650:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9174 00000100:00100000:2.0:1746065130.011656:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:29265:x1830881261279488:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:2.0:1746065130.011697:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065130.011717:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfa00/0x14b4f8542d4f4a29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be6b expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.011735:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065130.011738:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065130.011762:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.011772:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.011778:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.011783:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 253 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.011787:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdf4 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.011792:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdb5 expref: 12 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.011797:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 8/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.011857:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdb5 expref: 12 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.011870:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdb5 expref: 12 pid: 20754 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.011880:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827456:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.011973:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdf4 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.011980:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdf4 expref: 253 pid: 14643 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.011987:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827584:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.012121:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 253 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.012128:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 253 pid: 20754 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.012135:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827712:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.012155:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.012162:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 12 pid: 14643 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.012168:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827840:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.012189:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.012196:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 12 pid: 14645 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.012202:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827968:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065130.012216:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065130.013570:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827456:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065130.014954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.014987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.015466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.015485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.015508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.015579:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261279616 00000100:00100000:1.0:1746065130.015585:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261279616 00010000:00010000:1.0:1746065130.015621:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdb5 expref: 13 pid: 20754 timeout: 829 lvb_type: 0 00000100:00080000:0.0:1746065130.015705:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065130.015764:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280128 00000100:00100000:2.0:1746065130.015768:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280128 00010000:00010000:2.0:1746065130.015783:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 14 pid: 14643 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.015829:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280000 00000100:00100000:2.0:1746065130.015832:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280000 00010000:00010000:2.0:1746065130.015842:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 254 pid: 20754 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.015854:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280256 00000100:00100000:2.0:1746065130.015856:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280256 00010000:00010000:2.0:1746065130.015863:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 15 pid: 14645 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.015873:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5696 00000100:00100000:2.0:1746065130.015879:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261280128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065130.015890:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065130.015895:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 15 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065130.015904:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 15 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065130.015922:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065130.015926:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.015933:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065130.015964:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+15:1961:x1830881261280128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.015970:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5696 00000100:00100000:2.0:1746065130.015983:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5697 00000100:00100000:2.0:1746065130.015988:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1961:x1830881261280000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065130.015994:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065130.015998:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 254 pid: 20754 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065130.016005:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 254 pid: 20754 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065130.016016:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065130.016019:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.016024:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065130.016037:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1961:x1830881261280000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.016045:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5697 00000100:00100000:2.0:1746065130.016054:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5698 00000100:00100000:2.0:1746065130.016059:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881261280256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065130.016064:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065130.016068:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 14 pid: 14645 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065130.016074:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 14 pid: 14645 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065130.016083:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065130.016085:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.016090:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065130.016103:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75065d94-a855-40b7-bd64-6d6f17292955+14:1961:x1830881261280256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 44us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.016108:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5698 00000100:00100000:2.0:1746065130.016136:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827584:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.016144:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6b9400/0x14b4f8542d4f4838 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd14 expref: 253 pid: 20754 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.016155:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827712:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.016162:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a113600/0x14b4f8542d4f4831 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bd0d expref: 13 pid: 14643 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.016173:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827840:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.016182:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6002600/0x14b4f8542d4f4815 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bcff expref: 12 pid: 14645 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.016190:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881259827968:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.016212:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:3.0:1746065130.017051:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261279872 00000100:00100000:3.0:1746065130.017055:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261279872 00000100:00100000:3.0:1746065130.017611:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3777 00000100:00100000:3.0:1746065130.017618:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:27246:x1830881261279872:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065130.017782:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:27246:x1830881261279872:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 164us (2793us total) trans 8589943254 rc 0/0 00000100:00100000:3.0:1746065130.017788:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3777 00000100:00100000:1.0:1746065130.018947:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5699 00000100:00100000:1.0:1746065130.018956:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+11:1960:x1830881261279616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065130.018966:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065130.018973:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdb5 expref: 11 pid: 20754 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065130.018984:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdb5 expref: 11 pid: 20754 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065130.019000:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4f490a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdb5 expref: 11 pid: 20754 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065130.019012:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065130.019016:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065130.019022:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065130.019059:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75065d94-a855-40b7-bd64-6d6f17292955+10:1960:x1830881261279616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (4107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065130.019064:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5699 00000100:00100000:0.0:1746065130.020535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.020586:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280384 00000100:00100000:2.0:1746065130.020592:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280384 00010000:00010000:2.0:1746065130.020613:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdf4 expref: 254 pid: 14643 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.020633:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5700 00000100:00100000:2.0:1746065130.020637:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1960:x1830881261280384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065130.020644:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065130.020648:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdf4 expref: 254 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065130.020656:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdf4 expref: 254 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065130.020668:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcea000/0x14b4f8542d4f4981 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bdf4 expref: 254 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:2.0:1746065130.020677:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065130.020682:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.020688:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.020693:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.021383:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065130.021415:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:1960:x1830881261280384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 776us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.021422:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5700 00010000:00010000:3.0:1746065130.021798:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.021805:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000040:00080000:3.0:1746065130.022378:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2648, 88 off222856 00000004:00080000:3.0:1746065130.022385:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729313569121ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.022436:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2575, 88 off216248 00000004:00080000:3.0:1746065130.022440:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729313624947ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.022453:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2576, 88 off216336 00000004:00080000:3.0:1746065130.022456:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729313640420ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.022463:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2649, 88 off222944 00000004:00080000:3.0:1746065130.022465:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729313649669ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.022471:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2650, 88 off223032 00000004:00080000:3.0:1746065130.022473:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729313657492ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.022478:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2577, 88 off216424 00000004:00080000:3.0:1746065130.022481:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729313665716ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.022487:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2578, 88 off216512 00000004:00080000:3.0:1746065130.022490:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729313674351ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.022496:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2579, 88 off216600 00000004:00080000:3.0:1746065130.022498:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729313682469ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.022503:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2651, 88 off223120 00000004:00080000:3.0:1746065130.022506:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729313690880ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.022513:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2580, 88 off216688 00000004:00080000:3.0:1746065130.022515:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729313699614ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.022521:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2652, 88 off223208 00000004:00080000:3.0:1746065130.022523:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729313708010ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.022529:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2581, 88 off216776 00000004:00080000:3.0:1746065130.022531:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729313715637ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.022537:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2653, 88 off223296 00000004:00080000:3.0:1746065130.022539:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729313723569ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.022544:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2654, 88 off223384 00000004:00080000:3.0:1746065130.022546:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729313731139ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.022552:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2655, 88 off223472 00000004:00080000:3.0:1746065130.022554:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729313738682ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.022560:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2656, 88 off223560 00000004:00080000:3.0:1746065130.022562:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729313746839ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.022569:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2582, 88 off216864 00000004:00080000:3.0:1746065130.022571:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729313755719ns, next at 666938887344ns, rc = 0 00000001:00080000:2.0:1746065130.050096:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943245 is committed 00000001:00080000:2.0:1746065130.050107:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943244 is committed 00000001:00080000:2.0:1746065130.050111:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943253 is committed 00000001:00080000:2.0:1746065130.050118:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943248 is committed 00000001:00080000:2.0:1746065130.050126:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943249 is committed 00000001:00080000:2.0:1746065130.050129:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943255 is committed 00000004:00080000:2.0:1746065130.050133:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1874 committed 00000004:00010000:3.0:1746065130.050205:0:14643:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e8b7480 reply state ffff88009b828400 transno 8589943255 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:3.0:1746065130.050215:0:14643:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746065130.050321:0:14643:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065130.050336:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261279488:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 38676us (38793us total) trans 8589943255 rc 0/0 00000100:00100000:3.0:1746065130.050345:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9174 00000004:00080000:2.0:1746065130.050455:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1948 committed 00000004:00080000:2.0:1746065130.050471:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1947 committed 00000004:00080000:2.0:1746065130.050473:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1946 committed 00000004:00080000:2.0:1746065130.050474:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1945 committed 00000004:00080000:2.0:1746065130.050476:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1873 committed 00000004:00080000:2.0:1746065130.050477:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1944 committed 00000004:00080000:2.0:1746065130.050479:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1872 committed 00000004:00080000:2.0:1746065130.050480:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1943 committed 00000004:00080000:2.0:1746065130.050481:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1871 committed 00000004:00080000:2.0:1746065130.050482:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1870 committed 00000004:00080000:2.0:1746065130.050484:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1869 committed 00000004:00080000:2.0:1746065130.050486:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1942 committed 00000004:00080000:2.0:1746065130.050487:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1941 committed 00000004:00080000:2.0:1746065130.050489:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1868 committed 00000004:00080000:2.0:1746065130.050490:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1867 committed 00000004:00080000:2.0:1746065130.050491:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1940 committed 00000001:00080000:2.0:1746065130.050496:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943254 is committed 00000001:00080000:2.0:1746065130.050503:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943250 is committed 00010000:00010000:2.0:1746065130.050616:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.050624:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.050631:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.050636:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941e9e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065130.050639:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.050651:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.050665:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065130.050667:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065130.050672:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065130.050676:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9e00/0x14b4f8542d4f4a7d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00000100:00100000:2.0:1746065130.050708:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065130.050720:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259828096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.050792:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259828608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.050851:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259828352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.050974:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259828224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065130.051551:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.051598:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259828480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065130.051617:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.051630:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259828992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065130.051705:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.051718:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259829504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.051733:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.051744:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259830016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.051757:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.051770:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065130.051775:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259829120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.051788:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.051803:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259829632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065130.051900:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259828096 00000100:00100000:3.0:1746065130.051906:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259828096 00000100:00100000:3.0:1746065130.051935:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259828480 00000100:00100000:3.0:1746065130.051936:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259828480 00000100:00100000:3.0:1746065130.051944:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259828992 00000100:00100000:3.0:1746065130.051946:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259828992 00000100:00100000:3.0:1746065130.051954:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259829504 00000100:00100000:3.0:1746065130.051956:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259829504 00000100:00100000:3.0:1746065130.051966:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259830016 00000100:00100000:2.0:1746065130.051966:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065130.051967:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259830016 00000100:00100000:3.0:1746065130.051974:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259829120 00000100:00100000:3.0:1746065130.051975:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259829120 00000100:00100000:1.0:1746065130.051975:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259829632 00000100:00100000:1.0:1746065130.051978:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259829632 00000100:00100000:3.0:1746065130.051985:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11391 00000100:00100000:3.0:1746065130.051991:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3295:x1830881259828096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.051992:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11392 00000100:00100000:2.0:1746065130.051997:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11393 00000100:00100000:1.0:1746065130.051997:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3295:x1830881259828480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065130.052003:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3295:x1830881259828992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065130.052034:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.052052:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.052055:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259828608 00000100:00100000:0.0:1746065130.052058:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259828608 00000100:00100000:2.0:1746065130.052061:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259828864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.052069:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259828352 00000100:00100000:0.0:1746065130.052070:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259828352 00000100:00100000:2.0:1746065130.052074:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.052077:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11394 00000100:00100000:0.0:1746065130.052081:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881259829504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.052083:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259829376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.052094:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.052100:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259829888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.052110:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.052127:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259828864 00000100:00100000:2.0:1746065130.052130:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259828864 00000100:00100000:2.0:1746065130.052140:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259829376 00000100:00100000:2.0:1746065130.052142:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259829376 00000100:00100000:2.0:1746065130.052148:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259829888 00000100:00100000:2.0:1746065130.052150:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259829888 00000100:00100000:2.0:1746065130.052156:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11395 00000100:00100000:2.0:1746065130.052160:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3295:x1830881259830016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065130.052187:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881259828096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 196us (637us total) trans 17179872959 rc 0/0 00000100:00100000:3.0:1746065130.052192:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11391 00000100:00100000:3.0:1746065130.052203:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11396 00000100:00100000:3.0:1746065130.052207:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881259829120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.052228:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881259829504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (492us total) trans 21474840174 rc 0/0 00000100:00100000:3.0:1746065130.052233:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11397 00000100:00100000:0.0:1746065130.052236:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11394 00000100:00100000:3.0:1746065130.052238:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881259829632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065130.052248:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11398 00000100:00100000:3.0:1746065130.052251:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3296:x1830881259828608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.052254:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11399 00000100:00100000:0.0:1746065130.052259:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3298:x1830881259828352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065130.052283:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881259830016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (523us total) trans 21474840175 rc 0/0 00000100:00100000:2.0:1746065130.052288:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11395 00000100:00100000:2.0:1746065130.052299:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11400 00000100:00100000:2.0:1746065130.052303:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3298:x1830881259828864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065130.052339:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065130.052342:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065130.052344:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065130.052345:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065130.052347:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065130.052372:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881259828608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (337us total) trans 17179872960 rc 0/0 00000100:00100000:0.0:1746065130.052374:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3298:x1830881259828352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (319us total) trans 17179872961 rc 0/0 00000100:00100000:3.0:1746065130.052377:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11398 00000100:00100000:0.0:1746065130.052380:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11399 00000100:00100000:3.0:1746065130.052393:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11401 00000100:00100000:0.0:1746065130.052396:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11402 00000100:00100000:3.0:1746065130.052398:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3298:x1830881259829376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.052401:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3298:x1830881259829888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.052404:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3298:x1830881259828864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (327us total) trans 17179872962 rc 0/0 00000100:00100000:2.0:1746065130.052409:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11400 00000100:00100000:1.0:1746065130.052422:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872955 gen 2 00000004:00080000:1.0:1746065130.052427:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46e680, transno 17179872856 00000004:00080000:1.0:1746065130.052433:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46ca80, transno 17179872857 00000004:00080000:1.0:1746065130.052435:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46f800, transno 17179872858 00000004:00080000:1.0:1746065130.052437:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46ce00, transno 17179872859 00000004:00080000:1.0:1746065130.052439:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46d180, transno 17179872860 00000004:00080000:1.0:1746065130.052441:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46c380, transno 17179872861 00000004:00080000:1.0:1746065130.052442:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46d500, transno 17179872862 00000004:00080000:1.0:1746065130.052444:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46c700, transno 17179872863 00000004:00080000:1.0:1746065130.052446:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46d880, transno 17179872864 00000004:00080000:1.0:1746065130.052448:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a1880, transno 17179872865 00000004:00080000:1.0:1746065130.052450:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a1c00, transno 17179872866 00000004:00080000:1.0:1746065130.052452:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a1500, transno 17179872867 00000004:00080000:1.0:1746065130.052454:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46f480, transno 17179872868 00000004:00080000:1.0:1746065130.052456:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4e8700, transno 17179872869 00000004:00080000:1.0:1746065130.052458:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4ea680, transno 17179872870 00000004:00080000:1.0:1746065130.052459:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4eaa00, transno 17179872871 00000004:00080000:1.0:1746065130.052461:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095353b80, transno 17179872872 00000004:00080000:1.0:1746065130.052463:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4e8e00, transno 17179872873 00000004:00080000:1.0:1746065130.052465:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba1500, transno 17179872882 00000004:00080000:1.0:1746065130.052467:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa3b80, transno 17179872883 00002000:00010000:0.0:1746065130.052468:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1746065130.052469:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a13480, transno 17179872884 00000004:00080000:1.0:1746065130.052471:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba0000, transno 17179872885 00002000:00010000:0.0:1746065130.052471:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.052472:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:1.0:1746065130.052473:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ad5500, transno 17179872886 00002000:00010000:0.0:1746065130.052474:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00000004:00080000:1.0:1746065130.052475:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a12680, transno 17179872887 00002000:00010000:0.0:1746065130.052475:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1746065130.052477:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba1180, transno 17179872888 00000004:00080000:1.0:1746065130.052479:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a11500, transno 17179872889 00000004:00080000:1.0:1746065130.052481:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa1f80, transno 17179872890 00000004:00080000:1.0:1746065130.052483:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667df80, transno 17179872891 00000004:00080000:1.0:1746065130.052485:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d96300, transno 17179872892 00000004:00080000:1.0:1746065130.052487:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667ed80, transno 17179872893 00000004:00080000:1.0:1746065130.052489:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4b1500, transno 17179872894 00000004:00080000:1.0:1746065130.052491:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f541880, transno 17179872895 00000100:00100000:0.0:1746065130.052492:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3298:x1830881259829888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (380us total) trans 21474840176 rc 0/0 00000004:00080000:1.0:1746065130.052493:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4b1f80, transno 17179872896 00000004:00080000:1.0:1746065130.052495:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa0a80, transno 17179872897 00000100:00100000:0.0:1746065130.052497:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11402 00000004:00080000:1.0:1746065130.052498:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667d500, transno 17179872898 00000004:00080000:1.0:1746065130.052500:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f540000, transno 17179872899 00002000:00010000:3.0:1746065130.052502:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00000004:00080000:1.0:1746065130.052502:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013308b100, transno 17179872908 00000004:00080000:1.0:1746065130.052504:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880133089180, transno 17179872909 00002000:00010000:3.0:1746065130.052505:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:3.0:1746065130.052506:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:1.0:1746065130.052506:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013308bb80, transno 17179872910 00002000:00010000:3.0:1746065130.052508:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00000004:00080000:1.0:1746065130.052508:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013308ad80, transno 17179872911 00002000:00010000:3.0:1746065130.052510:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000004:00080000:1.0:1746065130.052510:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880133089f80, transno 17179872912 00000004:00080000:1.0:1746065130.052512:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880133089c00, transno 17179872913 00000004:00080000:1.0:1746065130.052514:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880133088e00, transno 17179872914 00000004:00080000:1.0:1746065130.052516:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880133088a80, transno 17179872915 00000004:00080000:1.0:1746065130.052517:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095355c00, transno 17179872916 00000004:00080000:1.0:1746065130.052519:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095355880, transno 17179872917 00000004:00080000:1.0:1746065130.052521:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095354700, transno 17179872918 00000004:00080000:1.0:1746065130.052523:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095356680, transno 17179872919 00000004:00080000:1.0:1746065130.052526:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90afb80, transno 17179872920 00000100:00100000:3.0:1746065130.052527:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881259829632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 289us (560us total) trans 21474840177 rc 0/0 00000004:00080000:1.0:1746065130.052528:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095354380, transno 17179872921 00000004:00080000:1.0:1746065130.052529:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90ac000, transno 17179872922 00000100:00100000:3.0:1746065130.052531:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11397 00000004:00080000:1.0:1746065130.052531:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095355500, transno 17179872923 00000004:00080000:1.0:1746065130.052533:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095356d80, transno 17179872924 00000004:00080000:1.0:1746065130.052535:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90ae680, transno 17179872925 00000004:00080000:1.0:1746065130.052536:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9ce680, transno 17179872926 00000004:00080000:1.0:1746065130.052538:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cf480, transno 17179872927 00000004:00080000:1.0:1746065130.052540:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cd880, transno 17179872928 00000004:00080000:1.0:1746065130.052542:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cc700, transno 17179872929 00000004:00080000:1.0:1746065130.052544:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cf800, transno 17179872930 00000004:00080000:1.0:1746065130.052546:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cd500, transno 17179872931 00000004:00080000:1.0:1746065130.052547:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cca80, transno 17179872932 00000004:00080000:1.0:1746065130.052549:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9ce300, transno 17179872933 00000004:00080000:1.0:1746065130.052551:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cfb80, transno 17179872934 00000004:00080000:1.0:1746065130.052553:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130445880, transno 17179872938 00000004:00080000:1.0:1746065130.052555:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46b480, transno 17179872939 00000004:00080000:1.0:1746065130.052556:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a0700, transno 17179872940 00000004:00080000:1.0:1746065130.052558:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130446d80, transno 17179872941 00000004:00080000:1.0:1746065130.052560:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd06680, transno 17179872942 00000004:00080000:1.0:1746065130.052562:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a3b80, transno 17179872943 00000004:00080000:1.0:1746065130.052563:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f469f80, transno 17179872944 00000004:00080000:1.0:1746065130.052566:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a0000, transno 17179872945 00000004:00080000:1.0:1746065130.052568:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130447800, transno 17179872946 00000004:00080000:1.0:1746065130.052570:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd05c00, transno 17179872947 00000004:00080000:1.0:1746065130.052572:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb12300, transno 17179872948 00000004:00080000:1.0:1746065130.052574:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd07800, transno 17179872949 00000004:00080000:1.0:1746065130.052576:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb11880, transno 17179872950 00000004:00080000:1.0:1746065130.052577:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90adf80, transno 17179872951 00000004:00080000:1.0:1746065130.052579:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd06a00, transno 17179872952 00000004:00080000:1.0:1746065130.052580:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb13100, transno 17179872953 00000004:00080000:1.0:1746065130.052582:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd05880, transno 17179872954 00000004:00080000:1.0:1746065130.052584:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb12680, transno 17179872955 00000100:00100000:1.0:1746065130.052588:0:3298:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012e8b6680 x1830881259828352/t17179872961(17179872961) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065146 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065130.052596:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b6680/2, rc 0, transno 17179872961 00000100:00100000:3.0:1746065130.052598:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881259828992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 596us (893us total) trans 17179872963 rc 0/0 00000100:00100000:1.0:1746065130.052600:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259828352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065130.052602:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11393 00000100:00100000:3.0:1746065130.052661:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881259829120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 454us (872us total) trans 21474840178 rc 0/0 00000100:00100000:3.0:1746065130.052666:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11396 00000100:00100000:3.0:1746065130.052731:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3298:x1830881259829376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 333us (635us total) trans 21474840179 rc 0/0 00000100:00100000:3.0:1746065130.052735:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11401 00000100:00100000:3.0:1746065130.052753:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840169 gen 2 00000004:00080000:3.0:1746065130.052756:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a1f80, transno 21474840082 00000004:00080000:3.0:1746065130.052761:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a2d80, transno 21474840083 00000004:00080000:3.0:1746065130.052764:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a2300, transno 21474840084 00000004:00080000:3.0:1746065130.052765:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a3100, transno 21474840085 00000004:00080000:3.0:1746065130.052768:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a2680, transno 21474840086 00000004:00080000:2.0:1746065130.052769:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5180/2, rc 0, transno 17179872960 00000004:00080000:3.0:1746065130.052770:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a3800, transno 21474840087 00000004:00080000:3.0:1746065130.052772:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a2a00, transno 21474840088 00000004:00080000:3.0:1746065130.052774:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801363a3480, transno 21474840089 00000100:00100000:2.0:1746065130.052774:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259828608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065130.052776:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90af800, transno 21474840090 00000004:00080000:1.0:1746065130.052776:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5c00/2, rc 0, transno 17179872962 00000004:00080000:3.0:1746065130.052778:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5883b80, transno 21474840091 00000004:00080000:3.0:1746065130.052780:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5882a00, transno 21474840092 00000100:00100000:1.0:1746065130.052780:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259828864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065130.052782:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90adc00, transno 21474840093 00000004:00080000:3.0:1746065130.052784:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880e00, transno 21474840094 00000004:00080000:3.0:1746065130.052786:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880380, transno 21474840095 00000100:00100000:2.0:1746065130.052787:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065130.052788:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5881500, transno 21474840096 00000004:00080000:3.0:1746065130.052790:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5882680, transno 21474840097 00000004:00080000:3.0:1746065130.052792:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d85880, transno 21474840102 00000004:00080000:3.0:1746065130.052794:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d85c00, transno 21474840103 00000004:00080000:3.0:1746065130.052796:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d87480, transno 21474840104 00000004:00080000:3.0:1746065130.052798:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d87b80, transno 21474840105 00000004:00080000:3.0:1746065130.052801:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f543480, transno 21474840106 00000004:00080000:3.0:1746065130.052802:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f543800, transno 21474840107 00000100:00100000:2.0:1746065130.052803:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259828736:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065130.052804:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f541c00, transno 21474840108 00000004:00080000:3.0:1746065130.052806:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f543b80, transno 21474840109 00000004:00080000:3.0:1746065130.052808:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667f800, transno 21474840110 00000004:00080000:3.0:1746065130.052810:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667dc00, transno 21474840111 00000004:00080000:3.0:1746065130.052812:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667ce00, transno 21474840112 00000004:00080000:3.0:1746065130.052828:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667e680, transno 21474840113 00000004:00080000:3.0:1746065130.052830:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667f100, transno 21474840114 00000004:00080000:3.0:1746065130.052832:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667fb80, transno 21474840115 00000004:00080000:3.0:1746065130.052834:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667e300, transno 21474840116 00000100:00100000:2.0:1746065130.052834:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065130.052836:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013667d880, transno 21474840117 00000004:00080000:3.0:1746065130.052838:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f469880, transno 21474840124 00000004:00080000:3.0:1746065130.052840:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46b800, transno 21474840125 00000004:00080000:3.0:1746065130.052842:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f469c00, transno 21474840126 00000004:00080000:3.0:1746065130.052844:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9bbb80, transno 21474840127 00000004:00080000:3.0:1746065130.052846:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f468700, transno 21474840128 00000004:00080000:3.0:1746065130.052848:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9b8a80, transno 21474840129 00000004:00080000:3.0:1746065130.052850:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f468000, transno 21474840130 00000004:00080000:3.0:1746065130.052851:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46a300, transno 21474840131 00000004:00080000:3.0:1746065130.052853:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9b8e00, transno 21474840132 00000004:00080000:3.0:1746065130.052855:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9b9180, transno 21474840133 00000004:00080000:3.0:1746065130.052856:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9baa00, transno 21474840134 00000004:00080000:3.0:1746065130.052858:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9b8000, transno 21474840135 00000004:00080000:3.0:1746065130.052859:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9ba300, transno 21474840136 00000004:00080000:3.0:1746065130.052861:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9b9f80, transno 21474840137 00000004:00080000:3.0:1746065130.052862:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9ba680, transno 21474840138 00000004:00080000:3.0:1746065130.052864:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9bad80, transno 21474840139 00000004:00080000:3.0:1746065130.052865:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130444380, transno 21474840140 00000004:00080000:3.0:1746065130.052867:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cce00, transno 21474840141 00000004:00080000:3.0:1746065130.052869:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130446a00, transno 21474840142 00000004:00080000:3.0:1746065130.052871:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cea00, transno 21474840143 00000004:00080000:3.0:1746065130.052872:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cdf80, transno 21474840144 00000004:00080000:3.0:1746065130.052874:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130445c00, transno 21474840145 00000004:00080000:3.0:1746065130.052876:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130446300, transno 21474840146 00000004:00080000:3.0:1746065130.052877:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cf100, transno 21474840147 00000004:00080000:3.0:1746065130.052879:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0084380, transno 21474840154 00000004:00080000:3.0:1746065130.052881:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0084e00, transno 21474840155 00000004:00080000:3.0:1746065130.052882:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085f80, transno 21474840156 00000004:00080000:3.0:1746065130.052884:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0084a80, transno 21474840157 00000004:00080000:3.0:1746065130.052886:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085180, transno 21474840158 00000004:00080000:3.0:1746065130.052887:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0086680, transno 21474840159 00000004:00080000:3.0:1746065130.052889:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0086300, transno 21474840160 00000004:00080000:3.0:1746065130.052891:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085500, transno 21474840161 00000004:00080000:3.0:1746065130.052893:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0084000, transno 21474840162 00000004:00080000:3.0:1746065130.052894:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0087100, transno 21474840163 00000004:00080000:3.0:1746065130.052896:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0087800, transno 21474840164 00000004:00080000:3.0:1746065130.052898:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d7ff480, transno 21474840165 00000004:00080000:3.0:1746065130.052899:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0087b80, transno 21474840166 00000004:00080000:3.0:1746065130.052901:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085880, transno 21474840167 00000004:00080000:3.0:1746065130.052902:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0084700, transno 21474840168 00000004:00080000:3.0:1746065130.052903:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d7ff100, transno 21474840169 00000100:00100000:3.0:1746065130.052907:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800913f9c00 x1830881259829120/t21474840178(21474840178) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065146 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746065130.052914:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f9c00/2, rc 0, transno 21474840178 00000004:00080000:1.0:1746065130.052915:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f8000/2, rc 0, transno 21474840179 00000100:00100000:3.0:1746065130.052916:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259829120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.052918:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259829248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065130.052919:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259829376:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065130.052925:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f8380/2, rc 0, transno 21474840177 00000004:00080000:1.0:1746065130.052927:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fa300/2, rc 0, transno 21474840176 00000100:00100000:3.0:1746065130.052928:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259829632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065130.052929:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259829888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065130.052935:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b7100/2, rc 0, transno 17179872963 00000100:00100000:2.0:1746065130.052935:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065130.052937:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259828992:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065130.052943:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fb100/2, rc 0, transno 21474840174 00000100:00100000:3.0:1746065130.052945:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259829504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.052947:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259829760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065130.052950:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f9880/2, rc 0, transno 21474840175 00000100:00100000:3.0:1746065130.052952:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259830016:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065130.052957:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5f80/2, rc 0, transno 17179872959 00000100:00100000:3.0:1746065130.052959:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259828096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065130.052960:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.052978:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259828224 00000100:00100000:2.0:1746065130.052982:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259828224 00002000:00010000:1.0:1746065130.052988:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065130.052990:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.052992:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.052993:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:2.0:1746065130.052994:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259828736 00002000:00010000:1.0:1746065130.052995:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065130.052996:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259828736 00000004:00080000:0.0:1746065130.052998:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 50 in progress, 3 in flight, 39 done 00000100:00100000:2.0:1746065130.053008:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259829248 00000100:00100000:2.0:1746065130.053010:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259829248 00000100:00100000:2.0:1746065130.053017:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259829760 00000100:00100000:1.0:1746065130.053017:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881259828480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1020us (1399us total) trans 17179872964 rc 0/0 00000100:00100000:2.0:1746065130.053018:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259829760 00000100:00100000:1.0:1746065130.053022:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11392 00000100:00100000:2.0:1746065130.053028:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11403 00000100:00100000:1.0:1746065130.053032:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11404 00000100:00100000:2.0:1746065130.053033:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881259828224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.053036:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881259828736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065130.053122:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881259828224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (333us total) trans 17179872965 rc 0/0 00000100:00100000:2.0:1746065130.053127:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11403 00000100:00100000:2.0:1746065130.053137:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11405 00000100:00100000:2.0:1746065130.053141:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881259829248:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.053151:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 3 in flight, 42 done 00000004:00080000:3.0:1746065130.053207:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 2 in flight, 72 done 00000100:00100000:2.0:1746065130.053214:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881259829248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (278us total) trans 21474840180 rc 0/0 00000100:00100000:3.0:1746065130.053219:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11406 00000100:00100000:2.0:1746065130.053223:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11405 00000100:00100000:3.0:1746065130.053225:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881259829760:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065130.053230:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5880/2, rc 0, transno 17179872964 00000100:00100000:0.0:1746065130.053233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.053234:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259828480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.053240:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065130.053244:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259830144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065130.053246:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5500/2, rc 0, transno 17179872965 00000100:00100000:2.0:1746065130.053250:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259828224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065130.053257:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fb480/2, rc 0, transno 21474840180 00000100:00100000:2.0:1746065130.053259:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259829248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065130.053263:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.053283:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259830144 00000100:00100000:2.0:1746065130.053285:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259830144 00002000:00010000:3.0:1746065130.053299:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1746065130.053299:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11407 00002000:00010000:3.0:1746065130.053301:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065130.053303:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746065130.053303:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013071b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881259830144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065130.053305:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065130.053306:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065130.053327:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881259829760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (365us total) trans 21474840181 rc 0/0 00000100:00100000:3.0:1746065130.053331:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11406 00000004:00080000:0.0:1746065130.053339:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f9f80/2, rc 0, transno 21474840181 00000100:00100000:0.0:1746065130.053343:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259829760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065130.053346:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280512 00000100:00100000:3.0:1746065130.053349:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280512 00002000:00010000:1.0:1746065130.053350:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065130.053352:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.053354:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.053355:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.053357:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065130.053366:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9175 00000100:00100000:3.0:1746065130.053370:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29265:x1830881261280512:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:1.0:1746065130.053376:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3297:x1830881259828736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 339us (541us total) trans 17179872966 rc 0/0 00010000:00010000:3.0:1746065130.053380:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065130.053381:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11404 00000004:00080000:0.0:1746065130.053384:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b6d80/2, rc 0, transno 17179872966 00000100:00100000:0.0:1746065130.053387:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259828736:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065130.053392:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be87 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.053426:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be87 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.053437:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be87 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.053452:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065130.053456:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065130.053458:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76c600, rc 0) 00000100:00100000:3.0:1746065130.053485:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29265:x1830881261280512:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 114us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.053492:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013071b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881259830144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (226us total) trans 17179872967 rc 0/0 00000100:00100000:3.0:1746065130.053493:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9175 00000100:00100000:2.0:1746065130.053500:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11407 00000004:00080000:1.0:1746065130.053516:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f9180/2, rc 0, transno 17179872967 00000100:00100000:1.0:1746065130.053520:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259830144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.060583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065130.060688:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280640 00000100:00100000:3.0:1746065130.060696:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280640 00000100:00100000:3.0:1746065130.060739:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9176 00000100:00100000:3.0:1746065130.060746:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29265:x1830881261280640:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065130.060763:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065130.060780:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76ca00/0x14b4f8542d4f4a8b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be8e expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.060889:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76da00/0x14b4f8542d4f4a92 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.060900:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76da00/0x14b4f8542d4f4a92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.060909:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76da00/0x14b4f8542d4f4a92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065130.060930:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:3.0:1746065130.060933:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065130.060944:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76da00/0x14b4f8542d4f4a92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.060966:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76ca00/0x14b4f8542d4f4a8b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be8e expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.060978:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76da00/0x14b4f8542d4f4a92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be8e expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.060984:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065130.060988:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065130.060991:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76da00, rc 0) 00000100:00100000:3.0:1746065130.061425:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261280640:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 678us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065130.061431:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9176 00000100:00100000:0.0:1746065130.064480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.064503:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.064514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.064526:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.064533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.064542:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280768 00000100:00100000:1.0:1746065130.064550:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280768 00000100:00100000:3.0:1746065130.064562:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280896 00000100:00100000:3.0:1746065130.064566:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280896 00000100:00100000:1.0:1746065130.064580:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281024 00000100:00100000:1.0:1746065130.064582:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281024 00000100:00100000:0.0:1746065130.064585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065130.064592:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281152 00000100:00100000:3.0:1746065130.064595:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281152 00000100:00080000:0.0:1746065130.064603:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065130.064607:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281280 00000100:00100000:1.0:1746065130.064609:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281280 00000100:00100000:3.0:1746065130.064617:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281408 00000100:00100000:3.0:1746065130.064619:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281408 00000100:00100000:1.0:1746065130.064621:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11408 00000100:00100000:1.0:1746065130.064627:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261280768:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:0.0:1746065130.064627:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11409 00000100:00100000:0.0:1746065130.064635:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261280896:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:3.0:1746065130.064639:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11410 00010000:00010000:1.0:1746065130.064641:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.064644:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065130.064645:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261281024:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065130.064652:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065130.064655:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be95 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.064655:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5be9c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.064661:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bea3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065130.064672:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6e9, atime: 0x6812d6e8, ctime: 0x6812d6e9, blocks: 0x801 00002000:00010000:0.0:1746065130.064672:0:4544:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6e9, ctime: 0x6812d6ea, blocks: 0x821 00002000:00010000:3.0:1746065130.064674:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6e9, ctime: 0x6812d6ea, blocks: 0x821 00010000:00010000:3.0:1746065130.064685:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.064685:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.064685:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.064687:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.064687:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.064687:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.064694:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bea3 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065130.064694:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be95 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.064694:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be9c expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065130.064706:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bea3 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065130.064706:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be95 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.064706:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be9c expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065130.064713:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76c400, rc 0) 00010000:00010000:1.0:1746065130.064714:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f716000, rc 0) 00010000:00010000:0.0:1746065130.064714:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fceb400, rc 0) 00000100:00100000:3.0:1746065130.064745:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261281024:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 101us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065130.064751:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11410 00000100:00100000:0.0:1746065130.064752:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261280896:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 119us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065130.064755:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261280768:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 127us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.064758:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11409 00000100:00100000:1.0:1746065130.064761:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11408 00000100:00100000:3.0:1746065130.064765:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11411 00000100:00100000:3.0:1746065130.064769:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261281152:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:0.0:1746065130.064771:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11412 00000100:00100000:1.0:1746065130.064774:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11413 00010000:00010000:3.0:1746065130.064775:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065130.064776:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:1961:x1830881261281280:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:1.0:1746065130.064779:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261281408:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065130.064782:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5beaa expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.064782:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065130.064784:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.064790:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5beb1 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065130.064791:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6ea, blocks: 0x81d 00010000:00010000:1.0:1746065130.064792:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5beb8 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.064798:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.064799:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746065130.064799:0:4544:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6ea, blocks: 0x16a9 00010000:00010000:3.0:1746065130.064802:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beaa expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746065130.064802:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6ea, atime: 0x6812d6e7, ctime: 0x6812d6ea, blocks: 0x1029 00010000:00010000:0.0:1746065130.064806:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.064808:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.064809:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.064810:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beaa expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065130.064811:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.064812:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb1 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065130.064832:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76d400, rc 0) 00010000:00010000:1.0:1746065130.064832:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb8 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.064838:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb1 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065130.064842:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb8 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.064842:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fceac00, rc 0) 00000100:00100000:3.0:1746065130.064846:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261281152:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 77us (319us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065130.064848:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f717c00, rc 0) 00000100:00100000:3.0:1746065130.064851:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11411 00000100:00100000:0.0:1746065130.064856:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261281280:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 81us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.064860:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11412 00000100:00100000:1.0:1746065130.064864:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261281408:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065130.064869:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11413 00000100:00100000:0.0:1746065130.070851:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065130.070904:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281664 00000100:00100000:3.0:1746065130.070913:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281664 00000100:00100000:3.0:1746065130.070965:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5243 00000100:00100000:3.0:1746065130.070973:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261281664:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065130.071002:0:8433:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.071016:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.071017:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.071022:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.071032:0:8433:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065130.081160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.081205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.081313:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.081333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.081554:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281920 00000100:00100000:0.0:1746065130.081562:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281920 00000100:00100000:0.0:1746065130.081605:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261282176 00000100:00100000:0.0:1746065130.081608:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261282176 00000100:00100000:2.0:1746065130.081631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065130.081636:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261282688 00000100:00100000:0.0:1746065130.081638:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261282688 00000100:00100000:2.0:1746065130.081645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.081664:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.082232:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261282560 00000100:00100000:1.0:1746065130.082237:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261282560 00000100:00100000:0.0:1746065130.082303:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261282944 00000100:00100000:2.0:1746065130.082320:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283200 00000100:00100000:2.0:1746065130.082323:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283200 00000100:00100000:3.0:1746065130.082329:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283072 00000100:00100000:3.0:1746065130.082332:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283072 00000100:00100000:2.0:1746065130.082346:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5244 00000100:00100000:3.0:1746065130.082351:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5245 00000100:00100000:2.0:1746065130.082353:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261281920:12345-192.168.202.46@tcp:3:lfs.0 00000100:00100000:3.0:1746065130.082354:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261282176:12345-192.168.202.46@tcp:3:lfs.0 00000100:00100000:2.0:1746065130.082369:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5246 00000100:00100000:2.0:1746065130.082372:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261282688:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065130.082384:0:8434:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.082384:0:21485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.082395:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.082395:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.082397:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.082397:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.082400:0:8434:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.082400:0:21485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.082411:0:8434:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.082411:0:21485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065130.082642:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5247 00000100:00100000:3.0:1746065130.082647:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261282560:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065130.082660:0:21481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.082669:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.082671:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065130.082673:0:21481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.082679:0:21481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065130.082733:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5248 00000100:00100000:2.0:1746065130.082738:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261283200:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065130.082753:0:21483:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.082759:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.082760:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.082763:0:21483:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.082769:0:21483:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065130.083087:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261282944 00000100:00100000:0.0:1746065130.083107:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5249 00000100:00100000:0.0:1746065130.083112:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261283072:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065130.083124:0:21488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.083131:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.083132:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.083134:0:21488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.083142:0:21488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.083146:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5250 00000100:00100000:1.0:1746065130.083151:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261282944:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065130.083165:0:21482:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.083171:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.083172:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.083174:0:21482:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.083180:0:21482:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.085782:0:11197:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.085798:0:11197:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.085800:0:11197:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.085804:0:11197:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.085826:0:11197:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.097038:0:8433:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.097053:0:8433:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.097060:0:8433:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.097070:0:8433:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c76c800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065130.097074:0:8433:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.097079:0:8433:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.097093:0:8433:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.097098:0:8433:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c76c800/0x14b4f8542d4f4ac3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065130.097165:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+14:1960:x1830881261281664:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 26190us (26348us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065130.097173:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5243 00010000:00010000:0.0:1746065130.104762:0:21485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.104779:0:21485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.104792:0:21485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.104798:0:21485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b1c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065130.105092:0:21485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.105100:0:21485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.105116:0:21485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.105122:0:21485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b1c00/0x14b4f8542d4f4ad1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065130.105172:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+15:1961:x1830881261282688:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 22794us (23854us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065130.105180:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5246 00010000:00010000:2.0:1746065130.113427:0:21488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.113443:0:21488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.113451:0:21488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.113457:0:21488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0040a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065130.113461:0:21488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.113468:0:21488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.113483:0:21488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.113489:0:21488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0040a00/0x14b4f8542d4f4ae6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065130.113573:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1961:x1830881261283072:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 30456us (31905us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065130.113583:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5249 00010000:00010000:1.0:1746065130.116394:0:21482:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.116408:0:21482:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.116416:0:21482:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.116423:0:21482:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6b9e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065130.116427:0:21482:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.116434:0:21482:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.116449:0:21482:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.116455:0:21482:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6b9e00/0x14b4f8542d4f4aed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.116519:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261282944:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 33364us (34884us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065130.116529:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5250 00010000:00010000:3.0:1746065130.123459:0:11197:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.123480:0:11197:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.123488:0:11197:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.123494:0:11197:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b0200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065130.123498:0:11197:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.123504:0:11197:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.123522:0:11197:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.123527:0:11197:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b0200/0x14b4f8542d4f4af4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065130.123609:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+13:1961:x1830881261281920:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 41251us (42452us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065130.123618:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5244 00010000:00010000:3.0:1746065130.131932:0:21483:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.131946:0:21483:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.131953:0:21483:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.131958:0:21483:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b1200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065130.131961:0:21483:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.131968:0:21483:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.131982:0:21483:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.131986:0:21483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1200/0x14b4f8542d4f4adf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065130.132054:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261283200:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 49312us (50404us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065130.132062:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5248 00010000:00010000:1.0:1746065130.133029:0:8434:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.133041:0:8434:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.133047:0:8434:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.133053:0:8434:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c76d600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065130.133055:0:8434:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.133061:0:8434:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.133071:0:8434:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.133078:0:8434:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c76d600/0x14b4f8542d4f4aca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.133130:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261282176:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 50772us (51922us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065130.133137:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5245 00010000:00010000:3.0:1746065130.136379:0:21481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.136395:0:21481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.136404:0:21481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.136410:0:21481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f3be800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065130.136414:0:21481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.136421:0:21481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.136436:0:21481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.136442:0:21481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f3be800/0x14b4f8542d4f4ad8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065130.136523:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261282560:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 53871us (55184us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065130.136533:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5247 00000100:00100000:0.0:1746065130.143558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065130.143805:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283584 00000100:00100000:3.0:1746065130.143832:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283584 00000100:00100000:3.0:1746065130.143870:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9177 00000100:00100000:3.0:1746065130.143878:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261283584:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:3.0:1746065130.143920:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065130.143943:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76da00/0x14b4f8542d4f4a92 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be8e expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.143975:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065130.143979:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065130.144008:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.144018:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.144026:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00010000:3.0:1746065130.144166:0:14643:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f46df80 reply state ffff8800a5309000 transno 8589943256 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:3.0:1746065130.144173:0:14643:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065130.144368:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261283584:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 489us (816us total) trans 8589943256 rc 0/0 00000100:00100000:3.0:1746065130.144374:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9177 00010000:00010000:3.0:1746065130.147557:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.147570:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.147576:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.147583:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982ae000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065130.147586:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.147592:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.147606:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065130.147608:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065130.147611:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065130.147616:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4f4afb lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065130.149675:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.152800:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283712 00000100:00100000:2.0:1746065130.152812:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283712 00000100:00100000:2.0:1746065130.152892:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11414 00000100:00100000:2.0:1746065130.152900:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29265:x1830881261283712:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065130.152919:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065130.152937:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f4b02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bebf expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.152964:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be95 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.152971:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.152972:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.152975:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f4b02 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bebf expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.153001:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be95 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.153011:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be95 expref: 9 pid: 4545 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065130.153020:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259830272:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065130.153915:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065130.154603:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259830272:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.154621:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f4b02 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bebf expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.154632:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76d600, rc 0) 00000100:00100000:2.0:1746065130.154670:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261283712:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1770us (5001us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.154677:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11414 00000100:00100000:0.0:1746065130.155577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.155673:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283840 00000100:00100000:1.0:1746065130.155678:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283840 00010000:00010000:1.0:1746065130.155702:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be95 expref: 9 pid: 4545 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065130.155733:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5701 00000100:00100000:1.0:1746065130.155739:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261283840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065130.155749:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065130.155768:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be95 expref: 9 pid: 4545 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.155869:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be95 expref: 9 pid: 4545 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.155887:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f716000/0x14b4f8542d4f4a99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be95 expref: 9 pid: 4545 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.156016:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.156018:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.156024:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f4b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bebf expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.156031:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f4b02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bebf expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.156053:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f4b02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bebf expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.156062:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259830400:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065130.156471:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065130.158842:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259830400:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065130.158861:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065130.158896:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261283840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3157us (3319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065130.158904:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5701 00000100:00100000:0.0:1746065130.159265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.159358:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283968 00000100:00100000:2.0:1746065130.159363:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283968 00000100:00100000:2.0:1746065130.159388:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11415 00000100:00100000:2.0:1746065130.159393:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261283968:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065130.159405:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065130.159417:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c76c800/0x14b4f8542d4f4b09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bec6 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.159438:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be9c expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.159445:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.159446:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.159449:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76c800/0x14b4f8542d4f4b09 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bec6 expref: 10 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.159468:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be9c expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.159476:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be9c expref: 10 pid: 4544 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065130.159485:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259830528:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065130.159906:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.161163:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259830528:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065130.161178:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c76c800/0x14b4f8542d4f4b09 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bec6 expref: 10 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.161192:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76c800, rc 0) 00000100:00100000:0.0:1746065130.161223:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261283968:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1829us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.161228:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11415 00000100:00100000:0.0:1746065130.162348:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.162466:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284096 00000100:00100000:1.0:1746065130.162471:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284096 00010000:00010000:1.0:1746065130.162490:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be9c expref: 10 pid: 4544 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065130.162519:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5702 00000100:00100000:1.0:1746065130.162524:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261284096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065130.162534:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065130.162553:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be9c expref: 10 pid: 4544 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.162563:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be9c expref: 10 pid: 4544 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.162581:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fceb400/0x14b4f8542d4f4aa0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be9c expref: 10 pid: 4544 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.162602:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.162603:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.162608:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c76c800/0x14b4f8542d4f4b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bec6 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.162616:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76c800/0x14b4f8542d4f4b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bec6 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.162639:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c76c800/0x14b4f8542d4f4b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bec6 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.162648:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259830656:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065130.162708:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.164389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.164459:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284224 00000100:00100000:2.0:1746065130.164465:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284224 00000100:00100000:1.0:1746065130.164477:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259830656:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065130.164489:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065130.164491:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11416 00000100:00100000:2.0:1746065130.164496:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261284224:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065130.164509:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065130.164512:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261284096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1988us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065130.164518:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5702 00010000:00010000:2.0:1746065130.164527:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c76ca00/0x14b4f8542d4f4b10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5becd expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.164545:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bea3 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.164551:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.164553:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.164556:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76ca00/0x14b4f8542d4f4b10 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5becd expref: 10 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.164573:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bea3 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.164583:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bea3 expref: 10 pid: 8427 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065130.164592:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259830784:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065130.164644:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065130.169693:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259830784:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.169723:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c76ca00/0x14b4f8542d4f4b10 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5becd expref: 10 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.169740:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76ca00, rc 0) 00000100:00100000:2.0:1746065130.169780:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261284224:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5282us (5393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.169787:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11416 00000100:00100000:0.0:1746065130.170907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.171328:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284352 00000100:00100000:1.0:1746065130.171334:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284352 00010000:00010000:1.0:1746065130.171360:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bea3 expref: 10 pid: 8427 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065130.171391:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5703 00000100:00100000:1.0:1746065130.171397:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261284352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065130.171408:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065130.171424:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bea3 expref: 10 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.171433:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bea3 expref: 10 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.171452:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4aa7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bea3 expref: 10 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.171476:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.171477:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.171483:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c76ca00/0x14b4f8542d4f4b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5becd expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.171494:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76ca00/0x14b4f8542d4f4b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5becd expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.171520:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c76ca00/0x14b4f8542d4f4b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5becd expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.171534:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259830912:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065130.171599:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.174716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.176002:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284480 00000100:00100000:2.0:1746065130.176011:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284480 00000100:00100000:1.0:1746065130.176023:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259830912:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065130.176040:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065130.176046:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11417 00000100:00100000:2.0:1746065130.176052:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29265:x1830881261284480:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065130.176068:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065130.176078:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261284352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4681us (5176us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065130.176084:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c76ce00/0x14b4f8542d4f4b17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bed4 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.176086:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5703 00010000:00010000:2.0:1746065130.176113:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beaa expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.176419:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.176421:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.176425:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c76ce00/0x14b4f8542d4f4b17 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bed4 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.176449:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beaa expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.176459:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beaa expref: 9 pid: 8427 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065130.176469:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259831040:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065130.176579:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065130.178747:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259831040:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.178777:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c76ce00/0x14b4f8542d4f4b17 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bed4 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.178794:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76ce00, rc 0) 00000100:00100000:2.0:1746065130.178857:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261284480:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2804us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.178864:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11417 00000100:00100000:0.0:1746065130.178947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.179034:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284608 00000100:00100000:1.0:1746065130.179040:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284608 00010000:00010000:1.0:1746065130.179066:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beaa expref: 9 pid: 8427 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065130.179089:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5704 00000100:00100000:1.0:1746065130.179095:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261284608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065130.179107:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065130.179130:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beaa expref: 9 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.179146:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beaa expref: 9 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.179166:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c76d400/0x14b4f8542d4f4aae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beaa expref: 9 pid: 8427 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.179176:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.179178:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.179184:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c76ce00/0x14b4f8542d4f4b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bed4 expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.179191:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c76ce00/0x14b4f8542d4f4b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bed4 expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.179214:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c76ce00/0x14b4f8542d4f4b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bed4 expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.179225:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259831168:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065130.179278:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065130.182209:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259831168:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065130.182230:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065130.182267:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261284608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3171us (3319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065130.182288:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5704 00000100:00100000:0.0:1746065130.183134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.183207:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284736 00000100:00100000:2.0:1746065130.183213:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284736 00000100:00100000:2.0:1746065130.183238:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11418 00000100:00100000:2.0:1746065130.183243:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29265:x1830881261284736:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065130.183257:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065130.183297:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f4b1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bedb expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.183320:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb1 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.183326:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.183328:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.183331:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f4b1e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bedb expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.183352:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb1 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.183361:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb1 expref: 9 pid: 4544 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065130.183370:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259831296:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065130.183423:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.186062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.186124:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284864 00000100:00100000:1.0:1746065130.186135:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284864 00010000:00010000:1.0:1746065130.186165:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb1 expref: 10 pid: 4544 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065130.186263:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881259831296:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.186296:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f4b1e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bedb expref: 10 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.186455:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6002400, rc 0) 00000100:00100000:2.0:1746065130.186495:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261284736:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3250us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.186503:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11418 00000100:00100000:1.0:1746065130.186558:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5705 00000100:00100000:1.0:1746065130.186565:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261284864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065130.186577:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065130.186596:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb1 expref: 9 pid: 4544 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.186606:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb1 expref: 9 pid: 4544 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.186625:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fceac00/0x14b4f8542d4f4ab5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb1 expref: 9 pid: 4544 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.186638:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.186640:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.186646:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f4b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bedb expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.186653:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f4b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bedb expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.186690:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f4b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bedb expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.186700:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259831424:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065130.186741:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.190334:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.190389:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284992 00000100:00100000:2.0:1746065130.190397:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284992 00000100:00100000:2.0:1746065130.190433:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11419 00000100:00100000:2.0:1746065130.190440:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261284992:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065130.190456:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065130.190464:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881259831424:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065130.190472:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4b25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bee2 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.190482:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065130.190497:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb8 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.190505:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.190507:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065130.190510:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4b25 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bee2 expref: 10 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.190519:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1960:x1830881261284864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3954us (4467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065130.190527:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5705 00010000:00010000:2.0:1746065130.190535:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb8 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065130.190545:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb8 expref: 10 pid: 4545 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746065130.190559:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259831552:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065130.190618:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065130.195457:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095353b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881259831552:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.195489:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4b25 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bee2 expref: 10 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.195506:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c76c400, rc 0) 00000100:00100000:2.0:1746065130.195551:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:29265:x1830881261284992:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5109us (5224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065130.195558:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11419 00000100:00100000:2.0:1746065130.196118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.196484:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285120 00000100:00100000:1.0:1746065130.196491:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285120 00010000:00010000:1.0:1746065130.196516:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb8 expref: 10 pid: 4545 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065130.196549:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5706 00000100:00100000:1.0:1746065130.196556:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1961:x1830881261285120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065130.196568:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065130.196587:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb8 expref: 10 pid: 4545 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.196598:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb8 expref: 10 pid: 4545 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.196618:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f717c00/0x14b4f8542d4f4abc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5beb8 expref: 10 pid: 4545 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065130.196644:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.196646:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065130.196652:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bee2 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.196663:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4b25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bee2 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065130.196689:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4b25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bee2 expref: 9 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065130.196701:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259831680:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065130.197534:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065130.199968:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881259831680:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065130.199987:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065130.200033:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1961:x1830881261285120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3476us (3914us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065130.200042:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5706 00000100:00100000:0.0:1746065130.204362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.205108:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285248 00000100:00100000:2.0:1746065130.205118:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285248 00000100:00100000:2.0:1746065130.205158:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11420 00000100:00100000:2.0:1746065130.205165:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1961:x1830881261285248:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:2.0:1746065130.205369:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:1.0:1746065130.206502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.206519:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.206537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.206553:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285376 00000100:00100000:1.0:1746065130.206558:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285376 00000100:00100000:1.0:1746065130.206581:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285632 00000100:00100000:1.0:1746065130.206583:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285632 00000100:00100000:1.0:1746065130.206591:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285888 00000100:00100000:1.0:1746065130.206592:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285888 00000100:00100000:1.0:1746065130.206603:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11421 00000100:00100000:1.0:1746065130.206608:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261285376:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065130.206720:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065130.206723:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.206725:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065129 -> 1746065130 00002000:00010000:1.0:1746065130.206727:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065130 -> 1746065131 00002000:00010000:1.0:1746065130.206729:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065130.206768:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261285376:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 160us (269us total) trans 21474840182 rc 0/0 00000100:00100000:1.0:1746065130.206774:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11421 00000100:00100000:1.0:1746065130.206790:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11422 00000100:00100000:1.0:1746065130.206796:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261285632:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065130.206882:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065130.206884:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.206886:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.206887:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065130 -> 1746065131 00002000:00010000:1.0:1746065130.206889:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746065130.206903:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261285632:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 107us (383us total) trans 17179872969 rc 0/0 00000100:00100000:1.0:1746065130.206908:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11422 00000100:00100000:1.0:1746065130.206918:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11423 00000100:00100000:1.0:1746065130.206922:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261285888:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065130.206976:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065130.206979:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.206980:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065127 -> 1746065130 00002000:00010000:1.0:1746065130.206981:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065130 -> 1746065131 00002000:00010000:1.0:1746065130.206983:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746065130.206997:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261285888:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 75us (459us total) trans 21474840183 rc 0/0 00000100:00100000:1.0:1746065130.207002:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11423 00000100:00100000:1.0:1746065130.207032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.207044:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285504 00000100:00100000:1.0:1746065130.207047:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285504 00000100:00100000:1.0:1746065130.207059:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11424 00000100:00100000:1.0:1746065130.207063:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261285504:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065130.207122:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065130.207124:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.207125:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065129 -> 1746065130 00002000:00010000:1.0:1746065130.207127:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065130 -> 1746065131 00002000:00010000:1.0:1746065130.207128:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065130.207143:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261285504:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 80us (111us total) trans 21474840184 rc 0/0 00000100:00100000:1.0:1746065130.207148:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11424 00000100:00100000:1.0:1746065130.207210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.207222:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285760 00000100:00100000:1.0:1746065130.207225:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285760 00000100:00100000:1.0:1746065130.207239:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11425 00000100:00100000:1.0:1746065130.207243:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1960:x1830881261285760:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065130.207331:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:1.0:1746065130.207334:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.207336:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.207337:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065130 -> 1746065131 00002000:00010000:1.0:1746065130.207339:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5801 -> 5801 00000100:00100000:1.0:1746065130.207354:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+12:1960:x1830881261285760:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 110us (143us total) trans 17179872970 rc 0/0 00000100:00100000:1.0:1746065130.207359:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11425 00002000:00010000:2.0:1746065130.208206:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065129 -> 1746065130 00002000:00010000:2.0:1746065130.208207:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065128 -> 1746065130 00002000:00010000:2.0:1746065130.208209:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065129 -> 1746065131 00002000:00010000:2.0:1746065130.208211:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:2.0:1746065130.208246:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1961:x1830881261285248:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 3080us (3892us total) trans 17179872968 rc 0/0 00000100:00100000:2.0:1746065130.208251:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11420 00000100:00100000:0.0:1746065130.212347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065130.212953:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286144 00000100:00100000:2.0:1746065130.212960:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286144 00000100:00100000:2.0:1746065130.212998:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3778 00000100:00100000:2.0:1746065130.213004:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009badf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261286144:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:2.0:1746065130.213051:0:16801:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x309:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfe00/0x14b4f8542d4f4a45 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be80 expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.213087:0:16801:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16801 initiator: MDT0 00010000:00010000:2.0:1746065130.213096:0:16801:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be87 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.213101:0:16801:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16801 initiator: MDT0 00010000:00010000:2.0:1746065130.213124:0:16801:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be87 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065130.213132:0:16801:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be87 expref: 9 pid: 14643 timeout: 829 lvb_type: 0 00000100:00100000:2.0:1746065130.213142:0:16801:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16801:1830881259831808:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065130.213212:0:16801:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065130.216831:0:16801:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16801:1830881259831808:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065130.216855:0:16801:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00000100:00100000:0.0:1746065130.221448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.222137:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286272 00000100:00100000:1.0:1746065130.222145:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286272 00010000:00010000:1.0:1746065130.222177:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be87 expref: 10 pid: 14643 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065130.222210:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5707 00000100:00100000:1.0:1746065130.222217:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+10:1960:x1830881261286272:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065130.222229:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065130.222234:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be87 expref: 10 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065130.222245:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be87 expref: 10 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065130.222280:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76c600/0x14b4f8542d4f4a84 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be87 expref: 10 pid: 14643 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065130.222307:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:1.0:1746065130.222312:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00010000:00010000:1.0:1746065130.222320:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16801 initiator: MDT0 00010000:00010000:1.0:1746065130.222325:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16801 initiator: MDT0 00010000:00010000:1.0:1746065130.222354:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065130.222393:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1960:x1830881261286272:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 176us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065130.222399:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5707 00010000:00010000:3.0:1746065130.223654:0:16801:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065130.223662:0:16801:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00000040:00080000:3.0:1746065130.224840:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2657, 88 off223648 00000004:00080000:3.0:1746065130.224846:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729516030738ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.225012:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2583, 88 off216952 00000004:00080000:3.0:1746065130.225016:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729516201018ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.225451:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2584, 88 off217040 00000004:00080000:3.0:1746065130.225455:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729516640111ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.225659:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2658, 88 off223736 00000004:00080000:3.0:1746065130.225664:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729516848957ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.225674:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2659, 88 off223824 00000004:00080000:3.0:1746065130.225677:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729516862143ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.225685:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2585, 88 off217128 00000004:00080000:3.0:1746065130.225687:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729516871991ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.225693:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2586, 88 off217216 00000004:00080000:3.0:1746065130.225695:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729516880267ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.225701:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2587, 88 off217304 00000004:00080000:3.0:1746065130.225703:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729516887778ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.225709:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2660, 88 off223912 00000004:00080000:3.0:1746065130.225713:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729516897302ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.225719:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2588, 88 off217392 00000004:00080000:3.0:1746065130.225722:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729516906928ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.225728:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2661, 88 off224000 00000004:00080000:3.0:1746065130.225731:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729516915241ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.225737:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2589, 88 off217480 00000004:00080000:3.0:1746065130.225739:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729516923896ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065130.225745:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2662, 88 off224088 00000004:00080000:3.0:1746065130.225747:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729516932212ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.225753:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2663, 88 off224176 00000004:00080000:3.0:1746065130.225756:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729516940583ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.225763:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2664, 88 off224264 00000004:00080000:3.0:1746065130.225765:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729516949964ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.225771:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2665, 88 off224352 00000004:00080000:3.0:1746065130.225774:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729516958622ns, next at 666984569566ns, rc = 0 00000040:00080000:3.0:1746065130.225780:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2590, 88 off217568 00000004:00080000:3.0:1746065130.225783:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729516967367ns, next at 666938887344ns, rc = 0 00000004:00010000:3.0:1746065130.256754:0:16801:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009badf850 reply state ffff880094bae800 transno 8589943257 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00000100:00100000:3.0:1746065130.256771:0:16801:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065130.256780:0:16801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065130.256783:0:16801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065130.256791:0:16801:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfe00/0x14b4f8542d4f4a45 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5be80 expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065130.256903:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009badf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:29265:x1830881261286144:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 43897us (45091us total) trans 8589943257 rc 0/0 00000100:00100000:3.0:1746065130.256912:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3778 00000001:00080000:2.0:1746065130.257259:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943257 is committed 00000004:00080000:2.0:1746065130.257277:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1882 committed 00000004:00080000:2.0:1746065130.257284:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1957 committed 00000004:00080000:2.0:1746065130.257296:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1956 committed 00000004:00080000:2.0:1746065130.257298:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1955 committed 00000004:00080000:2.0:1746065130.257299:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1954 committed 00000004:00080000:2.0:1746065130.257301:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1881 committed 00000004:00080000:2.0:1746065130.257302:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1953 committed 00000004:00080000:2.0:1746065130.257303:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1880 committed 00000004:00080000:2.0:1746065130.257305:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1952 committed 00000004:00080000:2.0:1746065130.257306:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1879 committed 00000004:00080000:2.0:1746065130.257308:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1878 committed 00000004:00080000:2.0:1746065130.257309:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1877 committed 00000004:00080000:2.0:1746065130.257311:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1951 committed 00000004:00080000:2.0:1746065130.257312:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1950 committed 00000004:00080000:2.0:1746065130.257313:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1876 committed 00000004:00080000:2.0:1746065130.257315:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1875 committed 00000004:00080000:2.0:1746065130.257317:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1949 committed 00010000:00010000:0.0:1746065130.258002:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16801 initiator: MDT0 00010000:00010000:0.0:1746065130.258011:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16801 initiator: MDT0 00010000:00010000:0.0:1746065130.258015:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16801 initiator: MDT0 00010000:00010000:0.0:1746065130.258020:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c76d400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065130.258023:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16801 initiator: MDT0 00010000:00010000:0.0:1746065130.258031:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16801 initiator: MDT0 00010000:00010000:0.0:1746065130.258404:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065130.258407:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065130.258411:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16801 initiator: MDT0 00010000:00010000:0.0:1746065130.258416:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c76d400/0x14b4f8542d4f4b2c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16801 initiator: MDT0 00000100:00100000:1.0:1746065130.258599:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259832064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.258634:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065130.259007:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259832576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.259024:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.259258:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259831936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.259289:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259832320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.259361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065130.259521:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259833088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065130.259536:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065130.259800:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259833600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065130.259831:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065130.259905:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259832064 00000100:00100000:2.0:1746065130.259912:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259832064 00000100:00100000:2.0:1746065130.259942:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259832576 00000100:00100000:2.0:1746065130.259944:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259832576 00000100:00100000:2.0:1746065130.259953:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259833088 00000100:00100000:2.0:1746065130.259955:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259833088 00000100:00100000:2.0:1746065130.259967:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11426 00000100:00100000:2.0:1746065130.259973:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881259832064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065130.260138:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065130.260141:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065130.260143:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065130.260145:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:2.0:1746065130.260147:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065130.260538:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11427 00000100:00100000:0.0:1746065130.260545:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3298:x1830881259832576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065130.260624:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065130.260627:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.260628:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.260629:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.260630:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065130.260650:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3298:x1830881259832576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (1626us total) trans 17179872972 rc 0/0 00000100:00100000:0.0:1746065130.260656:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11427 00000100:00100000:0.0:1746065130.260668:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11428 00000100:00100000:0.0:1746065130.260673:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881259833088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065130.260754:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065130.260757:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.260759:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.260761:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065130.260763:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065130.260778:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881259833088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (1241us total) trans 21474840185 rc 0/0 00000100:00100000:0.0:1746065130.260783:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11428 00000004:00080000:1.0:1746065130.260879:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdf800/2, rc 0, transno 17179872972 00000100:00100000:1.0:1746065130.260887:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259832576:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065130.260897:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084e00/2, rc 0, transno 21474840185 00000100:00100000:1.0:1746065130.260900:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259833088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065130.260915:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259832192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.260933:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065130.260944:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259832704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.260955:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065130.260999:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286400 00000100:00100000:3.0:1746065130.261003:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286400 00000100:00100000:3.0:1746065130.261025:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9178 00000100:00100000:3.0:1746065130.261030:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+6:29265:x1830881261286400:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065130.261042:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065130.261055:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af400/0x14b4f8542d4f4b33 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bee9 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.261093:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af400/0x14b4f8542d4f4b33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bee9 expref: 7 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.261103:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af400/0x14b4f8542d4f4b33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bee9 expref: 7 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065130.261115:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:3.0:1746065130.261118:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065130.261121:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982af400, rc 0) 00000100:00100000:3.0:1746065130.261146:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29265:x1830881261286400:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 117us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065130.261152:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9178 00000100:00100000:1.0:1746065130.261260:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259833216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065130.261287:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065130.261297:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259833728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065130.261308:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065130.261338:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259833600 00000100:00100000:1.0:1746065130.261341:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259833600 00000100:00100000:1.0:1746065130.261352:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259832192 00000100:00100000:1.0:1746065130.261353:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259832192 00000100:00100000:1.0:1746065130.261359:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259832704 00000100:00100000:1.0:1746065130.261360:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259832704 00000100:00100000:1.0:1746065130.261365:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259833216 00000100:00100000:1.0:1746065130.261366:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259833216 00000100:00100000:1.0:1746065130.261373:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259833728 00000100:00100000:1.0:1746065130.261374:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259833728 00000100:00100000:1.0:1746065130.261381:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11429 00000100:00100000:1.0:1746065130.261385:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3298:x1830881259833600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065130.261452:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065130.261454:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.261456:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.261458:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.261459:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065130.261478:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3298:x1830881259833600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1646us total) trans 21474840186 rc 0/0 00000100:00100000:1.0:1746065130.261483:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11429 00000100:00100000:1.0:1746065130.261493:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11430 00000100:00100000:1.0:1746065130.261497:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881259832192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065130.261562:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:1.0:1746065130.261564:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.261566:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.261567:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:1.0:1746065130.261569:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5801 -> 5801 00000100:00100000:1.0:1746065130.261589:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3295:x1830881259832192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (656us total) trans 17179872973 rc 0/0 00000100:00100000:1.0:1746065130.261596:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11430 00000100:00100000:1.0:1746065130.261605:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11431 00000100:00100000:1.0:1746065130.261609:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881259832704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.261684:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3295:x1830881259832704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (728us total) trans 17179872974 rc 0/0 00000100:00100000:1.0:1746065130.261688:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11431 00000100:00100000:1.0:1746065130.261697:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11432 00000100:00100000:1.0:1746065130.261700:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3295:x1830881259833216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065130.261759:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065130.261761:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.261763:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065130.261764:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:1.0:1746065130.261766:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746065130.261782:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881259833216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (495us total) trans 21474840187 rc 0/0 00000100:00100000:1.0:1746065130.261787:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11432 00000100:00100000:1.0:1746065130.261795:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11433 00000100:00100000:1.0:1746065130.261799:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3295:x1830881259833728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065130.261874:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065130.261876:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.261878:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.261879:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065130.261881:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065130.261898:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881259833728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (588us total) trans 21474840188 rc 0/0 00000100:00100000:1.0:1746065130.261903:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11433 00000004:00080000:1.0:1746065130.261952:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdce00/2, rc 0, transno 17179872973 00000100:00100000:1.0:1746065130.261956:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259832192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065130.261962:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdca80/2, rc 0, transno 17179872974 00000100:00100000:1.0:1746065130.261965:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259832704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065130.261970:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085f80/2, rc 0, transno 21474840187 00000100:00100000:1.0:1746065130.261972:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259833216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065130.261977:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0086300/2, rc 0, transno 21474840188 00000100:00100000:1.0:1746065130.261979:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259833728:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065130.261991:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0086680/2, rc 0, transno 21474840186 00000100:00100000:1.0:1746065130.261993:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259833600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065130.261996:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065130.262001:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259833984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.262016:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065130.262038:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259833984 00000100:00100000:1.0:1746065130.262041:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259833984 00000100:00100000:1.0:1746065130.262054:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11434 00000100:00100000:1.0:1746065130.262058:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3298:x1830881259833984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065130.262130:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3298:x1830881259833984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (112us total) trans 17179872975 rc 0/0 00000100:00100000:1.0:1746065130.262135:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11434 00000004:00080000:1.0:1746065130.262151:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba1e680/2, rc 0, transno 17179872975 00000100:00100000:1.0:1746065130.262154:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259833984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.262554:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.262572:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259832832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.262589:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.262600:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259833344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.262613:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.262620:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259833856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.262631:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.262649:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259832320 00000100:00100000:0.0:1746065130.262651:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259832320 00000100:00100000:0.0:1746065130.262662:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259832832 00000100:00100000:0.0:1746065130.262664:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259832832 00000100:00100000:0.0:1746065130.262669:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259833344 00000100:00100000:0.0:1746065130.262671:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259833344 00000100:00100000:0.0:1746065130.262676:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259833856 00000100:00100000:0.0:1746065130.262678:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259833856 00000100:00100000:0.0:1746065130.262684:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11435 00000100:00100000:0.0:1746065130.262688:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259832320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065130.262754:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065130.262756:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.262758:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.262759:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.262761:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065130.262782:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881259832320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (227us total) trans 17179872976 rc 0/0 00000100:00100000:0.0:1746065130.262787:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11435 00000100:00100000:0.0:1746065130.262802:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11436 00000100:00100000:0.0:1746065130.262806:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881259832832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.262895:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881259832832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (304us total) trans 17179872977 rc 0/0 00000100:00100000:0.0:1746065130.262900:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11436 00000100:00100000:0.0:1746065130.262910:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11437 00000100:00100000:0.0:1746065130.262914:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881259833344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.262991:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881259833344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (376us total) trans 21474840189 rc 0/0 00000100:00100000:0.0:1746065130.262996:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11437 00000100:00100000:0.0:1746065130.263006:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11438 00000100:00100000:0.0:1746065130.263010:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881259833856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.263079:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881259833856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (446us total) trans 21474840190 rc 0/0 00000100:00100000:0.0:1746065130.263084:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11438 00000004:00080000:0.0:1746065130.263103:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdc700/2, rc 0, transno 17179872976 00000100:00100000:0.0:1746065130.263106:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259832320:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.263112:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba1f800/2, rc 0, transno 17179872977 00000100:00100000:0.0:1746065130.263114:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259832832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.263119:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084a80/2, rc 0, transno 21474840189 00000100:00100000:0.0:1746065130.263121:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259833344:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.263127:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085500/2, rc 0, transno 21474840190 00000100:00100000:0.0:1746065130.263129:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259833856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.263141:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.263161:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259832448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.263178:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.263186:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259832960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.263197:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.263204:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259833472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.263214:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.263228:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259831936 00000100:00100000:0.0:1746065130.263231:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259831936 00000100:00100000:0.0:1746065130.263239:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259832448 00000100:00100000:0.0:1746065130.263241:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259832448 00000100:00100000:0.0:1746065130.263246:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259832960 00000100:00100000:0.0:1746065130.263247:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259832960 00000100:00100000:0.0:1746065130.263251:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259833472 00000100:00100000:0.0:1746065130.263253:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259833472 00000100:00100000:0.0:1746065130.263258:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11439 00000100:00100000:0.0:1746065130.263262:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259831936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065130.263341:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065130.263343:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.263345:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.263347:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065130.263348:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:0.0:1746065130.263369:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3297:x1830881259831936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (227us total) trans 17179872978 rc 0/0 00000100:00100000:0.0:1746065130.263377:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11439 00000100:00100000:0.0:1746065130.263388:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11440 00000100:00100000:0.0:1746065130.263392:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259832448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065130.263452:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065130.263453:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.263455:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.263456:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.263458:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065130.263476:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3297:x1830881259832448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (297us total) trans 17179872979 rc 0/0 00000100:00100000:0.0:1746065130.263481:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11440 00000100:00100000:0.0:1746065130.263491:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11441 00000100:00100000:0.0:1746065130.263495:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881259832960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065130.263563:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065130.263566:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.263567:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.263569:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065130.263571:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065130.263588:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259832960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (389us total) trans 21474840191 rc 0/0 00000100:00100000:0.0:1746065130.263592:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11441 00000100:00100000:0.0:1746065130.263602:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11442 00000100:00100000:0.0:1746065130.263607:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881259833472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065130.263668:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb size from disk: 2072576 -> 2072576 00002000:00010000:0.0:1746065130.263670:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb mtime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065130.263672:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.263674:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb ctime from disk: 1746065085 -> 1746065085 00002000:00010000:0.0:1746065130.263675:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37c:0x0] updating lvb blocks from disk: 2031 -> 2031 00000100:00100000:0.0:1746065130.263691:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259833472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (476us total) trans 21474840192 rc 0/0 00000100:00100000:0.0:1746065130.263695:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11442 00000004:00080000:0.0:1746065130.263715:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cde300/2, rc 0, transno 17179872978 00000100:00100000:0.0:1746065130.263718:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259831936:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.263724:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdd880/2, rc 0, transno 17179872979 00000100:00100000:0.0:1746065130.263726:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259832448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.263731:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084380/2, rc 0, transno 21474840191 00000100:00100000:0.0:1746065130.263733:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259832960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.263738:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085180/2, rc 0, transno 21474840192 00000100:00100000:0.0:1746065130.263741:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259833472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065130.264135:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3298:x1830881259832064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4160us (5499us total) trans 17179872971 rc 0/0 00000100:00100000:2.0:1746065130.264140:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11426 00000004:00080000:1.0:1746065130.266087:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdc000/2, rc 0, transno 17179872971 00000100:00100000:1.0:1746065130.266095:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259832064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065130.266408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065130.268140:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286656 00000100:00100000:3.0:1746065130.268149:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286656 00000100:00100000:3.0:1746065130.268187:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3779 00000100:00100000:3.0:1746065130.268194:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+7:29265:x1830881261286656:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1746065130.268424:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:29265:x1830881261286656:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 230us (2017us total) trans 8589943258 rc 0/0 00000100:00100000:3.0:1746065130.268430:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3779 00010000:00010000:0.0:1746065130.839969:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065131.153194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.153248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.153268:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286912 00000100:00100000:1.0:1746065131.153277:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286912 00000100:00100000:1.0:1746065131.153336:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286784 00000100:00100000:1.0:1746065131.153338:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286784 00000100:00100000:1.0:1746065131.153363:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11443 00000100:00100000:2.0:1746065131.153371:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11444 00000100:00100000:1.0:1746065131.153371:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013308bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261286912:12345-192.168.202.46@tcp:16:kworker.0 00000100:00100000:2.0:1746065131.153379:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+12:1961:x1830881261286784:12345-192.168.202.46@tcp:16:kworker.0 00000100:00080000:0.0:1746065131.154446:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065131.156056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.156077:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287040 00000100:00100000:0.0:1746065131.156083:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287040 00000100:00100000:0.0:1746065131.156109:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11445 00000100:00100000:0.0:1746065131.156115:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013071ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+13:1961:x1830881261287040:12345-192.168.202.46@tcp:16:kworker.0 00000001:00080000:1.0:1746065131.245283:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840192 is committed 00000001:00080000:1.0:1746065131.245311:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840170 is committed 00000001:00080000:1.0:1746065131.245326:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840184 is committed 00000001:00080000:1.0:1746065131.245331:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840172 is committed 00000001:00080000:1.0:1746065131.245342:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840173 is committed 00000100:00100000:0.0:1746065131.245457:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013071ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75065d94-a855-40b7-bd64-6d6f17292955+7:1961:x1830881261287040:12345-192.168.202.46@tcp:16:kworker.0 Request processed in 89337us (89400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.245469:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11445 00000100:00100000:3.0:1746065131.245545:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:75065d94-a855-40b7-bd64-6d6f17292955+6:1961:x1830881261286784:12345-192.168.202.46@tcp:16:kworker.0 Request processed in 92167us (92296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.245551:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11444 00000100:00100000:2.0:1746065131.245628:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013308bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+5:1961:x1830881261286912:12345-192.168.202.46@tcp:16:kworker.0 Request processed in 92258us (92440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.245634:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11443 00000100:00100000:0.0:1746065131.249289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.249434:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287296 00000100:00100000:2.0:1746065131.249442:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287296 00000100:00100000:2.0:1746065131.249489:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3780 00000100:00100000:2.0:1746065131.249497:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+7:29287:x1830881261287296:12345-192.168.202.46@tcp:35:umount.0 00000100:00100000:2.0:1746065131.249663:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:75065d94-a855-40b7-bd64-6d6f17292955+8:29287:x1830881261287296:12345-192.168.202.46@tcp:35:umount.0 Request processed in 165us (379us total) trans 8589943259 rc 0/0 00000100:00100000:2.0:1746065131.249669:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3780 00000100:00100000:0.0:1746065131.254291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.254330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.254412:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287680 00000100:00100000:2.0:1746065131.254420:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287680 00000100:00100000:0.0:1746065131.254556:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.254768:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11446 00000100:00100000:2.0:1746065131.254777:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+5:1957:x1830881261287680:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:2.0:1746065131.254802:0:4545:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4e932d 00000100:00080000:2.0:1746065131.254808:0:4545:0:(import.c:66:import_set_state_nolock()) ffff880129d2b000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1746065131.255054:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000001:00000004:2.0:1746065131.255205:0:4545:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179872979 00000100:00100000:2.0:1746065131.255372:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+2:1957:x1830881261287680:12345-192.168.202.46@tcp:9:umount.0 Request processed in 596us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.255381:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11446 00000100:00080000:0.0:1746065131.255591:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065131.255621:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287424 00000100:00100000:1.0:1746065131.255625:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287424 00000100:00100000:1.0:1746065131.255656:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287808 00000100:00100000:1.0:1746065131.255658:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287808 00000100:00100000:1.0:1746065131.255668:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287552 00000100:00100000:1.0:1746065131.255670:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287552 00000100:00100000:1.0:1746065131.255682:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 632 00000100:00100000:1.0:1746065131.255687:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+17:1961:x1830881261287424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.255695:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.255709:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880135cd9e00/0x14b4f8542d4e92e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e553d5 expref: 17 pid: 14642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.255727:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.255745:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+16:1961:x1830881261287424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.255750:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 632 00000100:00100000:1.0:1746065131.255762:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 633 00000100:00100000:1.0:1746065131.255766:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+15:1961:x1830881261287808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.255772:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.255779:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5f88800/0x14b4f8542d4e9318 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e55406 expref: 15 pid: 14642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.255786:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.255798:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+14:1961:x1830881261287808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 32us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.255803:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 633 00000100:00100000:1.0:1746065131.255812:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 634 00000100:00100000:1.0:1746065131.255837:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+13:1960:x1830881261287552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065131.255843:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.255849:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801302d2e00/0x14b4f8542d4e9311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e553ff expref: 13 pid: 14641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.255856:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065131.255868:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+12:1960:x1830881261287552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 32us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.255873:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 634 00010000:00010000:3.0:1746065131.256144:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065131.265854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.265935:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287936 00000100:00100000:2.0:1746065131.265943:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287936 00000100:00100000:2.0:1746065131.265977:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11447 00000100:00100000:2.0:1746065131.265984:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+5:1957:x1830881261287936:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:2.0:1746065131.266008:0:4545:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4e9326 00000100:00080000:2.0:1746065131.266016:0:4545:0:(import.c:66:import_set_state_nolock()) ffff8800930d1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065131.266051:0:4545:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840192 00000100:00100000:2.0:1746065131.266274:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:75065d94-a855-40b7-bd64-6d6f17292955+2:1957:x1830881261287936:12345-192.168.202.46@tcp:9:umount.0 Request processed in 289us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.266281:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11447 00010000:00010000:0.0:1746065131.266427:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065131.270117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.270392:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261288320 00000100:00100000:3.0:1746065131.270399:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261288320 00000100:00100000:3.0:1746065131.270448:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9179 00000100:00100000:3.0:1746065131.270457:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75065d94-a855-40b7-bd64-6d6f17292955+8:1957:x1830881261288320:12345-192.168.202.46@tcp:39:umount.0 00000020:00000080:3.0:1746065131.270484:0:14645:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4e931f 00000020:00010000:3.0:1746065131.270498:0:14645:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800930d6800: total 0 00000100:00080000:3.0:1746065131.270502:0:14645:0:(import.c:66:import_set_state_nolock()) ffff8800930d5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746065131.270528:0:14645:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943259 00000100:00100000:3.0:1746065131.270760:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75065d94-a855-40b7-bd64-6d6f17292955+7:1957:x1830881261288320:12345-192.168.202.46@tcp:39:umount.0 Request processed in 304us (649us total) trans 8589943260 rc 0/0 00000100:00100000:3.0:1746065131.270766:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9179 00000020:00010000:2.0:1746065131.270986:0:14603:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800930d6800: total 0 00010000:00010000:2.0:1746065131.271019:0:14603:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800930d6800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1746065131.271043:0:14603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:2.0:1746065131.271046:0:14603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065131.271052:0:14603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c775200/0x14b4f8542d4ee1a0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5803d expref: 6 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.271072:0:14603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:2.0:1746065131.271074:0:14603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065131.271077:0:14603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4e93e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e554ae expref: 5 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.271086:0:14603:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800930d6800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746065131.271096:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065131.271097:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065131.271099:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065131.725488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.725536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.725559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.725593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.725641:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261288576 00000100:00100000:3.0:1746065131.725653:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261288576 00000100:00100000:2.0:1746065131.725667:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261288448 00000100:00100000:2.0:1746065131.725674:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261288448 00000100:00100000:3.0:1746065131.725720:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261288704 00000100:00100000:3.0:1746065131.725723:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261288704 00000100:00100000:2.0:1746065131.725748:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 635 00000100:00100000:2.0:1746065131.725756:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edf50a1e-6d84-485b-9392-04c729e87e94+14:1961:x1830881261288576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065131.725771:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065131.725793:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801302d3200/0x14b4f8542d4e933b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5545a expref: 14 pid: 14642 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.725854:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065131.725896:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edf50a1e-6d84-485b-9392-04c729e87e94+13:1961:x1830881261288576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 140us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.726030:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 636 00000100:00100000:3.0:1746065131.726042:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edf50a1e-6d84-485b-9392-04c729e87e94+13:1961:x1830881261288448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065131.726058:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065131.726076:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012bd07200/0x14b4f8542d4e9334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e55430 expref: 13 pid: 14641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.726096:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065131.726142:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edf50a1e-6d84-485b-9392-04c729e87e94+12:1961:x1830881261288448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.726147:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 636 00000100:00100000:3.0:1746065131.726165:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 637 00000100:00100000:3.0:1746065131.726172:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edf50a1e-6d84-485b-9392-04c729e87e94+11:1961:x1830881261288704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065131.726177:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065131.726186:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801302d3800/0x14b4f8542d4e9342 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e55461 expref: 11 pid: 14642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.726193:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065131.726213:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edf50a1e-6d84-485b-9392-04c729e87e94+10:1961:x1830881261288704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 34us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.726221:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 637 00000100:00100000:3.0:1746065131.726247:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261289216 00000100:00100000:3.0:1746065131.726249:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261289216 00000100:00100000:3.0:1746065131.726289:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11448 00000100:00100000:3.0:1746065131.726297:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+11:1957:x1830881261289216:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:3.0:1746065131.726323:0:9716:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4e9357 00000020:00010000:3.0:1746065131.726327:0:9716:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a61af800: total 0 00000100:00080000:3.0:1746065131.726331:0:9716:0:(import.c:66:import_set_state_nolock()) ffff8800a61aa800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746065131.726356:0:9716:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179872979 00000100:00100000:3.0:1746065131.726475:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1957:x1830881261289216:12345-192.168.202.46@tcp:9:umount.0 Request processed in 181us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.726480:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11448 00000020:00010000:3.0:1746065131.726494:0:7081:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a61af800: total 0 00010000:00010000:3.0:1746065131.726508:0:7081:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a61af800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746065131.726538:0:7081:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c76ce00/0x14b4f8542d4f4b17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bed4 expref: 8 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.726563:0:7081:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c76d600/0x14b4f8542d4f4b02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bebf expref: 7 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.726579:0:7081:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6002400/0x14b4f8542d4f4b1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bedb expref: 6 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.726589:0:7081:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a61af800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746065131.726595:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065131.726597:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065131.726598:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1746065131.726606:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065131.726968:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 635 00000100:00100000:1.0:1746065131.731949:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1830881259834240:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732002:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.732045:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830881259834752:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732059:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.732074:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065131.732078:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830881259834368:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732088:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.732110:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259834240 00000100:00100000:1.0:1746065131.732115:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259834240 00000100:00100000:1.0:1746065131.732144:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259834752 00000100:00100000:1.0:1746065131.732145:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259834752 00000100:00100000:1.0:1746065131.732159:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259834368 00000100:00100000:1.0:1746065131.732161:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259834368 00000100:00100000:1.0:1746065131.732172:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1746065131.732177:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830881259834240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732209:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830881259834240:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.732213:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1746065131.732224:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1746065131.732227:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830881259834752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732240:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830881259834752:12345-0@lo:400:kworker.0 Request processed in 13us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.732244:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1746065131.732249:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1746065131.732252:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830881259834368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732275:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830881259834368:12345-0@lo:400:kworker.0 Request processed in 22us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.732279:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1746065131.732302:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830881259834368:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732308:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1830881259834240:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732313:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830881259834752:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732344:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259834496:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732360:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1746065131.732375:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065131.732380:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746065131.732384:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3297:1830881259834112:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732398:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.732412:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259834624:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732422:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.732435:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259834496 00000100:00100000:1.0:1746065131.732437:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259834496 00000100:00100000:1.0:1746065131.732465:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259834624 00000100:00100000:1.0:1746065131.732467:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259834624 00000100:00100000:1.0:1746065131.732477:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1746065131.732480:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3297:x1830881259834496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732499:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3297:x1830881259834496:12345-0@lo:400:kworker.0 Request processed in 19us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.732509:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1746065131.732516:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1746065131.732525:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259834624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732529:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840192 gen 2 00000004:00080000:1.0:1746065131.732533:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fb100, transno 21474840174 00000004:00080000:1.0:1746065131.732538:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f9880, transno 21474840175 00000004:00080000:1.0:1746065131.732540:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fa300, transno 21474840176 00000004:00080000:1.0:1746065131.732542:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f8380, transno 21474840177 00000004:00080000:1.0:1746065131.732544:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f9c00, transno 21474840178 00000004:00080000:1.0:1746065131.732546:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f8000, transno 21474840179 00000004:00080000:1.0:1746065131.732547:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fb480, transno 21474840180 00000004:00080000:1.0:1746065131.732549:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f9f80, transno 21474840181 00000004:00080000:1.0:1746065131.732551:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0084e00, transno 21474840185 00000004:00080000:1.0:1746065131.732553:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0086680, transno 21474840186 00000004:00080000:1.0:1746065131.732555:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085f80, transno 21474840187 00000004:00080000:1.0:1746065131.732556:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0086300, transno 21474840188 00000004:00080000:1.0:1746065131.732558:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0084a80, transno 21474840189 00000004:00080000:1.0:1746065131.732560:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085500, transno 21474840190 00000004:00080000:1.0:1746065131.732562:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0084380, transno 21474840191 00000004:00080000:1.0:1746065131.732563:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085180, transno 21474840192 00000100:00100000:1.0:1746065131.732566:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259834496:0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732586:0:14641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259834112 00000100:00100000:1.0:1746065131.732587:0:14641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259834112 00000100:00100000:1.0:1746065131.732600:0:14641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1746065131.732603:0:14641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3297:x1830881259834112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065131.732625:0:14641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3297:x1830881259834112:12345-0@lo:400:kworker.0 Request processed in 22us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.732629:0:14641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1746065131.732645:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3297:1830881259834112:0@lo:400:kworker.0 00000100:00100000:2.0:1746065131.732705:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259834624:12345-0@lo:400:kworker.0 Request processed in 185us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.732734:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00080000:2.0:1746065131.732806:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065131.732809:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746065131.732865:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 16 done 00000100:00100000:1.0:1746065131.732884:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259834624:0@lo:400:kworker.0 00000100:00100000:3.0:1746065131.733605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.733970:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261289856 00000100:00100000:2.0:1746065131.733973:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261289856 00000100:00100000:2.0:1746065131.734021:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11449 00000100:00100000:2.0:1746065131.734026:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+9:1957:x1830881261289856:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:2.0:1746065131.734041:0:4545:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4e9350 00000020:00010000:2.0:1746065131.734047:0:4545:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880129d2a000: total 0 00000100:00080000:2.0:1746065131.734050:0:4545:0:(import.c:66:import_set_state_nolock()) ffff880129d29000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065131.734074:0:4545:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840192 00000020:00010000:3.0:1746065131.734232:0:7082:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880129d2a000: total 0 00010000:00010000:3.0:1746065131.734265:0:7082:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880129d2a000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1746065131.734305:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f35c600/0x14b4f8542d4eb316 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e56612 expref: 7 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.734352:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c76c400/0x14b4f8542d4f4b25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bee2 expref: 6 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.734369:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c76ca00/0x14b4f8542d4f4b10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5becd expref: 5 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.734386:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c76c800/0x14b4f8542d4f4b09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bec6 expref: 4 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.734396:0:7082:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880129d2a000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1746065131.734406:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065131.734408:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065131.734409:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065131.734920:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+2:1957:x1830881261289856:12345-192.168.202.46@tcp:9:umount.0 Request processed in 890us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.734926:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11449 00000100:00100000:0.0:1746065131.740382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.740589:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290240 00000100:00100000:1.0:1746065131.740597:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290240 00000100:00100000:1.0:1746065131.740722:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9180 00000100:00100000:1.0:1746065131.740729:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+8:1957:x1830881261290240:12345-192.168.202.46@tcp:39:umount.0 00000020:00000080:1.0:1746065131.740756:0:14644:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4e9349 00000020:00010000:1.0:1746065131.740760:0:14644:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880129d2f000: total 0 00000100:00080000:1.0:1746065131.740763:0:14644:0:(import.c:66:import_set_state_nolock()) ffff880129d2d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746065131.740778:0:14644:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943260 00000020:00010000:0.0:1746065131.741018:0:8443:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880129d2f000: total 0 00000100:00080000:2.0:1746065131.741021:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746065131.741021:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065131.741050:0:8443:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880129d2f000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1746065131.741076:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715c00) 00010000:00010000:0.0:1746065131.741079:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065131.741084:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af400/0x14b4f8542d4f4b33 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bee9 expref: 7 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.741115:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:0.0:1746065131.741117:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746065131.741120:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d5f600/0x14b4f8542d4e9365 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5548b expref: 6 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.741127:0:8443:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880129d2f000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746065131.741139:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065131.741140:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065131.741142:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065131.741303:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf3f931f-11fa-4147-998b-3fd8b4e59c6c+4:1957:x1830881261290240:12345-192.168.202.46@tcp:39:umount.0 Request processed in 572us (1091us total) trans 8589943261 rc 0/0 00000100:00100000:1.0:1746065131.741310:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9180 00000100:00100000:2.0:1746065131.748291:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259834880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065131.748346:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.749223:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259834880 00000100:00100000:1.0:1746065131.749229:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259834880 00000100:00100000:1.0:1746065131.749281:0:8431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1746065131.749287:0:8431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830881259834880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746065131.749321:0:8431:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 245432320 pending 0 free 3850371072 avail 3848273920 00000100:00100000:1.0:1746065131.749424:0:8431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830881259834880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.749430:0:8431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1746065131.749493:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259834880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065131.767613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.767683:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290368 00000100:00100000:1.0:1746065131.767691:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290368 00000100:00080000:2.0:1746065131.767747:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065131.767751:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9181 00000100:00100000:1.0:1746065131.767759:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:29309:x1830881261290368:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065131.767841:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.767856:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132a00/0x14b4f8542d4f4b3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bef0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.767906:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.767916:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.767924:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.767936:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.767949:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.767953:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768214:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768220:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768226:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065131.768251:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:1.0:1746065131.768268:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065131.768280:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768287:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768294:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768298:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768303:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768307:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0133200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065131.768310:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768315:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768323:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009f49f200) 00010000:00010000:1.0:1746065131.768325:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065131.768329:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768333:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133200/0x14b4f8542d4f4b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768361:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768366:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768370:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768374:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0132400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065131.768376:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768380:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768385:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f715100) 00010000:00010000:1.0:1746065131.768387:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065131.768388:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768393:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132400/0x14b4f8542d4f4b48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.768415:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132a00/0x14b4f8542d4f4b3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef0 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.768426:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef0 expref: 248 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.768431:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:1.0:1746065131.768432:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065131.768434:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0133400, rc 0) 00000100:00100000:1.0:1746065131.768482:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29309:x1830881261290368:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 723us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.768487:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9181 00000100:00100000:3.0:1746065131.772659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.772739:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290624 00000100:00100000:1.0:1746065131.772746:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290624 00000100:00100000:1.0:1746065131.772874:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9182 00000100:00100000:1.0:1746065131.772882:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29309:x1830881261290624:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065131.772897:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.772910:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132e00/0x14b4f8542d4f4b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bef7 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.773229:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.773241:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef0 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.773247:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.773282:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef0 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.773292:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef0 expref: 249 pid: 14644 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065131.773303:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259835008:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065131.773689:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.776247:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259835008:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065131.776277:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065131.776700:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.778007:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290752 00000100:00100000:2.0:1746065131.778015:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290752 00010000:00010000:2.0:1746065131.778044:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef0 expref: 250 pid: 14644 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746065131.778080:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5708 00000100:00100000:2.0:1746065131.778086:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1961:x1830881261290752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065131.778099:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065131.778104:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef0 expref: 250 pid: 14644 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746065131.778114:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef0 expref: 250 pid: 14644 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746065131.778131:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0133400/0x14b4f8542d4f4b4f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef0 expref: 250 pid: 14644 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746065131.778154:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:2.0:1746065131.778159:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.778167:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.778173:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.778195:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065131.778218:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.778224:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065131.778227:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:1961:x1830881261290752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 142us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.778233:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5708 00000004:00200000:1.0:1746065131.778239:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065131.778499:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132e00/0x14b4f8542d4f4b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef7 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.778528:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef7 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.778533:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:1.0:1746065131.778535:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065131.778537:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0132200, rc 0) 00000100:00100000:1.0:1746065131.778560:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29309:x1830881261290624:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5679us (5907us total) trans 8589943262 rc 0/0 00000100:00100000:1.0:1746065131.778566:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9182 00000100:00100000:3.0:1746065131.780622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.780704:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290880 00000100:00100000:1.0:1746065131.780710:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290880 00000100:00100000:1.0:1746065131.780914:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9183 00000100:00100000:1.0:1746065131.780920:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29309:x1830881261290880:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065131.780938:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.780950:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500e00/0x14b4f8542d4f4b6b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5befe expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.781004:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.781014:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef7 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.781020:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.781044:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef7 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.781054:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef7 expref: 250 pid: 14644 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065131.781064:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259835136:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065131.782524:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065131.782973:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881259835136:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065131.782990:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065131.783246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.783938:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291008 00000100:00100000:2.0:1746065131.783944:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291008 00010000:00010000:2.0:1746065131.783966:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef7 expref: 251 pid: 14644 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746065131.783986:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5709 00000100:00100000:2.0:1746065131.783992:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881261291008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065131.784003:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065131.784007:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef7 expref: 251 pid: 14644 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746065131.784016:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef7 expref: 251 pid: 14644 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746065131.784032:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0132200/0x14b4f8542d4f4b5d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x309:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bef7 expref: 251 pid: 14644 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746065131.784056:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:2.0:1746065131.784060:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.784066:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.784071:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.784094:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065131.784125:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1960:x1830881261291008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 132us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.784131:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5709 00010000:00010000:1.0:1746065131.784283:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.784288:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065131.784320:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:1.0:1746065131.784323:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065131.784335:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.784358:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500e00/0x14b4f8542d4f4b6b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5befe expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.784368:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5befe expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.784374:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:1.0:1746065131.784375:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065131.784378:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500200, rc 0) 00000100:00100000:1.0:1746065131.784401:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29309:x1830881261290880:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3481us (3783us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.784406:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9183 00000100:00100000:0.0:1746065131.786377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.786724:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291264 00000100:00100000:1.0:1746065131.786732:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291264 00000100:00100000:1.0:1746065131.786762:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9184 00000100:00100000:1.0:1746065131.786768:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29309:x1830881261291264:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065131.786785:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.786799:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501400/0x14b4f8542d4f4b79 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf05 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.786888:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cab800/0x14b4f8542d4f4b80 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.786898:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cab800/0x14b4f8542d4f4b80 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.786906:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cab800/0x14b4f8542d4f4b80 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065131.786916:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00010000:00010000:1.0:1746065131.787005:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501400/0x14b4f8542d4f4b79 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf05 expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.787019:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cab800/0x14b4f8542d4f4b80 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf05 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.787025:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:1.0:1746065131.787028:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065131.787030:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cab800, rc 0) 00000100:00100000:1.0:1746065131.787334:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29309:x1830881261291264:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 564us (961us total) trans 8589943263 rc 0/0 00000100:00100000:1.0:1746065131.787340:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9184 00000100:00100000:0.0:1746065131.788884:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.788912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.788932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.788944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.788956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.788985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.789002:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291392 00000100:00100000:0.0:1746065131.789007:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291392 00000100:00100000:0.0:1746065131.789030:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291520 00000100:00100000:0.0:1746065131.789032:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291520 00000100:00100000:0.0:1746065131.789050:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291648 00000100:00100000:0.0:1746065131.789052:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291648 00000100:00100000:0.0:1746065131.789060:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291776 00000100:00100000:0.0:1746065131.789062:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291776 00000100:00100000:0.0:1746065131.789069:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291904 00000100:00100000:0.0:1746065131.789071:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291904 00000100:00100000:0.0:1746065131.789077:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292032 00000100:00100000:0.0:1746065131.789078:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292032 00000100:00100000:0.0:1746065131.789087:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11450 00000100:00100000:0.0:1746065131.789092:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261291392:12345-192.168.202.46@tcp:1:lfs.0 00002000:00010000:0.0:1746065131.789131:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x801 00010000:00010000:0.0:1746065131.789138:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789152:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.789154:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.789158:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789167:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789180:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789187:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789193:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789199:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d5f600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065131.789202:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789208:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789217:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789225:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d5f600/0x14b4f8542d4f4b8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.789280:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881261291392:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 187us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.789286:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11450 00000100:00100000:0.0:1746065131.789300:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11451 00000100:00100000:0.0:1746065131.789304:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881261291520:12345-192.168.202.46@tcp:1:lfs.0 00002000:00010000:0.0:1746065131.789327:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x821 00010000:00010000:0.0:1746065131.789330:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789336:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.789337:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.789339:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789346:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789355:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789360:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789369:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789374:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0040800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065131.789377:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789381:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789388:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.789392:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0040800/0x14b4f8542d4f4b95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.789418:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881261291520:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 114us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.789423:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11451 00000100:00100000:3.0:1746065131.789434:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11452 00000100:00100000:3.0:1746065131.789441:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1961:x1830881261291648:12345-192.168.202.46@tcp:1:lfs.0 00002000:00010000:3.0:1746065131.789463:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x821 00010000:00010000:3.0:1746065131.789468:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.789474:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.789476:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.789478:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.789489:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.789499:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.789505:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.789510:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.789515:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec8fc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065131.789517:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.789523:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.789531:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.789537:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec8fc00/0x14b4f8542d4f4b9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.789571:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1961:x1830881261291648:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 131us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.790732:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11453 00000100:00100000:0.0:1746065131.790742:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881261291776:12345-192.168.202.46@tcp:1:lfs.0 00002000:00010000:0.0:1746065131.790765:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x81d 00010000:00010000:0.0:1746065131.790770:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.790780:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.790782:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.790784:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.790792:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.790803:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.790807:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.790812:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.790829:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0041600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065131.790831:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.790837:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.790952:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11454 00000100:00100000:2.0:1746065131.790962:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261291904:12345-192.168.202.46@tcp:1:lfs.0 00002000:00010000:2.0:1746065131.790986:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x16a9 00010000:00010000:2.0:1746065131.790991:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.790997:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.790998:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.791000:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791012:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791022:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791033:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791038:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791043:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd35400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065131.791046:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791051:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791060:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791065:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd35400/0x14b4f8542d4f4baa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.791097:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261291904:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 139us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.791102:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11454 00000100:00100000:2.0:1746065131.791117:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11455 00000100:00100000:2.0:1746065131.791121:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1960:x1830881261292032:12345-192.168.202.46@tcp:1:lfs.0 00002000:00010000:2.0:1746065131.791140:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x1029 00010000:00010000:2.0:1746065131.791145:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791150:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.791151:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.791153:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791160:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791169:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791175:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791181:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791186:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd35c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065131.791188:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791193:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791201:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.791210:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd35c00/0x14b4f8542d4f4bb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.791232:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1960:x1830881261292032:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 110us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.791236:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11455 00010000:00010000:0.0:1746065131.791296:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.791306:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0041600/0x14b4f8542d4f4ba3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.791332:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881261291776:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 593us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.791337:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11453 00000100:00100000:3.0:1746065131.791367:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11452 00000100:00080000:2.0:1746065131.791449:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065131.793529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.794474:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292288 00000100:00100000:1.0:1746065131.794480:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292288 00000100:00100000:1.0:1746065131.794513:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9185 00000100:00100000:1.0:1746065131.794519:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29309:x1830881261292288:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:1.0:1746065131.794555:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065131.794574:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500200/0x14b4f8542d4f4b72 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5befe expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.794587:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:1.0:1746065131.794590:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065131.794611:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.794619:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065131.794624:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000040:00080000:1.0:1746065131.795081:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2666, 88 off224440 00000004:00080000:1.0:1746065131.795087:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731086271304ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065131.795119:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2591, 88 off217656 00000004:00080000:1.0:1746065131.795123:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731086308115ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065131.795145:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2592, 88 off217744 00000004:00080000:1.0:1746065131.795148:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731086332827ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065131.795156:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2667, 88 off224528 00000004:00080000:1.0:1746065131.795158:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731086342398ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065131.795165:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2668, 88 off224616 00000004:00080000:1.0:1746065131.795167:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731086352195ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065131.795828:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2593, 88 off217832 00000004:00080000:1.0:1746065131.795834:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731087018487ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065131.796056:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2594, 88 off217920 00000004:00080000:1.0:1746065131.796060:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731087245091ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065131.796071:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2595, 88 off218008 00000004:00080000:1.0:1746065131.796073:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731087257677ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065131.796079:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2669, 88 off224704 00000004:00080000:1.0:1746065131.796081:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731087266110ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065131.796103:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2596, 88 off218096 00000004:00080000:1.0:1746065131.796105:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731087290010ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065131.796112:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2670, 88 off224792 00000004:00080000:1.0:1746065131.796114:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731087298585ns, next at 666984569566ns, rc = 0 00000040:00080000:1.0:1746065131.796119:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2597, 88 off218184 00000004:00080000:1.0:1746065131.796123:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731087307307ns, next at 666938887344ns, rc = 0 00000040:00080000:1.0:1746065131.796128:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2671, 88 off224880 00000004:00080000:2.0:1746065131.796146:0:14689:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731087329811ns, next at 732087329117ns, rc = 0 00000100:00100000:1.0:1746065131.796147:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259835264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065131.796190:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065131.796218:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731087402655ns, next at 732087329117ns, rc = 0 00000040:00080000:1.0:1746065131.796242:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2672, 88 off224968 00000004:00080000:1.0:1746065131.796246:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731087430352ns, next at 732087329117ns, rc = 0 00000040:00080000:1.0:1746065131.796252:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2673, 88 off225056 00000004:00080000:1.0:1746065131.796262:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731087447030ns, next at 732087329117ns, rc = 0 00000040:00080000:1.0:1746065131.796269:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2674, 88 off225144 00000004:00080000:1.0:1746065131.796272:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731087456576ns, next at 732087329117ns, rc = 0 00000040:00080000:1.0:1746065131.796279:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2598, 88 off218272 00000004:00080000:1.0:1746065131.796281:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731087466001ns, next at 666938887344ns, rc = 0 00000100:00100000:2.0:1746065131.796283:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259835264 00000100:00100000:2.0:1746065131.796287:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259835264 00000100:00100000:2.0:1746065131.796310:0:8431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1746065131.796315:0:8431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259835264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746065131.796337:0:8431:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 255524864 pending 5111808 free 3849322496 avail 3847225344 00000100:00100000:2.0:1746065131.796374:0:8431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881259835264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.796379:0:8431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1746065131.796399:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259835264:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1746065131.816173:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943264 is committed 00000004:00080000:2.0:1746065131.816182:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1890 committed 00000004:00080000:2.0:1746065131.816188:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1967 committed 00000004:00080000:2.0:1746065131.816192:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1966 committed 00000004:00080000:2.0:1746065131.816194:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1965 committed 00000004:00080000:2.0:1746065131.816195:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1964 committed 00000004:00080000:2.0:1746065131.816197:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1889 committed 00000004:00080000:2.0:1746065131.816198:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1962 committed 00000004:00080000:2.0:1746065131.816200:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1888 committed 00000004:00080000:2.0:1746065131.816201:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1961 committed 00000004:00080000:2.0:1746065131.816203:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1887 committed 00000004:00080000:2.0:1746065131.816204:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1886 committed 00000004:00080000:2.0:1746065131.816206:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1885 committed 00000004:00080000:2.0:1746065131.816207:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1960 committed 00000004:00080000:2.0:1746065131.816209:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1959 committed 00000004:00080000:2.0:1746065131.816210:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1884 committed 00000004:00080000:2.0:1746065131.816211:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1883 committed 00000004:00080000:2.0:1746065131.816213:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1958 committed 00000001:00100000:2.0:1746065131.816224:0:14720:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bf3f931f-11fa-4147-998b-3fd8b4e59c6c 00000001:00080000:2.0:1746065131.816227:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943261 is committed 00000004:00080000:2.0:1746065131.816239:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1963 committed 00000001:00080000:2.0:1746065131.816243:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943259 is committed 00000001:00100000:2.0:1746065131.816251:0:14720:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 75065d94-a855-40b7-bd64-6d6f17292955 00000001:00080000:2.0:1746065131.816268:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943260 is committed 00000020:00000080:2.0:1746065131.816271:0:14720:0:(genops.c:904:class_export_put()) final put ffff8800930d6800/75065d94-a855-40b7-bd64-6d6f17292955 00000020:00000080:2.0:1746065131.816588:0:14720:0:(genops.c:904:class_export_put()) final put ffff880129d2f000/bf3f931f-11fa-4147-998b-3fd8b4e59c6c 00000004:00010000:2.0:1746065131.816620:0:14644:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012d50b480 reply state ffff8800a55c4c00 transno 8589943264 ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065131.816629:0:14644:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746065131.816710:0:14644:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065131.816723:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29309:x1830881261292288:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 22200us (23194us total) trans 8589943264 rc 0/0 00000100:00100000:2.0:1746065131.816730:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9185 00010000:00010000:2.0:1746065131.816852:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.816860:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.816866:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.816871:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801298de800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065131.816873:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.816879:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.816890:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:2.0:1746065131.816892:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065131.816895:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065131.816899:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801298de800/0x14b4f8542d4f4bb8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065131.817143:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259835520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065131.817188:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.817223:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065131.817228:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259835648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065131.817243:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1746065131.817273:0:10035:0:(genops.c:863:class_export_destroy()) destroying export ffff8800930d6800/75065d94-a855-40b7-bd64-6d6f17292955 for lustre-MDT0000 00000020:00000080:1.0:1746065131.817309:0:10035:0:(genops.c:863:class_export_destroy()) destroying export ffff880129d2f000/bf3f931f-11fa-4147-998b-3fd8b4e59c6c for lustre-MDT0000 00000020:00000080:1.0:1746065131.817331:0:10035:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800930d5000 for lustre-MDT0000 00000020:00000080:1.0:1746065131.817334:0:10035:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880129d2d800 for lustre-MDT0000 00000100:00100000:1.0:1746065131.817344:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259835520 00000100:00100000:1.0:1746065131.817349:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259835520 00000100:00100000:1.0:1746065131.817372:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259835648 00000100:00100000:1.0:1746065131.817374:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259835648 00000100:00100000:1.0:1746065131.817385:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11456 00000100:00100000:1.0:1746065131.817390:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3295:x1830881259835520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065131.817560:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3295:x1830881259835520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (371us total) trans 21474840193 rc 0/0 00000100:00100000:1.0:1746065131.817565:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11456 00000100:00100000:1.0:1746065131.817573:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11457 00000100:00100000:1.0:1746065131.817577:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3295:x1830881259835648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065131.817664:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3295:x1830881259835648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (419us total) trans 21474840194 rc 0/0 00000100:00100000:1.0:1746065131.817669:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11457 00000004:00080000:1.0:1746065131.817699:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fe680/2, rc 0, transno 21474840194 00000100:00100000:1.0:1746065131.817703:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259835648:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065131.817710:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fd500/2, rc 0, transno 21474840193 00000100:00100000:1.0:1746065131.817713:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259835520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065131.817888:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259835392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065131.817910:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065131.817926:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259835904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065131.817941:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065131.817951:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259836416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065131.817962:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065131.817974:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065131.817978:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259835776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065131.817990:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065131.818000:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259836288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065131.818010:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065131.818028:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259835392 00000100:00100000:3.0:1746065131.818030:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259835392 00000100:00100000:3.0:1746065131.818045:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259835904 00000100:00100000:3.0:1746065131.818047:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259835904 00000100:00100000:3.0:1746065131.818055:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259836416 00000100:00100000:3.0:1746065131.818057:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259836416 00000100:00100000:3.0:1746065131.818064:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259835776 00000100:00100000:3.0:1746065131.818065:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259835776 00000100:00100000:3.0:1746065131.818071:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259836288 00000100:00100000:3.0:1746065131.818072:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259836288 00000100:00100000:3.0:1746065131.818079:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11458 00000100:00100000:3.0:1746065131.818083:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3298:x1830881259835392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065131.818188:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881259835392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (276us total) trans 17179872980 rc 0/0 00000100:00100000:3.0:1746065131.818196:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11458 00000100:00100000:3.0:1746065131.818209:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11459 00000100:00100000:3.0:1746065131.818213:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3298:x1830881259835904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065131.818298:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881259835904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (355us total) trans 17179872981 rc 0/0 00000100:00100000:3.0:1746065131.818303:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11459 00000100:00100000:3.0:1746065131.818313:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11460 00000100:00100000:3.0:1746065131.818317:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3298:x1830881259836416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065131.818380:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065131.818382:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065131.818384:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065131.818386:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065131.818387:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065131.818405:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881259836416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (442us total) trans 17179872982 rc 0/0 00000100:00100000:3.0:1746065131.818410:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11460 00000100:00100000:3.0:1746065131.818420:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11461 00000100:00100000:3.0:1746065131.818424:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3298:x1830881259835776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065131.818514:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3298:x1830881259835776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (521us total) trans 21474840195 rc 0/0 00000100:00100000:3.0:1746065131.818518:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11461 00000100:00100000:3.0:1746065131.818527:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11462 00000100:00100000:3.0:1746065131.818531:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3298:x1830881259836288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065131.818591:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065131.818593:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065131.818595:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065131.818596:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065131.818598:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065131.818615:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881259836288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (603us total) trans 17179872983 rc 0/0 00000100:00100000:3.0:1746065131.818620:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11462 00000004:00080000:3.0:1746065131.818639:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fca80/2, rc 0, transno 21474840195 00000100:00100000:3.0:1746065131.818643:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259835776:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065131.818650:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0086300/2, rc 0, transno 17179872983 00000100:00100000:3.0:1746065131.818656:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259836288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065131.818662:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084700/2, rc 0, transno 17179872980 00000100:00100000:3.0:1746065131.818664:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259835392:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065131.818670:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084e00/2, rc 0, transno 17179872981 00000100:00100000:3.0:1746065131.818672:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259835904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065131.818678:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084a80/2, rc 0, transno 17179872982 00000100:00100000:3.0:1746065131.818680:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259836416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.818810:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259837056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065131.818836:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259836160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.818841:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.818852:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.818854:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065131.818859:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259836928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065131.818861:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259836672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.818870:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.818874:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259837056 00000100:00100000:2.0:1746065131.818876:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259837056 00000100:00100000:0.0:1746065131.818878:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259837312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065131.818889:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.818890:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259836160 00000100:00100000:2.0:1746065131.818891:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259836160 00000100:00100000:2.0:1746065131.818897:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259836672 00000100:00100000:2.0:1746065131.818898:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259836672 00000100:00100000:0.0:1746065131.818898:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746065131.818901:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259836032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.818904:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259837312 00000100:00100000:2.0:1746065131.818905:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259837312 00000100:00100000:2.0:1746065131.818912:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11463 00000100:00100000:0.0:1746065131.818912:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.818916:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3298:x1830881259837056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065131.818918:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259836544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.818928:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.818934:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259837184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065131.818943:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.818965:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259836032 00000100:00100000:0.0:1746065131.818968:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259836032 00000100:00100000:0.0:1746065131.818978:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259836544 00000100:00100000:0.0:1746065131.818979:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259836544 00000100:00100000:0.0:1746065131.818985:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259837184 00000100:00100000:0.0:1746065131.818987:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259837184 00000100:00100000:0.0:1746065131.818993:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11464 00000100:00100000:0.0:1746065131.818997:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3296:x1830881259836160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.819009:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3298:x1830881259837056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (166us total) trans 21474840196 rc 0/0 00000100:00100000:2.0:1746065131.819013:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11463 00000100:00100000:2.0:1746065131.819023:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11465 00000100:00100000:2.0:1746065131.819027:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3296:x1830881259836672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.819098:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830881259836672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (227us total) trans 17179872984 rc 0/0 00000100:00100000:2.0:1746065131.819103:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11465 00000100:00100000:2.0:1746065131.819112:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11466 00000100:00100000:2.0:1746065131.819116:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3296:x1830881259837312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065131.819149:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065131.819151:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.819153:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.819154:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.819156:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1746065131.819170:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065131.819172:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065131.819173:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746065131.819173:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3296:x1830881259836160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (320us total) trans 17179872985 rc 0/0 00002000:00010000:2.0:1746065131.819175:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065131.819177:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065131.819178:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11464 00000100:00100000:0.0:1746065131.819188:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11467 00000100:00100000:2.0:1746065131.819190:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3296:x1830881259837312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (300us total) trans 21474840197 rc 0/0 00000100:00100000:0.0:1746065131.819192:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3296:x1830881259836032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.819194:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11466 00000100:00100000:2.0:1746065131.819201:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11468 00000100:00100000:2.0:1746065131.819205:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3296:x1830881259836544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.819276:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3296:x1830881259836032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (361us total) trans 17179872986 rc 0/0 00000100:00100000:0.0:1746065131.819281:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11467 00000100:00100000:2.0:1746065131.819388:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1830881259836544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (458us total) trans 17179872987 rc 0/0 00000100:00100000:0.0:1746065131.819665:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11469 00000100:00100000:0.0:1746065131.819673:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1830881259837184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065131.819738:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065131.819740:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.819742:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.819743:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.819744:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065131.819762:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1830881259837184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (817us total) trans 21474840198 rc 0/0 00000100:00100000:2.0:1746065131.819830:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11468 00000100:00100000:2.0:1746065131.819845:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.819860:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259836928 00000100:00100000:2.0:1746065131.819862:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259837440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065131.819863:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259836928 00000100:00100000:2.0:1746065131.819877:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.819878:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11470 00000100:00100000:1.0:1746065131.819883:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3298:x1830881259836928:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065131.819892:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9ff800/2, rc 0, transno 21474840196 00000100:00100000:2.0:1746065131.819895:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259837056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.819906:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259837440 00000100:00100000:2.0:1746065131.819909:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259837440 00000100:00100000:2.0:1746065131.819921:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11471 00000100:00100000:2.0:1746065131.819926:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881259837440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065131.819994:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881259836928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (147us total) trans 21474840199 rc 0/0 00000100:00100000:2.0:1746065131.819998:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881259837440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (119us total) trans 21474840200 rc 0/0 00000100:00100000:1.0:1746065131.819999:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11470 00000100:00100000:2.0:1746065131.820002:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11471 00000004:00080000:1.0:1746065131.820017:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fc000/2, rc 0, transno 21474840199 00000100:00100000:1.0:1746065131.820020:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259836928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065131.820025:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fc700/2, rc 0, transno 21474840200 00000100:00100000:1.0:1746065131.820033:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259837440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065131.820135:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11469 00000100:00100000:0.0:1746065131.820224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:0.0:1746065131.820264:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0086680/2, rc 0, transno 17179872986 00000100:00100000:0.0:1746065131.820267:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259836032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.820274:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085500/2, rc 0, transno 17179872987 00000100:00100000:0.0:1746065131.820277:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259836544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.820282:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9ff480/2, rc 0, transno 21474840198 00000100:00100000:0.0:1746065131.820284:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259837184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065131.820289:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085f80/2, rc 0, transno 17179872985 00000100:00100000:0.0:1746065131.820291:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259836160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.820296:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084380/2, rc 0, transno 17179872984 00000100:00100000:0.0:1746065131.820299:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259836672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.820304:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fd880/2, rc 0, transno 21474840197 00000100:00100000:0.0:1746065131.820306:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259837312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.820471:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292416 00000100:00100000:2.0:1746065131.820475:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292416 00000100:00100000:1.0:1746065131.820477:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259836800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.820494:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9186 00000100:00100000:1.0:1746065131.820495:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.820499:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29309:x1830881261292416:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065131.820509:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065131.820520:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf0c expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.820540:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259836800 00000100:00100000:3.0:1746065131.820543:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259836800 00010000:00010000:2.0:1746065131.820556:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf0c expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.820557:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11472 00000100:00100000:3.0:1746065131.820561:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881259836800:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746065131.820568:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf0c expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.820581:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:2.0:1746065131.820584:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065131.820586:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8f400, rc 0) 00000100:00100000:2.0:1746065131.820612:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29309:x1830881261292416:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 113us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.820620:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9186 00000100:00100000:3.0:1746065131.820636:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3298:x1830881259836800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (139us total) trans 17179872988 rc 0/0 00000100:00100000:3.0:1746065131.820640:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11472 00000004:00080000:1.0:1746065131.820701:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5883100/2, rc 0, transno 17179872988 00000100:00100000:1.0:1746065131.820705:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259836800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.822032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.822080:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292544 00000100:00100000:2.0:1746065131.822084:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292544 00000100:00100000:2.0:1746065131.822102:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9187 00000100:00100000:2.0:1746065131.822107:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29309:x1830881261292544:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065131.822114:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065131.822122:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8ee00/0x14b4f8542d4f4bc6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf13 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.822165:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4f4bcd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.822172:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4f4bcd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.822179:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4f4bcd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065131.822195:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x309:0x0]: returning size 9223872 00000004:00200000:2.0:1746065131.822199:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065131.822209:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4f4bcd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.822226:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8ee00/0x14b4f8542d4f4bc6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf13 expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.822237:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4f4bcd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf13 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.822242:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:2.0:1746065131.822245:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065131.822247:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec8e400, rc 0) 00000100:00100000:2.0:1746065131.822692:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29309:x1830881261292544:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 583us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.822697:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9187 00000100:00100000:2.0:1746065131.826071:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.826119:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292672 00000100:00100000:1.0:1746065131.826125:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292672 00000100:00100000:1.0:1746065131.826153:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11473 00000100:00100000:1.0:1746065131.826159:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881261292672:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065131.826171:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065131.826184:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf1a expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065131.826205:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 1048576, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x801 00010000:00010000:1.0:1746065131.826219:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.826221:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.826229:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf1a expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065131.826241:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf1a expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065131.826251:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25c000, rc 0) 00000100:00100000:1.0:1746065131.826297:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881261292672:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 137us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065131.826302:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11473 00000100:00100000:1.0:1746065131.826745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.826760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.826772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.826783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.826833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.826887:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292800 00000100:00100000:2.0:1746065131.826890:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292800 00000100:00100000:2.0:1746065131.826905:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293056 00000100:00100000:2.0:1746065131.826907:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293056 00000100:00100000:2.0:1746065131.826916:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293312 00000100:00100000:2.0:1746065131.826917:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293312 00000100:00100000:2.0:1746065131.826924:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292928 00000100:00100000:2.0:1746065131.826925:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292928 00000100:00100000:2.0:1746065131.826934:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293184 00000100:00100000:2.0:1746065131.826935:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293184 00000100:00100000:2.0:1746065131.826943:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11474 00000100:00100000:2.0:1746065131.826948:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881261292800:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065131.826954:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065131.826964:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf21 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065131.826977:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x379:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x821 00010000:00010000:2.0:1746065131.826984:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.826985:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.826989:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf21 expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065131.827137:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11475 00000100:00100000:0.0:1746065131.827143:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261293056:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065131.827150:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.827157:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf2f expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065131.827169:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x81d 00010000:00010000:0.0:1746065131.827175:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.827177:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.827180:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf2f expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.827193:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf2f expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.827200:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092dab200, rc 0) 00000100:00100000:0.0:1746065131.827221:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261293056:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 79us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.827226:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11475 00000100:00100000:0.0:1746065131.827241:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11476 00000100:00100000:0.0:1746065131.827245:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881261293312:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065131.827250:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.827266:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf3d expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065131.827277:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37b:0x0] initial LVB size: 4194304, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x1029 00010000:00010000:0.0:1746065131.827284:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.827286:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.827289:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf3d expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.827298:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf3d expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.827304:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092daa200, rc 0) 00000100:00100000:0.0:1746065131.827319:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261293312:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 74us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.827327:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11476 00000100:00100000:0.0:1746065131.827339:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11477 00000100:00100000:0.0:1746065131.827344:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881261292928:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065131.827349:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.827357:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf28 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065131.827365:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x37a:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x821 00010000:00010000:0.0:1746065131.827372:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.827373:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.827377:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf28 expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.827384:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf28 expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.827390:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092daa400, rc 0) 00000100:00100000:0.0:1746065131.827405:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261292928:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 61us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.827409:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11477 00000100:00100000:0.0:1746065131.827418:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11478 00000100:00100000:0.0:1746065131.827427:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881261293184:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065131.827432:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.827439:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf36 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065131.827452:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 5029568, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x16a9 00010000:00010000:0.0:1746065131.827459:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.827460:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.827464:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf36 expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.827471:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf36 expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.827477:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092dab800, rc 0) 00000100:00100000:0.0:1746065131.827493:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261293184:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 70us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.827497:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11478 00010000:00010000:2.0:1746065131.827595:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf21 expref: 15 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065131.827602:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd34800, rc 0) 00000100:00100000:2.0:1746065131.827617:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881261292800:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 669us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.827622:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11474 00000100:00100000:1.0:1746065131.835277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.835438:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293568 00000100:00100000:3.0:1746065131.835447:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293568 00000100:00100000:3.0:1746065131.835495:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5251 00000100:00100000:3.0:1746065131.835502:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261293568:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065131.835534:0:21481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.835546:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.835548:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.835552:0:21481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.835563:0:21481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.838846:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.839372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.839589:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293824 00000100:00100000:0.0:1746065131.839597:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293824 00000100:00100000:0.0:1746065131.839638:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294080 00000100:00100000:0.0:1746065131.839640:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294080 00000100:00100000:0.0:1746065131.839656:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5252 00000100:00100000:0.0:1746065131.839662:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261293824:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065131.839689:0:8434:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.839701:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.839702:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.839706:0:8434:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.839722:0:8434:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.840936:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5253 00000100:00100000:0.0:1746065131.840944:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881261294080:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065131.840963:0:11197:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.840971:0:11197:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.840972:0:11197:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.840975:0:11197:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.840983:0:11197:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.842240:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.842957:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294336 00000100:00100000:1.0:1746065131.842964:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294336 00000100:00100000:1.0:1746065131.843006:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5254 00000100:00100000:1.0:1746065131.843013:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261294336:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065131.843036:0:21482:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.843051:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.843052:0:21482:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.843056:0:21482:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.843069:0:21482:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.844311:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.844902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.845216:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294592 00000100:00100000:3.0:1746065131.845222:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294592 00000100:00100000:3.0:1746065131.845250:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294976 00000100:00100000:3.0:1746065131.845252:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294976 00000100:00100000:3.0:1746065131.845274:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5255 00000100:00100000:3.0:1746065131.845280:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261294592:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065131.845302:0:21488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.845312:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.845313:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.845317:0:21488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.845327:0:21488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.845473:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.845503:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065131.845520:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295104 00000100:00100000:1.0:1746065131.845523:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295104 00000100:00100000:1.0:1746065131.845543:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295360 00000100:00100000:1.0:1746065131.845545:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295360 00000100:00100000:1.0:1746065131.845557:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5256 00000100:00100000:1.0:1746065131.845562:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881261294976:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065131.845575:0:21487:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.845582:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.845584:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.845587:0:21487:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.845594:0:21487:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.845899:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5257 00000100:00100000:1.0:1746065131.845905:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881261295104:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065131.845921:0:21486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.845932:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.845933:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.845936:0:21486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.845942:0:21486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.846166:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5258 00000100:00100000:1.0:1746065131.846173:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881261295360:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065131.846187:0:21484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.846310:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065131.846486:0:21484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.846487:0:21484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065131.846490:0:21484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.846497:0:21484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.851953:0:21481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.851969:0:21481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.851976:0:21481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.851982:0:21481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0133e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065131.851985:0:21481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.851992:0:21481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.852006:0:21481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.852012:0:21481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0133e00/0x14b4f8542d4f4bfe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.852085:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881261293568:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 16580us (16812us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065131.852093:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5251 00010000:00010000:1.0:1746065131.861014:0:8434:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.861943:0:8434:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.861955:0:8434:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.861962:0:8434:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092daaa00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065131.861965:0:8434:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.861972:0:8434:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.861986:0:8434:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.861990:0:8434:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092daaa00/0x14b4f8542d4f4c05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.862182:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881261293824:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 22515us (23337us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065131.862191:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5252 00010000:00010000:3.0:1746065131.880759:0:21488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.880780:0:21488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.880788:0:21488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.880794:0:21488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c5f400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065131.880798:0:21488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.880804:0:21488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.880834:0:21488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.880839:0:21488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.880909:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881261294592:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 35626us (36598us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746065131.880916:0:11197:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.880918:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5255 00010000:00010000:2.0:1746065131.880926:0:11197:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.880933:0:11197:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.880938:0:11197:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092daa600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065131.880941:0:11197:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.880947:0:11197:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.880956:0:11197:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.880965:0:11197:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092daa600/0x14b4f8542d4f4c0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.881000:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881261294080:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 40057us (41628us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065131.881006:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5253 00010000:00010000:1.0:1746065131.881337:0:21482:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.881344:0:21482:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.881349:0:21482:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.881353:0:21482:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25d600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065131.881356:0:21482:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.881362:0:21482:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.881371:0:21482:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.881375:0:21482:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c25d600/0x14b4f8542d4f4c13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21482 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.881421:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261294336:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 38408us (39184us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065131.881427:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5254 00010000:00010000:2.0:1746065131.886536:0:21486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.886551:0:21486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.886559:0:21486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.886565:0:21486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25ca00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065131.886568:0:21486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.886574:0:21486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.886590:0:21486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.886596:0:21486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4f4c28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.886677:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881261295104:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 40767us (41200us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065131.886686:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5257 00010000:00010000:1.0:1746065131.891600:0:21487:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.891615:0:21487:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.891622:0:21487:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.891628:0:21487:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25d800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065131.891631:0:21487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.891639:0:21487:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.891655:0:21487:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.891661:0:21487:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c25d800/0x14b4f8542d4f4c21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.891741:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881261294976:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 46174us (46835us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065131.891751:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5256 00010000:00010000:1.0:1746065131.892294:0:21484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.892302:0:21484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.892307:0:21484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.892311:0:21484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25d200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065131.892313:0:21484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.892318:0:21484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.892327:0:21484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065131.892580:0:21484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d200/0x14b4f8542d4f4c2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065131.893364:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881261295360:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 47188us (47856us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065131.893371:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5258 00000100:00100000:0.0:1746065131.901087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.901326:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295616 00000100:00100000:2.0:1746065131.901333:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295616 00000100:00100000:2.0:1746065131.901367:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9188 00000100:00100000:2.0:1746065131.901375:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29309:x1830881261295616:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:2.0:1746065131.901414:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065131.901435:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8e400/0x14b4f8542d4f4bcd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x309:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf13 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.901465:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:2.0:1746065131.901468:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065131.901534:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.901543:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.901551:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00010000:2.0:1746065131.901685:0:14643:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008fc5ad80 reply state ffff880093ed8000 transno 8589943265 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:2.0:1746065131.901691:0:14643:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065131.901756:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:29309:x1830881261295616:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 381us (675us total) trans 8589943265 rc 0/0 00000100:00100000:2.0:1746065131.901764:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9188 00000100:00100000:0.0:1746065131.903963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065131.904038:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.904046:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.904052:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.904057:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55c3000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065131.904061:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.904067:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.904078:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:2.0:1746065131.904080:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065131.904083:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065131.904087:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55c3000/0x14b4f8542d4f4c36 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00000100:00100000:3.0:1746065131.904154:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295744 00000100:00100000:3.0:1746065131.904161:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295744 00000100:00100000:3.0:1746065131.904200:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11479 00000100:00100000:3.0:1746065131.904207:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:29309:x1830881261295744:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065131.904223:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065131.904234:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5ea00/0x14b4f8542d4f4c3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf44 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.904265:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf1a expref: 30 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065131.904883:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.904885:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.904891:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5ea00/0x14b4f8542d4f4c3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf44 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.904929:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf1a expref: 30 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065131.904940:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf1a expref: 30 pid: 21998 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746065131.904952:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259837568:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065131.905048:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065131.907336:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259837568:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065131.907360:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5ea00/0x14b4f8542d4f4c3d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf44 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.907373:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5ea00, rc 0) 00000100:00100000:3.0:1746065131.907414:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:29309:x1830881261295744:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3207us (3454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.907425:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11479 00000100:00100000:0.0:1746065131.909087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.909514:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295872 00000100:00100000:2.0:1746065131.909521:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295872 00010000:00010000:2.0:1746065131.909552:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf1a expref: 30 pid: 21998 timeout: 831 lvb_type: 1 00000100:00100000:2.0:1746065131.909586:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5710 00000100:00100000:2.0:1746065131.909593:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261295872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065131.909605:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065131.909625:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf1a expref: 30 pid: 21998 timeout: 831 lvb_type: 1 00010000:00010000:2.0:1746065131.909635:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf1a expref: 30 pid: 21998 timeout: 831 lvb_type: 1 00010000:00010000:2.0:1746065131.909655:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4f4bd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf1a expref: 30 pid: 21998 timeout: 831 lvb_type: 1 00010000:00010000:2.0:1746065131.910831:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.910835:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.910843:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c5ea00/0x14b4f8542d4f4c3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf44 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.910852:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5ea00/0x14b4f8542d4f4c3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf44 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.910884:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c5ea00/0x14b4f8542d4f4c3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf44 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.910894:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259837696:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065131.911129:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065131.913199:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259837696:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065131.913216:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065131.913265:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261295872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3671us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.913277:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5710 00000100:00100000:0.0:1746065131.913335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.913715:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296000 00000100:00100000:3.0:1746065131.913721:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296000 00000100:00100000:3.0:1746065131.913760:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11480 00000100:00100000:3.0:1746065131.913767:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:29309:x1830881261296000:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065131.913782:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065131.913797:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f4c44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf4b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.913849:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf21 expref: 16 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065131.913856:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.913857:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.913860:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f4c44 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf4b expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.913882:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf21 expref: 16 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065131.913893:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf21 expref: 16 pid: 4545 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746065131.913903:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259837824:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065131.914009:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.915098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.915168:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259837824:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065131.915190:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f4c44 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf4b expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.915202:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5ee00, rc 0) 00000100:00100000:3.0:1746065131.915238:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:29309:x1830881261296000:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1471us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.915244:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11480 00000100:00100000:2.0:1746065131.915309:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296128 00000100:00100000:2.0:1746065131.915313:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296128 00010000:00010000:2.0:1746065131.915327:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf21 expref: 16 pid: 4545 timeout: 831 lvb_type: 1 00000100:00100000:2.0:1746065131.915359:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5711 00000100:00100000:2.0:1746065131.915365:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881261296128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065131.915373:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065131.915389:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf21 expref: 16 pid: 4545 timeout: 831 lvb_type: 1 00010000:00010000:2.0:1746065131.915398:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf21 expref: 16 pid: 4545 timeout: 831 lvb_type: 1 00010000:00010000:2.0:1746065131.915606:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd34800/0x14b4f8542d4f4bdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf21 expref: 16 pid: 4545 timeout: 831 lvb_type: 1 00010000:00010000:2.0:1746065131.915616:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.915617:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.915623:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f4c44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf4b expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.915630:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f4c44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf4b expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.915651:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c5ee00/0x14b4f8542d4f4c44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf4b expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065131.915661:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259837952:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065131.915878:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065131.916860:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259837952:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065131.916872:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065131.916893:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881261296128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1528us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.916901:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5711 00000100:00100000:0.0:1746065131.917163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.917442:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296256 00000100:00100000:3.0:1746065131.917447:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296256 00000100:00100000:3.0:1746065131.917470:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11481 00000100:00100000:3.0:1746065131.917476:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:29309:x1830881261296256:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065131.917487:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065131.917500:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf52 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.917521:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf28 expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065131.917528:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.917529:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.917532:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c4b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf52 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.917548:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf28 expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065131.917558:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf28 expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746065131.917572:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259838080:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065131.917633:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065131.919366:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259838080:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065131.919386:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c4b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf52 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.919401:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5f400, rc 0) 00000100:00100000:3.0:1746065131.919437:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:29309:x1830881261296256:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1961us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.919442:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11481 00000100:00100000:2.0:1746065131.919616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.919705:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296384 00000100:00100000:3.0:1746065131.919710:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296384 00010000:00010000:3.0:1746065131.919725:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf28 expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746065131.919926:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5712 00000100:00100000:3.0:1746065131.919933:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881261296384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065131.919943:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065131.919962:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf28 expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.919971:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf28 expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.919997:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092daa400/0x14b4f8542d4f4bf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf28 expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.920009:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.920011:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.920016:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf52 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.920023:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf52 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.920041:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c5f400/0x14b4f8542d4f4c4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf52 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.920049:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259838208:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065131.920264:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065131.921575:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259838208:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065131.921587:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065131.921608:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881261296384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1675us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.921615:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5712 00000100:00100000:0.0:1746065131.921896:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.921988:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296512 00000100:00100000:3.0:1746065131.921992:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296512 00000100:00100000:3.0:1746065131.922017:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11482 00000100:00100000:3.0:1746065131.922022:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:29309:x1830881261296512:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065131.922035:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065131.922045:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c5ec00/0x14b4f8542d4f4c52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf59 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.922061:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf2f expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065131.922068:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.922069:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.922072:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5ec00/0x14b4f8542d4f4c52 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf59 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.922087:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf2f expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065131.922096:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf2f expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746065131.922104:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259838336:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065131.922899:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065131.924491:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259838336:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065131.924512:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c5ec00/0x14b4f8542d4f4c52 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf59 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.924524:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5ec00, rc 0) 00000100:00100000:3.0:1746065131.924567:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:29309:x1830881261296512:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2543us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.924574:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11482 00000100:00100000:0.0:1746065131.924952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.925072:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296640 00000100:00100000:3.0:1746065131.925076:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296640 00010000:00010000:3.0:1746065131.925095:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf2f expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746065131.925534:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5713 00000100:00100000:3.0:1746065131.925541:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261296640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065131.925555:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065131.925573:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf2f expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.925583:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf2f expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.925600:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092dab200/0x14b4f8542d4f4be2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf2f expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.925610:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.925612:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.925617:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c5ec00/0x14b4f8542d4f4c52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf59 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.925623:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c5ec00/0x14b4f8542d4f4c52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf59 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.925646:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c5ec00/0x14b4f8542d4f4c52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf59 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.925655:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259838464:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065131.925737:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.926951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.927015:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259838464:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065131.927028:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065131.927090:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261296640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1548us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.927097:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5713 00000100:00100000:2.0:1746065131.927189:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296768 00000100:00100000:2.0:1746065131.927194:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296768 00000100:00100000:2.0:1746065131.927326:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11483 00000100:00100000:2.0:1746065131.927332:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:29309:x1830881261296768:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065131.927345:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065131.927358:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55c3a00/0x14b4f8542d4f4c59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf60 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.927376:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf36 expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065131.927382:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.927383:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.927386:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55c3a00/0x14b4f8542d4f4c59 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf60 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.927403:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf36 expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065131.927415:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf36 expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00000100:00100000:2.0:1746065131.927424:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259838592:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065131.927733:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065131.928330:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881259838592:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065131.928345:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55c3a00/0x14b4f8542d4f4c59 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf60 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.928354:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55c3a00, rc 0) 00000100:00100000:2.0:1746065131.928370:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:29309:x1830881261296768:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1039us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.928375:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11483 00000100:00100000:1.0:1746065131.929474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.929568:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296896 00000100:00100000:3.0:1746065131.929573:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296896 00010000:00010000:3.0:1746065131.929591:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf36 expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746065131.929618:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5714 00000100:00100000:3.0:1746065131.929624:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261296896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065131.929632:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065131.929647:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf36 expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.929656:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf36 expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.929671:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092dab800/0x14b4f8542d4f4bf7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf36 expref: 30 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.929685:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.929686:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.929691:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55c3a00/0x14b4f8542d4f4c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf60 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.929698:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55c3a00/0x14b4f8542d4f4c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf60 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.929718:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55c3a00/0x14b4f8542d4f4c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf60 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.929727:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259838720:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065131.929782:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065131.930910:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881259838720:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065131.930914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065131.930923:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065131.930952:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881261296896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1328us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.930959:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5714 00000100:00100000:2.0:1746065131.931048:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297024 00000100:00100000:2.0:1746065131.931052:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297024 00000100:00100000:2.0:1746065131.931083:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11484 00000100:00100000:2.0:1746065131.931089:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013071a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:29309:x1830881261297024:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065131.931100:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065131.931112:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093967600/0x14b4f8542d4f4c60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf67 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.931128:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf3d expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065131.931138:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.931139:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065131.931142:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093967600/0x14b4f8542d4f4c60 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf67 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.931160:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf3d expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065131.931169:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf3d expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00000100:00100000:2.0:1746065131.931182:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259838848:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065131.931235:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065131.932385:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881259838848:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065131.932403:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093967600/0x14b4f8542d4f4c60 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf67 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.932412:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093967600, rc 0) 00000100:00100000:2.0:1746065131.932444:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013071a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:29309:x1830881261297024:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1355us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.932450:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11484 00000100:00100000:0.0:1746065131.932635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.932937:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297152 00000100:00100000:3.0:1746065131.932942:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297152 00010000:00010000:3.0:1746065131.932958:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf3d expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00000100:00100000:3.0:1746065131.932974:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5715 00000100:00100000:3.0:1746065131.932979:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881261297152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065131.932987:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065131.933002:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf3d expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.933010:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf3d expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.933025:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092daa200/0x14b4f8542d4f4be9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf3d expref: 16 pid: 9716 timeout: 831 lvb_type: 1 00010000:00010000:3.0:1746065131.933034:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.933035:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065131.933039:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093967600/0x14b4f8542d4f4c60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf67 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.933046:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093967600/0x14b4f8542d4f4c60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf67 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.933186:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093967600/0x14b4f8542d4f4c60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf67 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065131.933196:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259838976:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065131.933443:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.935475:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.935499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.935525:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.935537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.935555:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297280 00000100:00100000:0.0:1746065131.935560:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297280 00000100:00100000:0.0:1746065131.935586:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297536 00000100:00100000:0.0:1746065131.935588:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297536 00000100:00100000:0.0:1746065131.935599:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297792 00000100:00100000:0.0:1746065131.935601:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297792 00000100:00100000:0.0:1746065131.935610:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297408 00000100:00100000:0.0:1746065131.935612:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297408 00000100:00100000:0.0:1746065131.935624:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11485 00000100:00100000:0.0:1746065131.935629:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261297280:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065131.935789:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065131.935792:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.935794:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.935796:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065131 -> 1746065132 00002000:00010000:0.0:1746065131.935797:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:0.0:1746065131.935854:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261297280:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 223us (382us total) trans 17179872989 rc 0/0 00000100:00100000:0.0:1746065131.935859:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11485 00000100:00100000:2.0:1746065131.935880:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11486 00000100:00100000:2.0:1746065131.935892:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881261297536:12345-192.168.202.46@tcp:2:lfs.0 00000100:00100000:3.0:1746065131.935939:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881259838976:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065131.935955:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065131.935970:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881261297152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2992us (3337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065131.935977:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5715 00002000:00010000:2.0:1746065131.935986:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065131.935989:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.935991:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.935993:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065131 -> 1746065132 00002000:00010000:2.0:1746065131.935994:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065131.936012:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881261297536:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 121us (511us total) trans 21474840201 rc 0/0 00000100:00100000:0.0:1746065131.936521:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11487 00000100:00100000:0.0:1746065131.936529:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881261297792:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065131.936594:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:0.0:1746065131.936597:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.936599:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.936601:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065131 -> 1746065132 00002000:00010000:0.0:1746065131.936602:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5801 -> 5801 00000100:00100000:0.0:1746065131.936620:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261297792:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 93us (1094us total) trans 17179872990 rc 0/0 00000100:00100000:0.0:1746065131.936626:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11487 00000100:00100000:0.0:1746065131.936639:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11488 00000100:00100000:0.0:1746065131.936644:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881261297408:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065131.936708:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065131.936710:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00000100:00100000:2.0:1746065131.936711:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11486 00002000:00010000:0.0:1746065131.936712:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.936713:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065131 -> 1746065132 00002000:00010000:0.0:1746065131.936715:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065131.936730:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881261297408:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 86us (1191us total) trans 21474840202 rc 0/0 00000100:00100000:0.0:1746065131.936735:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11488 00000100:00100000:0.0:1746065131.936799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065131.936830:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297664 00000100:00100000:0.0:1746065131.936834:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297664 00000100:00100000:0.0:1746065131.936852:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11489 00000100:00100000:0.0:1746065131.937142:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881261297664:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065131.937205:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065131.937208:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.937209:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.937211:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065131 -> 1746065132 00002000:00010000:0.0:1746065131.937213:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065131.937230:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881261297664:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 374us (430us total) trans 17179872991 rc 0/0 00000100:00100000:0.0:1746065131.937235:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11489 00000100:00100000:0.0:1746065131.937307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.937436:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297920 00000100:00100000:2.0:1746065131.937439:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297920 00000100:00100000:2.0:1746065131.937456:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 11490 00000100:00100000:2.0:1746065131.937460:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881261297920:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:2.0:1746065131.937526:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065131.937528:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.937530:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.937532:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065131 -> 1746065132 00002000:00010000:2.0:1746065131.937533:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746065131.938391:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881261297920:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 927us (1081us total) trans 21474840203 rc 0/0 00000100:00100000:2.0:1746065131.938397:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 11490 00000100:00100000:0.0:1746065131.940715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.940804:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298176 00000100:00100000:3.0:1746065131.940811:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298176 00000100:00100000:3.0:1746065131.940872:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3781 00000100:00100000:3.0:1746065131.940878:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:29309:x1830881261298176:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:3.0:1746065131.940922:0:16801:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x309:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cab800/0x14b4f8542d4f4b80 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf05 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.940957:0:16801:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065131.940966:0:16801:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf0c expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.940972:0:16801:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065131.940993:0:16801:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf0c expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065131.941002:0:16801:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf0c expref: 250 pid: 14644 timeout: 831 lvb_type: 0 00000100:00100000:3.0:1746065131.941013:0:16801:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16801:1830881259839104:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065131.941090:0:16801:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065131.943197:0:16801:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16801:1830881259839104:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065131.943197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065131.943215:0:16801:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00000100:00100000:2.0:1746065131.943288:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298304 00000100:00100000:2.0:1746065131.943294:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298304 00010000:00010000:2.0:1746065131.943315:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf0c expref: 251 pid: 14644 timeout: 831 lvb_type: 0 00000100:00100000:2.0:1746065131.943352:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 5716 00000100:00100000:2.0:1746065131.943364:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1961:x1830881261298304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065131.943377:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065131.943382:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf0c expref: 251 pid: 14644 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746065131.943390:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf0c expref: 251 pid: 14644 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746065131.943406:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec8f400/0x14b4f8542d4f4bbf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf0c expref: 251 pid: 14644 timeout: 831 lvb_type: 0 00010000:00010000:2.0:1746065131.943437:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:2.0:1746065131.943441:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00010000:00010000:2.0:1746065131.943448:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16801 initiator: MDT0 00010000:00010000:2.0:1746065131.943453:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16801 initiator: MDT0 00010000:00010000:2.0:1746065131.943477:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065131.943511:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1961:x1830881261298304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 147us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.943517:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 5716 00010000:00010000:3.0:1746065131.943581:0:16801:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065131.943587:0:16801:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00000040:00080000:3.0:1746065131.944644:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2675, 88 off225232 00000004:00080000:3.0:1746065131.944650:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731235834067ns, next at 732087329117ns, rc = 0 00000040:00080000:3.0:1746065131.945155:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2599, 88 off218360 00000004:00080000:3.0:1746065131.945160:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731236344308ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065131.945187:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2600, 88 off218448 00000004:00080000:3.0:1746065131.945190:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731236374580ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065131.945198:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2676, 88 off225320 00000004:00080000:3.0:1746065131.945200:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731236384740ns, next at 732087329117ns, rc = 0 00000040:00080000:3.0:1746065131.945206:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2677, 88 off225408 00000004:00080000:3.0:1746065131.945208:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731236392987ns, next at 732087329117ns, rc = 0 00000040:00080000:3.0:1746065131.945215:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2601, 88 off218536 00000004:00080000:3.0:1746065131.945217:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731236401722ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065131.945223:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2602, 88 off218624 00000004:00080000:3.0:1746065131.945226:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731236410690ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065131.945232:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2603, 88 off218712 00000004:00080000:3.0:1746065131.945234:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731236418828ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065131.945240:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2678, 88 off225496 00000004:00080000:3.0:1746065131.945243:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731236427630ns, next at 732087329117ns, rc = 0 00000040:00080000:3.0:1746065131.945248:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2604, 88 off218800 00000004:00080000:3.0:1746065131.945250:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731236435287ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065131.945266:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2679, 88 off225584 00000004:00080000:3.0:1746065131.945269:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731236454175ns, next at 732087329117ns, rc = 0 00000040:00080000:3.0:1746065131.945276:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2605, 88 off218888 00000004:00080000:3.0:1746065131.945278:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731236463092ns, next at 666938887344ns, rc = 0 00000040:00080000:3.0:1746065131.945284:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2680, 88 off225672 00000004:00080000:3.0:1746065131.945286:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731236471270ns, next at 732087329117ns, rc = 0 00000040:00080000:3.0:1746065131.945292:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2681, 88 off225760 00000004:00080000:3.0:1746065131.945294:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731236479095ns, next at 732087329117ns, rc = 0 00000040:00080000:3.0:1746065131.945300:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2682, 88 off225848 00000004:00080000:3.0:1746065131.945303:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731236487397ns, next at 732087329117ns, rc = 0 00000040:00080000:3.0:1746065131.945309:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2683, 88 off225936 00000004:00080000:3.0:1746065131.945311:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731236495457ns, next at 732087329117ns, rc = 0 00000040:00080000:3.0:1746065131.945317:0:16801:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2606, 88 off218976 00000004:00080000:3.0:1746065131.945319:0:16801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731236503823ns, next at 666938887344ns, rc = 0 00000001:00080000:2.0:1746065131.975954:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943265 is committed 00000001:00080000:2.0:1746065131.975967:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943266 is committed 00000004:00080000:2.0:1746065131.975970:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1898 committed 00000004:00080000:2.0:1746065131.975977:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1976 committed 00000004:00080000:2.0:1746065131.975981:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1975 committed 00000004:00080000:2.0:1746065131.975983:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1974 committed 00000004:00080000:2.0:1746065131.975985:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1973 committed 00000004:00080000:2.0:1746065131.975987:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1897 committed 00000004:00080000:2.0:1746065131.975988:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1972 committed 00000004:00080000:2.0:1746065131.975989:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1896 committed 00000004:00080000:2.0:1746065131.975991:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1971 committed 00000004:00080000:2.0:1746065131.975992:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1895 committed 00000004:00080000:2.0:1746065131.975994:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1894 committed 00000004:00080000:2.0:1746065131.975995:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1893 committed 00000004:00080000:2.0:1746065131.975996:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1970 committed 00000004:00080000:2.0:1746065131.975997:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1969 committed 00000004:00080000:2.0:1746065131.975999:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1892 committed 00000004:00080000:2.0:1746065131.976000:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1891 committed 00000004:00080000:2.0:1746065131.976001:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1968 committed 00000100:00100000:2.0:1746065131.976098:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259839232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.976160:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.976193:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259839744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.976206:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.976220:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065131.976224:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259839360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.976237:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.976247:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259839872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.976275:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.976293:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259839488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.976306:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.976317:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259840000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.976327:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.976336:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065131.976340:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259839616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.976352:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.976361:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259840128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.976371:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.976391:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259839232 00000100:00100000:2.0:1746065131.976397:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259839232 00000100:00100000:2.0:1746065131.976422:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259839744 00000100:00100000:2.0:1746065131.976424:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259839744 00000100:00100000:2.0:1746065131.976432:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259839360 00000100:00100000:2.0:1746065131.976433:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259839360 00000100:00100000:2.0:1746065131.976439:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259839872 00000100:00100000:2.0:1746065131.976440:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259839872 00000100:00100000:2.0:1746065131.976446:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259839488 00000100:00100000:2.0:1746065131.976448:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259839488 00000100:00100000:2.0:1746065131.976453:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259840000 00000100:00100000:2.0:1746065131.976455:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259840000 00000100:00100000:2.0:1746065131.976459:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259839616 00000100:00100000:2.0:1746065131.976461:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259839616 00000100:00100000:2.0:1746065131.976466:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259840128 00000100:00100000:2.0:1746065131.976467:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259840128 00000100:00100000:2.0:1746065131.976476:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11491 00000100:00100000:2.0:1746065131.976482:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881259839232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065131.976629:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065131.976632:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.976634:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.976635:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb ctime from disk: 1746065132 -> 1746065132 00002000:00010000:2.0:1746065131.976637:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x379:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065131.976663:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259839232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (502us total) trans 21474840204 rc 0/0 00000100:00100000:2.0:1746065131.976669:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11491 00000100:00100000:2.0:1746065131.976687:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11492 00000100:00100000:2.0:1746065131.976692:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881259839744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.976771:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259839744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (564us total) trans 21474840205 rc 0/0 00000100:00100000:2.0:1746065131.976776:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11492 00000100:00100000:2.0:1746065131.976787:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11493 00000100:00100000:2.0:1746065131.976791:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881259839360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065131.976875:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065131.976877:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.976879:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.976881:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb ctime from disk: 1746065132 -> 1746065132 00002000:00010000:2.0:1746065131.976882:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065131.976900:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259839360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (662us total) trans 21474840206 rc 0/0 00000100:00100000:2.0:1746065131.976904:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11493 00000100:00100000:2.0:1746065131.976914:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11494 00000100:00100000:2.0:1746065131.976918:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881259839872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065131.976980:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065131.976982:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065131.976984:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065131.976985:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065131.976987:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065131.977004:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881259839872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (728us total) trans 21474840207 rc 0/0 00000100:00100000:2.0:1746065131.977009:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11494 00000100:00100000:2.0:1746065131.977018:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11495 00000100:00100000:2.0:1746065131.977022:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881259839488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065131.977093:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065131.977095:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.977096:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.977098:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb ctime from disk: 1746065132 -> 1746065132 00002000:00010000:2.0:1746065131.977099:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37b:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746065131.977119:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259839488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (811us total) trans 21474840208 rc 0/0 00000100:00100000:2.0:1746065131.977124:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11495 00000100:00100000:2.0:1746065131.977134:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11496 00000100:00100000:2.0:1746065131.977138:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881259840000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065131.977196:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065131.977198:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065131.977199:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065131.977201:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065131.977202:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x37e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065131.977219:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259840000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (891us total) trans 21474840209 rc 0/0 00000100:00100000:2.0:1746065131.977224:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11496 00000100:00100000:2.0:1746065131.977234:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11497 00000100:00100000:2.0:1746065131.977238:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881259839616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.977328:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259839616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (974us total) trans 21474840210 rc 0/0 00000100:00100000:2.0:1746065131.977333:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11497 00000100:00100000:2.0:1746065131.977342:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11498 00000100:00100000:2.0:1746065131.977346:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881259840128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065131.977420:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881259840128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1046us total) trans 21474840211 rc 0/0 00000100:00100000:2.0:1746065131.977425:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11498 00000004:00080000:2.0:1746065131.977468:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913faa00/2, rc 0, transno 21474840210 00000100:00100000:2.0:1746065131.977472:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259839616:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065131.977479:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fbb80/2, rc 0, transno 21474840211 00000100:00100000:2.0:1746065131.977481:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259840128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065131.977487:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fa300/2, rc 0, transno 21474840208 00000100:00100000:2.0:1746065131.977489:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259839488:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065131.977494:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fb800/2, rc 0, transno 21474840209 00000100:00100000:2.0:1746065131.977496:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881259840000:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065131.977511:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f9880/2, rc 0, transno 21474840206 00000100:00100000:2.0:1746065131.977514:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259839360:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065131.977520:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fad80/2, rc 0, transno 21474840207 00000100:00100000:2.0:1746065131.977522:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259839872:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065131.977527:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fb100/2, rc 0, transno 21474840204 00000100:00100000:2.0:1746065131.977529:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259839232:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065131.977535:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f9500/2, rc 0, transno 21474840205 00000100:00100000:2.0:1746065131.977537:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881259839744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065131.977662:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259840384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.977687:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.977706:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259840896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.977718:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.977728:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065131.977732:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259840256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.977745:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.977755:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259840768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.977766:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.977785:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259840384 00000100:00100000:0.0:1746065131.977788:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259840384 00000100:00100000:0.0:1746065131.977802:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259840896 00000100:00100000:0.0:1746065131.977804:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259840896 00000100:00100000:0.0:1746065131.977810:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259840256 00000100:00100000:0.0:1746065131.977812:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259840256 00000100:00100000:0.0:1746065131.977838:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259840768 00000100:00100000:0.0:1746065131.977840:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259840768 00000100:00100000:0.0:1746065131.977847:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11499 00000100:00100000:0.0:1746065131.977851:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3296:x1830881259840384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065131.977938:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065131.977940:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.977942:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.977944:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb ctime from disk: 1746065132 -> 1746065132 00002000:00010000:0.0:1746065131.977945:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37f:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065131.977966:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881259840384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (278us total) trans 17179872992 rc 0/0 00000100:00100000:0.0:1746065131.977971:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11499 00000100:00100000:0.0:1746065131.977983:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11500 00000100:00100000:0.0:1746065131.977987:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3296:x1830881259840896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065131.978047:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065131.978050:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.978051:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.978053:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.978054:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x383:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065131.978071:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881259840896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (352us total) trans 17179872993 rc 0/0 00000100:00100000:0.0:1746065131.978076:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11500 00000100:00100000:0.0:1746065131.978087:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11501 00000100:00100000:0.0:1746065131.978091:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3296:x1830881259840256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065131.978157:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065131.978159:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.978161:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.978163:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 1746065132 -> 1746065132 00002000:00010000:0.0:1746065131.978165:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:0.0:1746065131.978180:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881259840256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (435us total) trans 17179872994 rc 0/0 00000100:00100000:0.0:1746065131.978188:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11501 00000100:00100000:0.0:1746065131.978199:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11502 00000100:00100000:0.0:1746065131.978203:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3296:x1830881259840768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065131.978269:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065131.978270:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.978272:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.978273:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.978275:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065131.978292:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881259840768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (524us total) trans 17179872995 rc 0/0 00000100:00100000:0.0:1746065131.978297:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11502 00000004:00080000:0.0:1746065131.978332:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc5b480/2, rc 0, transno 17179872994 00000100:00100000:0.0:1746065131.978338:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259840256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.978344:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc59c00/2, rc 0, transno 17179872995 00000100:00100000:0.0:1746065131.978347:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259840768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.978352:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc58000/2, rc 0, transno 17179872992 00000100:00100000:0.0:1746065131.978354:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259840384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.978359:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380e300/2, rc 0, transno 17179872993 00000100:00100000:0.0:1746065131.978361:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259840896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.978385:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065131.978390:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259841280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.978406:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.978427:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259841280 00000100:00100000:0.0:1746065131.978430:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259841280 00000100:00100000:0.0:1746065131.978443:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11503 00000100:00100000:0.0:1746065131.978447:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881259841280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.978529:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3296:x1830881259841280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (122us total) trans 17179872996 rc 0/0 00000100:00100000:0.0:1746065131.978533:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11503 00000004:00080000:0.0:1746065131.978550:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380ce00/2, rc 0, transno 17179872996 00000100:00100000:0.0:1746065131.978552:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881259841280:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746065131.978688:0:16801:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008fc5bb80 reply state ffff88008ffb3800 transno 8589943266 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16801 initiator: MDT0 00000100:00100000:3.0:1746065131.978697:0:16801:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065131.978704:0:16801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:3.0:1746065131.978706:0:16801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065131.978712:0:16801:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cab800/0x14b4f8542d4f4b80 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x309:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf05 expref: 248 pid: 14644 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746065131.978772:0:16801:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065131.978781:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29309:x1830881261298176:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 37903us (38072us total) trans 8589943266 rc 0/0 00000100:00100000:3.0:1746065131.978787:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3781 00010000:00010000:3.0:1746065131.978803:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065131.978830:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065131.978836:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065131.978840:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c5e000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065131.978843:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065131.978848:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065131.978857:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff88009f715000) 00010000:00010000:3.0:1746065131.978858:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065131.978861:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16801 initiator: MDT0 00010000:00010000:3.0:1746065131.978864:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5e000/0x14b4f8542d4f4c67 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16801 initiator: MDT0 00000100:00100000:2.0:1746065131.979636:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259840640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.979661:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.979731:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259840640 00000100:00100000:0.0:1746065131.979735:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259840640 00000100:00100000:0.0:1746065131.979752:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11504 00000100:00100000:0.0:1746065131.979757:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881259840640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065131.979850:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065131.979852:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.979854:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.979855:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065131.979857:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065131.979875:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3298:x1830881259840640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (214us total) trans 17179872997 rc 0/0 00000100:00100000:0.0:1746065131.979879:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11504 00000004:00080000:2.0:1746065131.980379:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc5a300/2, rc 0, transno 17179872997 00000100:00100000:2.0:1746065131.980384:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259840640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.980389:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259841152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.980406:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065131.981102:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259841152 00000100:00100000:1.0:1746065131.981107:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259841152 00000100:00100000:1.0:1746065131.981129:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11505 00000100:00100000:1.0:1746065131.981134:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3298:x1830881259841152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065131.981245:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3298:x1830881259841152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (837us total) trans 17179872998 rc 0/0 00000100:00100000:1.0:1746065131.981251:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11505 00000004:00080000:2.0:1746065131.981521:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380c000/2, rc 0, transno 17179872998 00000100:00100000:2.0:1746065131.981525:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259841152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.981533:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065131.981538:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259840512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.981555:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.981566:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259841024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.981577:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065131.981599:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259840512 00000100:00100000:2.0:1746065131.981602:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259840512 00000100:00100000:2.0:1746065131.981613:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881259841024 00000100:00100000:2.0:1746065131.981615:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881259841024 00000100:00100000:2.0:1746065131.981624:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11506 00000100:00100000:2.0:1746065131.981628:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881259840512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065131.981716:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 5029568 -> 5029568 00002000:00010000:2.0:1746065131.981719:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.981721:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:2.0:1746065131.981722:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065132 -> 1746065132 00002000:00010000:2.0:1746065131.981724:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 5801 -> 5801 00000100:00100000:2.0:1746065131.981747:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3298:x1830881259840512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (191us total) trans 17179872999 rc 0/0 00000100:00100000:2.0:1746065131.981753:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11506 00000100:00100000:2.0:1746065131.981763:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11507 00000100:00100000:2.0:1746065131.981767:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881259841024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065131.981868:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3298:x1830881259841024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (289us total) trans 17179873000 rc 0/0 00000100:00100000:2.0:1746065131.981873:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11507 00000004:00080000:3.0:1746065131.982110:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc59500/2, rc 0, transno 17179872999 00000100:00100000:3.0:1746065131.982114:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259840512:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065131.982120:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380ed80/2, rc 0, transno 17179873000 00000100:00100000:3.0:1746065131.982122:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881259841024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.983582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065131.983644:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298432 00000100:00100000:2.0:1746065131.983650:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298432 00000100:00100000:2.0:1746065131.983679:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9189 00000100:00100000:2.0:1746065131.983697:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:29309:x1830881261298432:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065131.983712:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065131.983730:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b64a200/0x14b4f8542d4f4c6e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x309:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5bf6e expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.983774:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b64a200/0x14b4f8542d4f4c6e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf6e expref: 248 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.983785:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b64a200/0x14b4f8542d4f4c6e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x309:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5bf6e expref: 248 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065131.983799:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x309:0x0].0x0 (ffff880133205200) 00010000:00010000:2.0:1746065131.983802:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065131.983804:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b64a200, rc 0) 00000100:00100000:2.0:1746065131.984419:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29309:x1830881261298432:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 720us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065131.984426:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9189 00000100:00100000:0.0:1746065131.989432:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065131.989519:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298688 00000100:00100000:3.0:1746065131.989526:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298688 00000100:00100000:3.0:1746065131.990477:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 3782 00000100:00100000:3.0:1746065131.990490:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:29309:x1830881261298688:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1746065131.990754:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:29309:x1830881261298688:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 266us (1328us total) trans 8589943267 rc 0/0 00000100:00100000:3.0:1746065131.990761:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 3782 00000001:02000400:3.0:1746065132.723468:0:2039:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed 00010000:00010000:3.0:1746065132.848378:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 70125 lines, 70125 kept, 0 dropped, 0 bad.